Friday, April 5, 2024

Data Collection Plan for Total Solar Eclipse 2024

First of all, if you've been watching the weather forecasts, you may have concluded that the total solar eclipse passing through Dallas on Monday will be a bust. Well, don't give up hope, yet. Even though we got clouded out in 2017 on our trip to Marshall, Missouri, as you would see in my post from back then, I still managed to capture of view of totality through the clouds. All it takes is for the clouds to part a bit at just the right time or the clouds to be high altitude and thin for us to still be able to see totality. Regardless of the forecast, be sure to get outside to see what there is to see!

Even if we are clouded out, you'll still experience one aspect of a total solar eclipse: it will get dark! With that in mind, I expect to have a successful day whether I get to see the total eclipse or not. I have a bunch of microcontrollers (ESP32) with sensors that I'll be using to collect data that day. 

That said, you may find that my approach to data collection is a bit unorthodox. Here's part of my setup for data collection. Yes, that is a Nonni's biscotti box. :-D

Seriously, here's the type of data I'll be collecting:

- light levels for visible light and near infrared (lux)
- light spectrum levels in various wavelengths
- environment: temperature, humidity, air pressure
- sound level changes (dB)
- magnetic field changes

WARNING: you may be a geek if you keep reading beyond this point. 

TL;DR

The architecture I'm using builds on infrastructure I already have in place. I use Home Assistant running on a Raspberry Pi for my home automation, control and historical data. Home Assistant supports integrating data sensors using microcontrollers called an ESP32 via a system called ESPHOME. By attaching various sensor components to an ESP32 then configuring it in ESPHOME, it makes it simple to automatically collect sensor data in Home Assistant for storage, retrieval, monitoring and analysis. 

Here is an example of a historical data graph in Home Assistant. The beauty of this besides being able to quickly visualize data is that Home Assistant also makes it easy to download the data for analysis in other tools. 

My original plan was to set things up to collect data through three full days, the day before, of and after the eclipse. Given the prospect of clouds and, more importantly, the forecast for rain on Tuesday, I've scaled back to just trying to collect data in the hours around the eclipse. I considered creating weatherproof enclosures for the sensors but that would have turned a shoestring-budget project into something quite a bit more expensive. 

After things have wrapped up, I'll pull up history for all the sensor devices in Home Assistant and download the data for further analysis.

As for the details of the sensors I'm planning to deploy, let's start with the light sensors. You can see details of the code plus the specific sensors in this gist on github.com. For this sensor package, the ESP32 and the sensors are mounted on a breadboard that is in the bottom of the biscotti box.

The reason is that my goal is to measure changes in ambient light. For various (and technical) reasons, direct sunlight would be more challenging to measure with these sensors. Given we should see a drop in ambient light levels (and color levels) during totality even if it is cloudy, I think the data will be more predictable and meaningful just measuring ambient light. Pointing the sensors straight up and blocking them from direct sunlight should accomplish this. 

One thing you'll see in the ESPHOME code for each sensor package is that they generally report data back to Home Assistant once a minute but include a switch I can turn on that tells the sensor to send measurements every second (or faster). I have Home Assistant automations set up to flip the high speed data collection switch on for each sensor package a little while before the eclipse starts and turn it back off a little while after the eclipse ends. That way once I set things up Sunday evening or Monday morning, I can focus my attention on the eclipse, leaving the data collection to happen automatically. 

On one side of the outside of the box is another ESP32 mounted on a breadboard with a sensor to measure the environment. Here's the gist with the ESPHOME including details on the sensor.  It will collect data on temperature, relative humidity and air pressure. The code also derives absolute humidity and dew point. 

Based on things I have read including published eclipse science projects, we should certainly see a change in temperature as the Moon's umbra passes over us during totality. Relative humidity has an inverse correlation to temperature so I expect to see changes to it that are similar to the temperature changes (but inverted). I have no idea what to expect in terms of changes in absolute humidity, air pressure and dew point but it will be interesting to see if there are changes that match the timing of the eclipse. 

On the other side of the box is an ESP32 with a digital microphone. This one is set up to measure changes in sound levels throughout the eclipse. You'll see in the gist, this is based on a custom ESPHOME component. It provides sound levels in several forms but my interest is in just having the unfiltered (raw) sound levels. 

Measuring changes in sound levels that can correlate to the total phase of the eclipse may be challenging. Although it may "get quiet" in terms of reactions to the darkness by birds and insects, my guess is that loud expressions of joy during totality by folks gathered with us to observe the eclipse may offset any drop in sound levels by nature. 

The last sensor package I've put together was an afterthought. I had one more ESP32 and also had a sensor that is a magnetometer, one that measures changes in magnetic fields in 3 axis. See this gist for the ESPHOME code which includes details of the sensor. The ESP32 I'm using in this case also happens to be much smaller than the others which seemed like to a good idea for a sensor trying to measure changes in local magnetic fields. 

Based on my research, there have been changes in magnetic fields around Earth measured during past total eclipses but those measurements were performed with sophisticated equipment in the upper reaches of the atmosphere or in space. I don't have any reason to expect that I'll measure any changes that correlate to the timing of the eclipse with my simple magnetometer setup but I figure I'll do the data collection and see what happens. 

For this sensor package, I've mounted the sensor on top of a wooden yardstick with the ESP32 below and a Wi-Fi antenna below that. My plan is to have this mounted on a stake well away from structures and people to minimize other magnetic fields nearby. However, that means it's further to the Wi-Fi router, hence the extra antenna. I'm also using a power pack instead of using a power adapter plugged into AC power. This means the only limitation on where I can put this will be how far from the house I get before the Wi-Fi signal drops. 

Sometime next week when I have had time to review and analyze the data collected on Monday, I'll write up my conclusions and share them here. 

Just two days and a wake-up before show-time!

Stay tuned!



Saturday, March 23, 2024

ISS Lunar Transit Mesquite Texas: Composite Image


As I shared in my last post, I was up in the very early hours this morning to catch a unique event, the International Space Station (ISS) passing in front of the Moon, a lunar transit. What I didn't share in that post is why I used the video mode on my Nikon D750 instead of taking individual photos. 

The D750 is a great camera with some powerful capabilities. It has a top capture speed of 6.5 frames per second. Unfortunately, it can't sustain that speed for long. After about a dozen shots, the buffer fills up and the camera slows to closer to 1 frame per second or even 1 every two seconds. With an event that only lasts about 6 tenths of a second, since the camera only shoots at 6.5 frames per second for about 2 seconds, it would take perfect timing to be able to capture any part of the transit. If I started shooting 4 or 5 seconds too soon or too late, I might miss it all together. 

However, with a video mode of 60 frames per second, I just had to start recording well before the start of the transit and then let it run long enough to be sure the transit was over before stopping the camera. Thankfully, when I was scrambling to finish focusing this morning and realized it was almost time for the transit, starting the video and letting it record for a few minutes was enough to capture the transit and capture far more frames with the ISS than I could have even if the D750 could capture images at 6.5 frames per second indefinitely. Using video has its drawbacks, e.g., things in motion (and the ISS moves incredibly fast) inherently have a little blur, even with a really fast shutter speed, but capturing more images with the ISS in them and having a bit more flexibility in starting/stopping the capture was worth it. Perhaps someday I'll get another chance to do this and will try capturing it with images instead of video. 

To create the image above, I went through the video with Lightroom, selecting each frame with the ISS and exporting it as a JPEG file. I then took these files and opened them in Photoshop as levels. By using auto-align and auto-blend, Photoshop produced a single composite image showing the track the ISS took across the Moon. I decided that the first draft was a bit busy so I did it over again just using every other ISS frame to produce this photo. I also applied some intelligent sharpening to make up for the camera being a little out of focus. It's not great but I am satisfied with it. 

Click on the image to see enlarged. Enjoy!

 

ISS Lunar Transit Mesquite Texas



I have captured images of the International Space Station (ISS) passing overhead before but I've never captured an ISS transit. Until now!

Every few weeks I check transit-finder.com to see whether there are solar or lunar transits happening nearby. Earlier this week I found that there would be one early AM this morning. 

Lots of things have to come together just right to see the ISS cross in front of the Sun or the Moon. 
  • A location on the Earth where the ISS passes directly in between that location and the Sun or Moon.
  • The ISS has to be close enough to the Earth for its angular size (how big it appears in the sky) to stand out. My sources indicate it's best when the ISS has an angular size of at least 42 arc seconds. 
  • A time of day or night when there will be enough contrast for the ISS to stand out against the given object. For the Sun, this is pretty straightforward but a transit in front of the Moon when it's up during daylight makes for a more challenging capture. 
  • And, of course, you have to be able to see the event so that means little or no clouds. 
The last few times there's been one in the area, the weather didn't cooperate but this time it was pretty clear. The location was within 15 minutes of home and the ISS was forecast to have an angular size of 59.72 arc seconds. 

A little before midnight, I packed up my equipment and Luna in the car and headed to the area where Linda, Lexie and I used to take walks when we lived in Mesquite. With a tripod, mount, telescope, camera and other gear, I needed a spot where I could set up next to the car so I had to scout a few spots looking for a place without too much bright light, on public property, and with a clear view of Polaris (to align the mount) and the Moon. I finally settled on the parking lot at the Palos Verdes Lake Park. Unfortunately, that chewed up enough time that I was still trying to get a sharp focus on the Moon when I realized it was time for the transit. I went ahead and started video rolling, let it go for a few minutes and then packed things up and headed home. 

Today, sitting down with the video I was thrilled to find I had captured it! The focus is not great but it is clear enough to be able to see the ISS moving across the face of the Moon. The entire event was just over a half a second so shooting at 60 fps I caught about 30 frames of the ISS. 

I'm sharing the video for now. Later, I'll work on putting together a photo that captures the entire event in one image.

Be sure to watch full-screen for the best view of the transit. 

In the meantime, here are the technical details:
SkyWatcher Evostar 72ED
0.85 Focal Reducer/Flattener
2X Teleconverter
Nikon D750 (DX mode)
Deep Sky Dad AF3 focusing motor
60fps video at ISO 3200 1/4000th second shutter speed
SkyWatcher Star Adventurer GTi mount
Radian Carbon Fiber tripod
Edited in DaVinci Resolve 

Event details:
See transit-finder.com screenshot below. The centerline crossed the trail just north of Northwest Drive. I captured this video from the park parking lot (not shown in this diagram but it's at the northwest tip of the lake).