The Daily Parker

Last month we had the second-gloomiest April on record, with only 34% of possible sunshine reaching Chicago all month. Normal is 51%.

I realize May is only 34 hours old, but we haven't gotten any sunshine this month, either, with rain forecast tonight, Tuesday night, and Thursday. Then I'm heading to San Francisco for the weekend, where they haven't had any clouds in a while. I could use the sunshine.

Yesterday we had summer-like temperatures and autumn-like winds in Chicago, with 60 km/h wind gusts from the south. That may have had something to do with this insanity:

Yes, the Cubs won 21-0 yesterday on 23 hits, their biggest shutout in over 120 years:

Nico Hoerner was one of five Cubs to record three or more hits, finishing with three RBIs on a career-high four hits. After a three-hit performance Friday, it also marked the first back-to-back three-hit games of his career.

Rivas, Seiya Suzuki, Ian Happ and Willson Conteras all had three hits.

The margin of victory surpassed 19-0 shutout wins on June, 7 1906, against the New York Giants and on May 13, 1969, against the San Diego Padres.

The Cubs’ 21 runs were the most since they scored 26 against the Colorado Rockies on August 18, 1995. And the 21-run win margin marked the team’s largest since a 24-2 win at the Boston Braves on July 3, 1945.

The last time the Cubs did something historic, the world changed for the worse a few days later. I'm filling water jugs and taping my windows...

It's a bit windy in Chicago: winds steady at 25 knots peaking at 47 knots at 1pm. WGN says:

The National Weather Service has issued a High Wind Warning through 7 p.m. Thursday.

Gusts are to build to greater than 60 mph at times–and there are indications a few of the strongest gusts could reach speeds of 70 to 80 mph.

Whitecaps were spotted in Lake Michigan and the gusts have the potential to send waves greater than 10 feet on the shoreline.

It’s a good idea to move objects indoors and out of the wind.

Great, thanks! That last bit helps. Even Cassie got tired of pushing against it.

Bonus graphic: can you spot when the cold front came through yesterday?

Canada has put the Prairie Provinces on a winter storm warning as "the worst blizzard in decades" descends upon Saskatchewan and Manitoba:

A winter storm watch is in effect for southern Manitoba and southeastern Saskatchewan, with snowfall accumulations of 30 to 50 centimetres expected mid-week, along with northerly wind gusts of up to 90 kilometres per hour, said Environment Canada on Monday.

“Do not plan to travel — this storm has the potential to be the worst blizzard in decades,” the agency warns.

The storm is expected to start Tuesday night, as a Colorado low pressure system moving toward Minnesota will bring a “heavy swath of snow” from southeastern Saskatchewan through most of southern Manitoba.

Snow will start to fall early in the evening near the U.S. border and move north overnight. Blowing snow and high winds will cause zero visibility and whiteout conditions, making driving treacherous.

Meanwhile, elsewhere:

• Via Schneier, Andy Greenberg explains how not only can authorities penetrate Bitcoin's supposed anonymity, but the nature of blockchains means that they can discover illicit transactions years after the fact.
• Josh Marshall calls the $2 bn Saudi sovereign wealth fund investment in Jared Kushner's new hedge fund "the largest and most brazen instance of public corruption I’ve seen in twenty five years covering American politics as a journalist."
• French president Emmanuel Macron will face right-wing loony Marine Le Pen in the April 24th runoff election.
• Businessman Willie Wilson has officially entered the race for Chicago Mayor, making me hope that someone else enters the race soon. Anyone else.

And finally, prosecutors in Texas have declined to pursue charges against a 26-year-old woman arrested last week for infanticide after self-inducing an abortion. Welcome to the new 19th Century, at least in the religious South.

Thursday evening, at the Harris Theater for Music and Dance:

That's Bill Kurtis, Peter Sagal, Karen Chee, Alonzo Bodden, and Helen Hong at this week's "Wait Wait" taping. The "Not My Job" guest was actor Matt Walsh:

Then yesterday, Cassie and I trundled up to Spiteful Brewing in the sun:

Not a bad few days, in all.

When I launched the final weather archive import on Tuesday, I predicted it would finish around 1pm today. See my accuracy for yourself:

2022-04-08 12:54:05.0975|INFO|Moved 118,773,651 weather archives from v3 to v5
2022-04-08 12:54:05.0975|INFO|Finished importing; duration 3.03:41:19.2445019
2022-04-08 12:54:05.0975|INFO|Import finished

Not a bad prediction.

So Weather Now 5 now has about 260 million historical records going back to 2006, including Chicago's weather from 15 years ago this hour. And where the weather station reported climate records, we've got those too.

Microsoft Azure recalculates storage use daily around 11 am Central time, so I don't have the complete picture yet, but it looks like I transferred about 245 GB of data. I'll find out for sure tomorrow, and in 3-4 days I'll get an accurate view of the storage cost.

Whew. I'm glad that's over.

Now that I've got a few weeks without travel, performances*, or work conferences, I can go back to not having enough time to read all the news that interests me. Like these stories:

• The Economist examines how Putin might be punished for war crimes in Ukraine.
• Max Boot wonders why Tucker Carlson still loves his old Uncle Vlad.
• The IPCC says we have eight years to cut greenhouse emissions by 50% or the planet will pass the 1.5°C warming threshold no matter what else we do. Welp.
• Via Bruce Schneier, criminals have started phishing data providers for sensitive information by pretending to be law enforcement.
• Michelle Goldberg wonders why Republican politicians are suddenly afraid of...furries?
• Tom Scott explains how Britain knows what time it is, and a British comedy show takes Denmark to task for not pinning their clocks to UTC.
• As part of his promotional tour for his new novel Kaiju Preservation Society, John Scalzi has given us the short story "Grizzly Bear Conflict Manager."

Finally, Michelin has handed out its 2022 stars for Chicago. Nothing surprising on the list, but I now have four more restaurants to try.

* Except that I volunteered to help a church choir do five Messiah choruses on Easter Sunday, so I've got two extra rehearsals and a service in the next 12 days.

Bonus update: the fog this morning made St Boniface Cemetery especially spooky-looking when Cassie and I went out for her morning walk:

On Friday, I used Arithmetic™ to predict that the 162-million-row weather data transfer from Weather Now v3 to v5 would end around 7pm last night. Let's check the logs:

2022-04-04 18:48:30.7196|INFO|Clearing v3 archival records for ZYTX
2022-04-04 18:49:27.7471|INFO|Moved 157,408,921 weather archives from v3 to v5
2022-04-04 18:49:27.7471|INFO|Finished importing; duration 4.04:14:55.0952715 

Nice prediction. (It logged 157 million rows because I made a performance tweak and re-started the app after 5 million.)

As I've mentioned, those 162 million rows only go back to September 2009. But v3 launched in January 2007. And it turns out I have a second archive, also containing about 25 GB of data, going back to August 2006. I had to think back to decisions I never documented to piece together why.

In August 2006, I had a single big machine that served as my domain controller, Web server, and Exchange endpoint, and a second big database server. In this photo from 31 July 2006, the Exchange/Web/DC server is the white one on the right ("DOPPELKUH") and the SQL server ("BULLE") is the big black one on the left:

Now, BULLE was a huge machine for the time, with about 200 GB of disk space and (I think) 16 GB of memory. That 200 GB expanse tempted me to turn off a data-purge feature from more parsimonious days, and apparently I deployed that change around 9am on 11 August 2006. (Sadly, the purge feature worked as designed, and I have no archival data before then.)

In October 2006, I finally bought a server rack and moved the database to an even bigger set of disks:

Everything ticked along until around the time I deployed the Weather Now v3.5 refresh and discovered that the un-purged data file had grown to 25 GB. So on 3 September 2009, I simply created a new database and changed the data connection strings to point to it. That new database kept growing until I switched the archival data store to the Cloud in 2013.

And now, I get to take advantage of the triviality of that change by making an equally trivial change to the import controller's data connection string. The 2006 data file has 118,774,028 rows covering 3,988 stations from 11 August 2006 to 3 September 2009. At 435 rows per second, the final archival import should finish around...let's see...1 pm on Friday. At that point, every single byte of data Weather Now has collected in the past 15 years will be available through the App for you to see.

More from the archives:

• The server rack in its final form.
• A note about decommissioning the server rack in March 2013, when I moved Weather Now v4 to the Cloud.

The Apollo Chorus performed last night at the Big Foot Arts Festival in Walworth, Wis., so I haven't done a lot of useful things today. I did take a peek at the other weather archive I have lying around, and discovered (a) it has the same schema as the one I'm currently importing into Weather Now 5, and (b) it only goes back to August 2006.

Somewhere I have older archives that I need to find... But if not, NOAA might have some.

As of 17:16 CDT, the massive Weather Now v3 to v5 import had 115,441,906 records left to transfer. At 14:28 CDT yesterday, it was at 157,409,431, giving us a rate of ( 41,967,525 / 96,480 seconds = ) 435 records per second. A little more math gives us another 265,392 seconds to go, or 3 days, 1 hour, 43 minutes left.

So, OK then, what's the over-under on this thing finishing before 7pm Monday?

It's just finished station KCKV (Outlaw Field, Clarksville, Tenn.), with another 2,770 stations left to go. Because it's going in alphabetical order, this means it's finished all of the Pacific Islands (A stations), Northern Europe (B and E), Canada (C), Africa (D, F, G, H). There are no I or J stations (at least not on Earth). K is by far the largest swath as it encompasses all of the continental US, which has more airports than any other land mass.

Once it finishes the continental US, it'll have only 38 million left to do! Whee!