The Daily Parker

I meant to add this earlier today, but I had to do some work for my real job.

Uploading 15.4 million place records into Weather Now revealed some unexpected statistics. As you might expect from a military website, the National Geospatial-Intelligence Agency got a lot of its data from military sources. And the military tends to map things they care about in great detail. So the top 10 countries by place counts turn out to be:

1. China, 2.1 million
2. United States, 1.1 million
3. Russia, 857,000
4. Iran, 686,000
5. Indonesia, 543,000
6. Thailand, 530,000
7. Finland, 495,000
8. Mexico, 490,000
9. Republic of Korea, 346,000
10. Afghanistan, 343,000

The top 5 states by USGS place count might surprise you, too:

1. California, 52,700
2. Texas, 43,300
3. Oregon, 36,800
4. Tennessee, 33,400
5. Arkansas, 29,800

Florida, New York, Pennsylvania, and Illinois, the 3rd through 6th most populous states, come in at 19th, 11th, 8th, and 33rd, respectively. I have no idea why.

And the smallest places? All of these NGIA files had fewer than 8 locations—probably because they contain places that are really part of some other country:

1. Dramana and Shakhatoe, 1
2. Kalapani, 1
3. Minerva Reefs, 1
4. Conejo Island, 2
5. Geyser Reef, 2
6. Hans Island, 2
7. Siachen, 2

I honestly don't know why NGIA puts those places in their own files. I'll correct them eventually.

If you want to have a bit of fun, try searching for places you know and see what weather is closest.

Late Tuesday night, Weather Now finished importing and indexing 15,430,045 places from around the world, ending with Mutirikwi Dam, Masvingo, Zimbabwe at 9:29 pm CST. (I need to re-import about 11,000 records for places that don't belong to any particular country, but that's low-priority.)

When I first built the Weather Now Gazetteer in July 2002, I only imported populated places, because database space was a lot more expensive then. So from 2002 until the v5 upgrade launched 3 years ago, the Gazetteer had about 7.5 million records and lived in a relational SQL database that migrated to the Cloud in 2013.

This time, I imported every scrap of geographic data I could find in the US, which added 8 million more. And starting later this year, I'll automate updates, particularly from sources that change frequently like the National Geospatial-Intelligence Agency and the Federal Aviation Administration. I may import other databases later on, but for now, I think we're good.

Pricing for Cosmos DB works differently than it used to for SQL Server. Weather Now v4 (2013-2022) used an Azure SQL DB size that cost $10 per month. That gave me up to 10 GB of relational storage for everything, which is why all the weather data moved to really inexpensive flat storage (Azure Tables) that cost about 4.5c per GB per month. When Weather Now lived on-premises through 2013, the Gazetteer and weather data took up about 50 GB (25 GB for the Gazetteer and 25 GB for the first 11 years of weather data), but it cost nothing except electricity—$100 a month of electricity, in fact.

With Cosmos DB, I pay for database transactions, called Request Units, plus a small fee of 25c per GB per month for storage. It gets a little complicated, but basically, the biggest expense for the database is the import, which cost about $75. Going forward, the biggest database expense will be the search service, which costs $2.42 per day. Storing 20 years of weather data costs $1.65 per day. Of course, the application service hosting Weather Now runs $3.60 a day, so it does all add up.

Because the daily cost summary takes a full UTC day to update, I don't have the new run rate for the application yet. When that comes out tonight, I may have to look into ways to defray the cost of the app, whether by voluntary donations or *gulp* advertising.

Incidentally, The Daily Parker costs $4.87 per day ($3.60 for the app service, 79c for storage, and 48c for the database. Now that Weather Now is pretty much where I want it, my next project will be to write a new blog engine and port this app to something that will cost about half that. So be on the lookout for a tip jar on this app as well.

The Weather Now gazetteer import has gotten to the Ps (Pakistan) with 11,445,567 places imported and 10,890,186 indexed. (The indexer runs every three hours.) I'll have a bunch of statistics about the database when the import finishes, probably later tonight or tomorrow morning at the latest. I'm especially pleased with the import software I wrote, and with Azure Cosmos DB. They're churning through batches of about 30 files at a time and importing places at around 10,000 per minute.

Meanwhile, in the rest of the world:

• The OAFPOTUS will likely get nowhere with Russian dictator Vladimir Putin for the same reasons no one else has: Putin doesn't negotiate in good faith.
• Former US Ambassador to Hungary David Pressman explains how Hungarian president Viktor Orbán and his allies have enriched themselves at the country's expense, as a warning about what is starting to happen over here.
• French president Emmanuel Macron had to correct the OAFPOTUS more than once in a press conference yesterday that I'm sure one of them remembered and the other did not.
• Clown Prince Elon Musk stepped on a rake over the weekend in part because his prank email to every Federal worker could very likely cause some Justice Department lawyers to face sanctions.
• James Fallows explains how Musk's Maoist vandalism of the US Government will have catastrophic consequences in aviation sooner rather than later.
• Will the known charlatan Dr Mehmet Oz truly divest himself from his financial interests in Medicare- and Medicaid-related companies now that he's been tapped to head the Federal agency that runs both? Ah, ha ha, ha. How droll.
• Chicago Public Media has come out as strongly as they can against Chicago Mayor Brandon Johnson's proposed $830 million bond sale. (I mentioned the bond sale last week.)
• According to Newsweek, a poll found Johnson's approval rating at 6.6%, lower than Rod Blagojevich's approval when the legislature removed him from office in 2009. (A Daily Parker reader joked that Johnson is now less popular than chlamydia.)
• Medium-term inflation expectations in the US have surged to levels we haven't seen this century, prompting Paul Krugman to ask why the markets don't seem to care (hint: Upton Sinclair).
• Craft distilleries in Illinois have their hopes pinned on a bill making its way through the state legislature that would remove restrictions on how they can operate tasting rooms. I'm also hoping the bill passes.

Finally, in February 1852, a man calling himself David Kennison died in Chicago. He had clamed to be 115 years old, participated in the Boston Tea Party, and hobnobbed with the great and good in the early days of the Republic. And in the proud tradition of people giving undue acclaim to total charlatans, the entire city turned out for his funeral—173 years ago yesterday.

First, the temperature at Inner Drive Technology WHQ has gotten up to 10.5°C for the first time since 3:33 pm on Monday December 9th. If it goes up just 0.1°C more, that will make today the warmest day since Monday November 25th. Fingers crossed.

Second, the National Geospatial-Intelligence Agency returned to DNS this morning. Someone at the Department of Defense must have noticed that the government's maps had vanished and was able to get the DNS entries restored. In consequence, I have downloaded everything through Romania, imported everything through Comoros (except China; that's importing right now), and the automatic indexer has captured 274,194 new places for a total gazetteer size of 2,668,565 places. That will rise dramatically later today; there are 2.05 million records for China, of which the import tool has already saved 1 million.

Updates as conditions warrant.

Update: As of 2:29 pm the temperature hit 10.6°C for the first time since 1:49 pm on Monday November 25th. Today is officially the warmest day of the 2024-25 winter season!

By yesterday evening I managed to import all the National Geospatial-Intelligence Agency country place data through the Bs. This morning, I couldn't get to the NGIA website.

All right, sometimes these things happen. No biggie.

Yet, knowing a little about how the OAFPOTUS and Clown Prince Elon have operated the last 30 days, I did some digging. And I discovered yet another example of how imbecilic these infants are.

Simply: someone has removed the agency from the Internet. All DNS records for the agency are gone. Someone just deleted the entire domain.

NGIA has 14,500 employees, mainly in its Virginia headquarters. Its products include the NGIA name files that cartographers all over the world use to maintain their maps. Google, Microsoft, and Apple, for example, are big NGIA consumers, as you might want to know if you've ever used their maps.

I knew that the OAFPOTUS could seriously degrade Weather Now, but I thought I had a bit more time. I guess not. So if you use Weather Now and want to search for anyplace in a country whose name begins with C to Z (except Canada, Jamaica, Macau, and the UK, for reasons), I guess we'll both be disappointed.

This could just be a temporary error, like how the Clown Prince accidentally shut down vital food services here and abroad, or mistakenly halted cancer research. At least I know the data are still there, even if the computers the data live on are no longer accessible from outside Fort Belvoir. And I expect Google, Microsoft, and Apple might have something to say about this when they notice it's happened.

At least the National Weather Service still has its DNS entries. For now.

Last night I released Weather Now v5.0.9183, with a few bug fixes including a patch to the Gazetteer that recognizes the UK's four constituent parts (example). I've spent a few evenings the past week and a half fixing everything I could think of in the Gazetteer code, plus integrating with Azure Maps to allow me to correct time zones and parent places.

Then, starting around 5pm yesterday, I re-imported the existing data from fresh sources, including the NCDC update Monday and the FAA update yesterday. And just now I've completed importing all 970,000 USGS names records for the 50 United States plus DC and Puerto Rico. The Gazetteer now has 1.6 million records, and there are still a lot of places to import from the National Geospatial-Intelligence Agency.

If you're curious, you can go to the About the Gazetteer page to see what all I've imported. I plan to start importing the NGIA country files this afternoon, once I've downloaded them.

The Azure Search indexer that populates the full-text search for the application runs every three hours, so most of the USGS records won't show up in the search feature until just after noon US Central time (a bit more than an hour for now).

Also, after lunch, I'll have a Butters update. Spoiler: she sleeps 21 hours a day.

Time got away from me this afternoon. I might read all this tomorrow morning:

• Nicholas Kristof says the Musk/OAFPOTUS administration prostrating to Russia will make the world more dangerous. So does Alex Shepard.
• Jennifer Rubin says that the Musk/OAFPOTUS administration will break the government, and therefore own it.
• Anne Applebaum decries Vice President JD Vance's speech to the Munich Security Conference.
• Former Senate Majority Leader Mitch McConnell (R-KY) announced his retirement, now that he got everything he wanted.
• The Chicago City Council narrowly voted against lowering the city speed limit to 25 mph (40 km/h), despite evidence that more people will die.
• American Airlines is adding 22% more flights from O'Hare this summer. Yay!
• Hurricane, the most-decorated dog in the United States Secret Service, has died at age 15.

Finally, On Tour Brewing, a Brews & Choos Top 10 brewery, will close this spring. A new brewery and a resurrection of one of my favorite pre-pandemic bars, Links Tavern, will open in its place. Can't wait!

The US meeting with Russia and not Ukraine to discuss the fate of Ukraine seems unmistakably similar to the Molotov-Ribbentrop discussions in August 1939 that divvied up Poland between the Nazis and Stalin's Russia. The meeting in Riyadh between US Secretary of State Marco Rubio and Russian Foreign Minister Sergei Lavrov seems more focused on a colonial-style mineral extraction concession for the US than on Ukrainian sovereignty. This comes just days after Vice President JD Vance channeled UK Prime Minister Neville Chamberlain (a known Nazi sympathizer) in a speech in Munich just before meeting with actual Nazis.

("'I never thought leopards would eat my face,' sobs woman who voted for the Leopards Eating People's Faces Party."—Adrian Bott)

Meanwhile, back home:

• The State Department has decided to cancel most of its news subscriptions, because why would our diplomats need to know what's going on in the world?
• Fortunately (for now), the OAFPOTUS violently dismantling the US government's bureaucracy has gotten in the way of him dismantling the regulations that he claims to hate, further showing (a) how fundamentally stupid he is and (b) how it has nothing to do with regulations.
• Apparently jealous of the OAFPOTUS's successful raiding of public funds for his own benefit, Argentine president Javier Milei and his friends appear to have raked in close to $100 million in what looks like a classic memecoin rug-pull.
• The Chicago City Council may vote today on a proposal to borrow $830 m in an issue that would not pay back principal until 2045, a structure that (a) would result in a constant cash-flow to the private investors of something like $80 m per year and (b) cost the city $2 bn once we finally pay it all back. It would be the dumbest thing the city's government has done since the parking-meter scam.
• Researchers have determined that both work-from-home and return-to-office have drawbacks and benefits, and that mandating all of one or the other isn't great for any company. (But we knew that, even if some CEOs didn't.)
• Beware anyone asking you to send a code that you see on the screen; this is a device-code authentication attack, which is increasing in popularity among your finer criminals.

Finally, one of my least-favorite Brews & Choos stops has threatened planned to open a new brewpub in Irving Park. Crust Brewing in Rosemont wants to bring the same hellish experience to the former Leader Bar at 3000 W Irving Park Rd. Yes, this is a B&C-qualifying location, but no, I won't review it until I run out of other things to review.

It seems like so much of the news I've read today concerns people behaving stupidly, but thinking they're behaving intelligently. Sadly, it's mostly the same group of people:

• James Fallows makes it clear the aviation accidents over the past few weeks are not the Administration's fault—but the ones a year from now will certainly be.
• Jeff Maurer likens Elon Musk's wrecking crew to the drunk and sleep-deprived Assemblée Nationale of 4 August 1789; you know, the one that led directly to the French Revolution.
• Josh Marshall theorizes that Musk has employed a bunch of 25-year-old incels to destroy the Government precisely because the infants have no fear of consequences.
• Paul Krugman thanks the OAFPOTUS for "making microbes great again."
• Economist Claudia Goldin has discovered an inverse relationship between fertility and sharing housework, which columnist Heather Long explains is the reason so many people in rich countries have decided not to have kids.
• Cranky Flier can't countenance Southwest Airlines making its first layoffs in history, and puts the blame squarely on the private equity firm they partnered with.

Finally, people in Bridgeport and other Southwest Side neighborhoods have fallen in love with a rotund beaver who lives with her family on the Chicago River. Some have suggested naming the beaver Lori Heavyfoot or Dam Ryan. I hope she doesn't meet up with one of the city's other charismatic megafauna...

I've added a couple of new features to Weather Now, including a view of the best weather in the world. More usefully, I've added a release notes page.

This weekend, I plan to to rebuild the Gazetteer, and import all of the USGS records—about 900,000 places. This will also mean rebuilding the search index in the Basic tier. The Free tier is great for testing, but it only lets me index 10,000 items at a time. Even if the Free tier could support 900,000 records, I don't want to hit "Rebuild" 90 times.

I'll also be setting up a Donate button, for obvious reasons.

Enjoy.