The Daily Parker

Politics, Weather, Photography, and the Dog

Almost everywhere in the world

Late Tuesday night, Weather Now finished importing and indexing 15,430,045 places from around the world, ending with Mutirikwi Dam, Masvingo, Zimbabwe at 9:29 pm CST. (I need to re-import about 11,000 records for places that don't belong to any particular country, but that's low-priority.)

When I first built the Weather Now Gazetteer in July 2002, I only imported populated places, because database space was a lot more expensive then. So from 2002 until the v5 upgrade launched 3 years ago, the Gazetteer had about 7.5 million records and lived in a relational SQL database that migrated to the Cloud in 2013.

This time, I imported every scrap of geographic data I could find in the US, which added 8 million more. And starting later this year, I'll automate updates, particularly from sources that change frequently like the National Geospatial-Intelligence Agency and the Federal Aviation Administration. I may import other databases later on, but for now, I think we're good.

Pricing for Cosmos DB works differently than it used to for SQL Server. Weather Now v4 (2013-2022) used an Azure SQL DB size that cost $10 per month. That gave me up to 10 GB of relational storage for everything, which is why all the weather data moved to really inexpensive flat storage (Azure Tables) that cost about 4.5c per GB per month. When Weather Now lived on-premises through 2013, the Gazetteer and weather data took up about 50 GB (25 GB for the Gazetteer and 25 GB for the first 11 years of weather data), but it cost nothing except electricity—$100 a month of electricity, in fact.

With Cosmos DB, I pay for database transactions, called Request Units, plus a small fee of 25c per GB per month for storage. It gets a little complicated, but basically, the biggest expense for the database is the import, which cost about $75. Going forward, the biggest database expense will be the search service, which costs $2.42 per day. Storing 20 years of weather data costs $1.65 per day. Of course, the application service hosting Weather Now runs $3.60 a day, so it does all add up.

Because the daily cost summary takes a full UTC day to update, I don't have the new run rate for the application yet. When that comes out tonight, I may have to look into ways to defray the cost of the app, whether by voluntary donations or *gulp* advertising.

Incidentally, The Daily Parker costs $4.87 per day ($3.60 for the app service, 79c for storage, and 48c for the database. Now that Weather Now is pretty much where I want it, my next project will be to write a new blog engine and port this app to something that will cost about half that. So be on the lookout for a tip jar on this app as well.

Still chugging along

The Weather Now gazetteer import has gotten to the Ps (Pakistan) with 11,445,567 places imported and 10,890,186 indexed. (The indexer runs every three hours.) I'll have a bunch of statistics about the database when the import finishes, probably later tonight or tomorrow morning at the latest. I'm especially pleased with the import software I wrote, and with Azure Cosmos DB. They're churning through batches of about 30 files at a time and importing places at around 10,000 per minute.

Meanwhile, in the rest of the world:

Finally, in February 1852, a man calling himself David Kennison died in Chicago. He had clamed to be 115 years old, participated in the Boston Tea Party, and hobnobbed with the great and good in the early days of the Republic. And in the proud tradition of people giving undue acclaim to total charlatans, the entire city turned out for his funeral—173 years ago yesterday.

Some good news

First, the temperature at Inner Drive Technology WHQ has gotten up to 10.5°C for the first time since 3:33 pm on Monday December 9th. If it goes up just 0.1°C more, that will make today the warmest day since Monday November 25th. Fingers crossed.

Second, the National Geospatial-Intelligence Agency returned to DNS this morning. Someone at the Department of Defense must have noticed that the government's maps had vanished and was able to get the DNS entries restored. In consequence, I have downloaded everything through Romania, imported everything through Comoros (except China; that's importing right now), and the automatic indexer has captured 274,194 new places for a total gazetteer size of 2,668,565 places. That will rise dramatically later today; there are 2.05 million records for China, of which the import tool has already saved 1 million.

Updates as conditions warrant.

Update: As of 2:29 pm the temperature hit 10.6°C for the first time since 1:49 pm on Monday November 25th. Today is officially the warmest day of the 2024-25 winter season!

National Geospatial-Intelligence Agency removed from the Internet

By yesterday evening I managed to import all the National Geospatial-Intelligence Agency country place data through the Bs. This morning, I couldn't get to the NGIA website.

All right, sometimes these things happen. No biggie.

Yet, knowing a little about how the OAFPOTUS and Clown Prince Elon have operated the last 30 days, I did some digging. And I discovered yet another example of how imbecilic these infants are.

Simply: someone has removed the agency from the Internet. All DNS records for the agency are gone. Someone just deleted the entire domain.

NGIA has 14,500 employees, mainly in its Virginia headquarters. Its products include the NGIA name files that cartographers all over the world use to maintain their maps. Google, Microsoft, and Apple, for example, are big NGIA consumers, as you might want to know if you've ever used their maps.

I knew that the OAFPOTUS could seriously degrade Weather Now, but I thought I had a bit more time. I guess not. So if you use Weather Now and want to search for anyplace in a country whose name begins with C to Z (except Canada, Jamaica, Macau, and the UK, for reasons), I guess we'll both be disappointed.

This could just be a temporary error, like how the Clown Prince accidentally shut down vital food services here and abroad, or mistakenly halted cancer research. At least I know the data are still there, even if the computers the data live on are no longer accessible from outside Fort Belvoir. And I expect Google, Microsoft, and Apple might have something to say about this when they notice it's happened.

At least the National Weather Service still has its DNS entries. For now.

Weather Now update

Last night I released Weather Now v5.0.9183, with a few bug fixes including a patch to the Gazetteer that recognizes the UK's four constituent parts (example). I've spent a few evenings the past week and a half fixing everything I could think of in the Gazetteer code, plus integrating with Azure Maps to allow me to correct time zones and parent places.

Then, starting around 5pm yesterday, I re-imported the existing data from fresh sources, including the NCDC update Monday and the FAA update yesterday. And just now I've completed importing all 970,000 USGS names records for the 50 United States plus DC and Puerto Rico. The Gazetteer now has 1.6 million records, and there are still a lot of places to import from the National Geospatial-Intelligence Agency.

If you're curious, you can go to the About the Gazetteer page to see what all I've imported. I plan to start importing the NGIA country files this afternoon, once I've downloaded them.

The Azure Search indexer that populates the full-text search for the application runs every three hours, so most of the USGS records won't show up in the search feature until just after noon US Central time (a bit more than an hour for now).

Also, after lunch, I'll have a Butters update. Spoiler: she sleeps 21 hours a day.

Ribbentrop, meet Rubio

The US meeting with Russia and not Ukraine to discuss the fate of Ukraine seems unmistakably similar to the Molotov-Ribbentrop discussions in August 1939 that divvied up Poland between the Nazis and Stalin's Russia. The meeting in Riyadh between US Secretary of State Marco Rubio and Russian Foreign Minister Sergei Lavrov seems more focused on a colonial-style mineral extraction concession for the US than on Ukrainian sovereignty. This comes just days after Vice President JD Vance channeled UK Prime Minister Neville Chamberlain (a known Nazi sympathizer) in a speech in Munich just before meeting with actual Nazis.

("'I never thought leopards would eat my face,' sobs woman who voted for the Leopards Eating People's Faces Party."—Adrian Bott)

Meanwhile, back home:

  • The State Department has decided to cancel most of its news subscriptions, because why would our diplomats need to know what's going on in the world?
  • Fortunately (for now), the OAFPOTUS violently dismantling the US government's bureaucracy has gotten in the way of him dismantling the regulations that he claims to hate, further showing (a) how fundamentally stupid he is and (b) how it has nothing to do with regulations.
  • Apparently jealous of the OAFPOTUS's successful raiding of public funds for his own benefit, Argentine president Javier Milei and his friends appear to have raked in close to $100 million in what looks like a classic memecoin rug-pull.
  • The Chicago City Council may vote today on a proposal to borrow $830 m in an issue that would not pay back principal until 2045, a structure that (a) would result in a constant cash-flow to the private investors of something like $80 m per year and (b) cost the city $2 bn once we finally pay it all back. It would be the dumbest thing the city's government has done since the parking-meter scam.
  • Researchers have determined that both work-from-home and return-to-office have drawbacks and benefits, and that mandating all of one or the other isn't great for any company. (But we knew that, even if some CEOs didn't.)
  • Beware anyone asking you to send a code that you see on the screen; this is a device-code authentication attack, which is increasing in popularity among your finer criminals.

Finally, one of my least-favorite Brews & Choos stops has threatened planned to open a new brewpub in Irving Park. Crust Brewing in Rosemont wants to bring the same hellish experience to the former Leader Bar at 3000 W Irving Park Rd. Yes, this is a B&C-qualifying location, but no, I won't review it until I run out of other things to review.

Just two more days of the Arctic freeze

The temperature at Inner Drive Technology WHQ has gone up all day, just surpassing yesterday's afternoon high of -11.3°C:

Of course, yesterday's actual high was -10.3°C, at midnight, and we won't hit that again until tomorrow. But by Friday we'll be able to walk outside without losing extremities, and by Sunday it'll even be above freezing. And then, in 10 days: spring!

There is one advantage to Arctic air over Chicago, though: the air is really clear.

Punzun Ltd: 25 years (this iteration)

Punzun Ltd. (an Illinois corporation doing business as Inner Drive Technology) turns 25 today! I set up the corporation before I moved back to Illinois from New York, so that I could take either a contract or full-time job when I got here.

I can scarcely believe I've been back nearly 25 years.

And 25 years ago—this was months before Bush v Gore, remember—I would not have believed that these would be the news stories I'd care about in 2025:

Finally, on this Presidents Day, let's return to Washington's farewell address for just a moment:

All obstructions to the execution of the Laws, all combinations and associations, under whatever plausible character, with the real design to direct, control, counteract, or awe the regular deliberation and action of the constituted authorities, are destructive of this fundamental principle, and of fatal tendency. They serve to organize faction, to give it an artificial and extraordinary force; to put, in the place of the delegated will of the nation, the will of a party, often a small but artful and enterprising minority of the community; and, according to the alternate triumphs of different parties, to make the public administration the mirror of the ill-concerted and incongruous projects of faction, rather than the organ of consistent and wholesome plans digested by common counsels, and modified by mutual interests.

However combinations or associations of the above description may now and then answer popular ends, they are likely, in the course of time and things, to become potent engines, by which cunning, ambitious, and unprincipled men will be enabled to subvert the power of the people, and to usurp for themselves the reins of government; destroying afterwards the very engines, which have lifted them to unjust dominion.

Towards the preservation of your government, and the permanency of your present happy state, it is requisite, not only that you steadily discountenance irregular oppositions to its acknowledged authority, but also that you resist with care the spirit of innovation upon its principles, however specious the pretexts.

Can't say what made me go back to that source today...

New Weather Now release

I've added a couple of new features to Weather Now, including a view of the best weather in the world. More usefully, I've added a release notes page.

This weekend, I plan to to rebuild the Gazetteer, and import all of the USGS records—about 900,000 places. This will also mean rebuilding the search index in the Basic tier. The Free tier is great for testing, but it only lets me index 10,000 items at a time. Even if the Free tier could support 900,000 records, I don't want to hit "Rebuild" 90 times.

I'll also be setting up a Donate button, for obvious reasons.

Enjoy.

A cyber attack in plain sight

Security expert Bruce Schneier can't believe the damage that Elon Musk's team have already done to US national security, and worries it will get much, much worse:

In the span of just weeks, the US government has experienced what may be the most consequential security breach in its history—not through a sophisticated cyberattack or an act of foreign espionage, but through official orders by a billionaire with a poorly defined government role. And the implications for national security are profound.

What makes this situation unprecedented isn’t just the scope, but also the method of attack. Foreign adversaries typically spend years attempting to penetrate government systems such as these, using stealth to avoid being seen and carefully hiding any tells or tracks. The Chinese government’s 2015 breach of OPM was a significant US security failure, and it illustrated how personnel data could be used to identify intelligence officers and compromise national security.

The Treasury’s computer systems have such an impact on national security that they were designed with the same principle that guides nuclear launch protocols: No single person should have unlimited power. Just as launching a nuclear missile requires two separate officers turning their keys simultaneously, making changes to critical financial systems traditionally requires multiple authorized personnel working in concert.

This approach, known as “separation of duties,” isn’t just bureaucratic red tape; it’s a fundamental security principle as old as banking itself. When your local bank processes a large transfer, it requires two different employees to verify the transaction. When a company issues a major financial report, separate teams must review and approve it. These aren’t just formalities—they’re essential safeguards against corruption and error. These measures have been bypassed or ignored. It’s as if someone found a way to rob Fort Knox by simply declaring that the new official policy is to fire all the guards and allow unescorted visits to the vault.

The implications for national security are staggering.

The OAFPOTUS and his enablers have already crippled the United States internationally. How do Republicans in Congress not see this? Does Musk have to personally give Vladimir Putin a thumb drive with our nuclear codes before someone in the cult wakes up?