I had to pause the really tricky refactoring I worked on yesterday because we discovered a new performance issue that obscured an old throttling issue. It took me most of the morning to find the performance bottleneck, but after removing it a process went from 270 seconds to 80. Then I started looking into getting the 80 down to, say, 0.8, and discovered that because we're using an API limit with a request limit (180 requests in 15 minutes), I put in a 5-second delay between requests.
So now I've got all this to read...someday:
Finally, the economics of workers vs employers has taken an odd turn as job applicants have started simply ghosting interviewers. But, as Slate says, "employers have been doing this to workers for years, and their hand-wringing didn’t start until the tables were turned."
Quick hit list of stuff I didn't find time to read:
Finally, Alexandra Petri guesses about the books that Republican candidate for Virginia Governor Glenn Youngkin might put on your kid's AP curriculum.
On this day in 1767, Charles Mason and Jeremiah Dixon completed their survey of the disputed Maryland-Pennsylvania border, which became even more contentious in 1780 when Pennsylvania aboolished slavery. A group of surveyors started re-surveying the border in 2019; I can't find out whether they finished.
Meanwhile, 255 years later, politics is still mostly local:
Finally, Chicago has perfectly clear skies for only the third time this month after yesterday and the 4th, getting only 39% of possible sunshine for almost the past three weeks.
BGP stands for Border Gateway Protocol. It's a mechanism to exchange routing information between autonomous systems (AS) on the Internet. The big routers that make the Internet work have huge, constantly updated lists of the possible routes that can be used to deliver every network packet to their final destinations. Without BGP, the Internet routers wouldn't know what to do, and the Internet wouldn't work.
The Internet is literally a network of networks, and it’s bound together by BGP. BGP allows one network (say Facebook) to advertise its presence to other networks that form the Internet. As we write Facebook is not advertising its presence, ISPs and other networks can’t find Facebook’s network and so it is unavailable.
The individual networks each have an ASN: an Autonomous System Number. An Autonomous System (AS) is an individual network with a unified internal routing policy. An AS can originate prefixes (say that they control a group of IP addresses), as well as transit prefixes (say they know how to reach specific groups of IP addresses).
At 1658 UTC we noticed that Facebook had stopped announcing the routes to their DNS prefixes.
We keep track of all the BGP updates and announcements we see in our global network. At our scale, the data we collect gives us a view of how the Internet is connected and where the traffic is meant to flow from and to everywhere on the planet.
A BGP UPDATE message informs a router of any changes you’ve made to a prefix advertisement or entirely withdraws the prefix. We can clearly see this in the number of updates we received from Facebook when checking our time-series BGP database. Normally this chart is fairly quiet: Facebook doesn’t make a lot of changes to its network minute to minute.
But at around 15:40 UTC we saw a peak of routing changes from Facebook. That’s when the trouble began.
So, someone at Facebook may have applied a router update incorrectly. And as of now, they've corrected the problem.
The United States Supreme Court began their term earlier today, in person for the first time since March 2020. Justice Brett Kavanagh (R) did not attend owing to his positive Covid-19 test last week.
In other news:
So how did facebook.com disappear from root DNS, the day after 60 Minutes aired a segment on Haugen?
Just a couple today, but they seem interesting:
And wow, did the Chicago Bears have a bad game yesterday.
So these things happened:
And finally, break out the Glühwein: Chicago's Christkindlmarket will return to Daley Plaza and Wrigleyville this winter.
I've just spent the last 45 minutes transferring all my auto-pay accounts to a new credit card after my bank notified me that someone in Berlin tried to use my old card to buy something on a French website. Since this happened just a couple of days after T-Mobile once again lost control of millions of customer records, I assume that's how my card number wound up with a European criminal.
Or maybe it came from one of the companies whose accounts I just had to update? According to C-Net, "T-Mobile says there's no indication any consumer financial data, such as credit card or other payment information, was compromised." Uh huh.
Until companies have to endure real consequences for their own crappy security, this will continue to happen.
I have opened these on my Surface at work, but I'll have to read them at home:
Finally, Empirical Brewery has a new line of beer that supports Tree House Cats at Work. I'll try some and let you know.
Eugene Wesley Roddenberry would have been 100 years old today. Star Trek and NASA have a livestream today to celebrate.
In other news:
Finally, sometime today I hope to finish reading Joe Pinsker's interview with author Oliver Burkeman about how not to get sucked into things that waste your time, like the Internet.