Politics, Weather, Photography, and the Dog
Thursday 14 August 2014

I mentioned over a month ago that, given some free time, I would fix the search feature on Weather Now. Well, I just deployed the fix, and it's kind of cool.

I used Lucene.NET as the search engine, incorporating it into the Inner Drive Gazetteer that underlies the geographic information for Weather Now. I won't go into too many details about it right now, except that I was surprised at how much the index writer was able to crunch and store (in Azure blobs). The entire index takes up 815 MB of blob space. That's so small a fraction of a cent per month I can't even calculate it right now.

The indexing process took about 6 minutes per 500,000 rows. (The entire database has 7.25 million rows.) It helped that I ran the indexing process on an Azure virtual machine, because at one point during index optimization I clocked the data throughput at 200 Mbps. Yes, two hundred megabits per second. The entire index ran in a little less than two hours on a VM while I was doing other things. And once the index initializes in the Weather Now app, searches only take a second or so.

Go ahead. Try a search. Put in your ZIP code or the name of a prominent building near you.

I still have a lot I want to do with the application, including updating it to a responsive theme and MVC, but this is a pretty big leap.

Thursday 14 August 2014 16:23:11 EDT (UTC-04:00)  |  | Cloud | Cool links | Weather | Windows Azure#
Search
On this page....
Weather Now gazetteer now really, really fast
Countdowns
The Daily Parker +3364d 20h 40m
Berlin 11d 09h 09m
Parker's 9th birthday 136d 16h 34m
My next birthday 217d 20h 39m
Categories
Aviation (352) Baseball (110) Best Bars (9) Biking (44) Chicago (937) Cubs (197) Duke (133) Geography (341) Higher Ground (5) Jokes (284) Kitchen Sink (672) London (59) Parker (195) Daily (204) Photography (145) Politics (303) US (1110) World (261) Raleigh (21) Readings (8) Religion (66) San Francisco (93) Software (209) Blogs (78) Business (235) Cloud (90) Cool links (138) Security (101) Travel (244) Weather (717) Astronomy (91) Windows Azure (61) Work (92) Writing (10)
Links
Archive
<January 2015>
SunMonTueWedThuFriSat
28293031123
45678910
11121314151617
18192021222324
25262728293031
1234567
Full archive
Blogroll
About
David Braverman and Parker
David Braverman is the Chief Technology Officer of Holden International in Chicago, and the creator of Weather Now. Parker is the most adorable dog on the planet, 80% of the time.
Legal
All content Copyright ©2015 David Braverman.
Creative Commons License
The Daily Parker by David Braverman is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 3.0 United States License, excluding photographs, which may not be republished unless otherwise noted.
Admin Login
Sign In
Blog Stats
Total Posts: 4654
This Year: 40
This Month: 40
This Week: 8
Comments: 0