Politics, Weather, Photography, and the Dog
Thursday 14 August 2014

I mentioned over a month ago that, given some free time, I would fix the search feature on Weather Now. Well, I just deployed the fix, and it's kind of cool.

I used Lucene.NET as the search engine, incorporating it into the Inner Drive Gazetteer that underlies the geographic information for Weather Now. I won't go into too many details about it right now, except that I was surprised at how much the index writer was able to crunch and store (in Azure blobs). The entire index takes up 815 MB of blob space. That's so small a fraction of a cent per month I can't even calculate it right now.

The indexing process took about 6 minutes per 500,000 rows. (The entire database has 7.25 million rows.) It helped that I ran the indexing process on an Azure virtual machine, because at one point during index optimization I clocked the data throughput at 200 Mbps. Yes, two hundred megabits per second. The entire index ran in a little less than two hours on a VM while I was doing other things. And once the index initializes in the Weather Now app, searches only take a second or so.

Go ahead. Try a search. Put in your ZIP code or the name of a prominent building near you.

I still have a lot I want to do with the application, including updating it to a responsive theme and MVC, but this is a pretty big leap.

Thursday 14 August 2014 16:23:11 EDT (UTC-04:00)  |  | Cloud | Cool links | Weather | Windows Azure#
Search
On this page....
Weather Now gazetteer now really, really fast
Countdowns
The Daily Parker +3450d 07h 32m
Italy 33d 14h 26m
IDTWHQ move 50d 14h 41m
Parker's 9th birthday 51d 05h 41m
My next birthday 132d 09h 46m
Categories
Aviation (362) Baseball (110) Best Bars (10) Biking (46) Chicago (979) Cubs (199) Duke (134) Geography (360) Higher Ground (5) Jokes (284) Kitchen Sink (697) London (66) Parker (201) Daily (204) Photography (150) Politics (306) US (1135) World (277) Raleigh (21) Readings (8) Religion (68) San Francisco (94) Software (217) Blogs (83) Business (248) Cloud (90) Cool links (150) Security (105) Travel (255) Weather (747) Astronomy (93) Windows Azure (63) Work (100) Writing (15)
Links
Archive
<April 2015>
SunMonTueWedThuFriSat
2930311234
567891011
12131415161718
19202122232425
262728293012
3456789
Full archive
Blogroll
About
David Braverman and Parker
David Braverman is the Chief Technology Officer of Holden International in Chicago, and the creator of Weather Now. Parker is the most adorable dog on the planet, 80% of the time.
Legal
All content Copyright ©2015 David Braverman.
Creative Commons License
The Daily Parker by David Braverman is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 3.0 United States License, excluding photographs, which may not be republished unless otherwise noted.
Admin Login
Sign In
Blog Stats
Total Posts: 4769
This Year: 155
This Month: 31
This Week: 9
Comments: 0