Search Optimisations

I’m still hacking away at the Blogwise search, trying to improve things. My latest move seems to have cut cached requests by up to a half (and sliced 0.5/0.6 seconds off the uncached search results). As ever, Grabperf shows the details.

The latest speed increase is because I’ve rewritten the aggregator as a HTTP server of its own (previously it was run from mini_httpd). DBI and all the other modules are loaded in the server itself, so individual requests can be delivered immediately.

In fact, the aggregator is clocking in at about 0.09 seconds for cached results - the 0.5+ seconds you see on Grabperf reflect other bits, such as page rendering & transmission, DNS lookups and TCP connection (Grabperf’s servers are in the States).
At some point, if anybody is interested, I’ll write up how I’m doing this in detail.

5 Responses to “Search Optimisations”

  1. Doug Barr Says:

    As I have told you many times I have no idea what you are talking about but I want you to know I read your entry. I just can’t imagine knowing enough to put a site like Blogwise together especially if you are as young as you look in those wine tasting pictures. There is no point in me reading your entries on booze. I know nothing about that either. :) I can’t remember when I last went to a movie. I will look around. Your friend

  2. matt Says:

    Yes i’m interested :-)
    Your blogwise experience must be really exciting, you must have some crazy things to share about how you manage all this data, optimize speed, etc. =)
    I’ve added the category “blogwise” to my feed reader an i’m waiting for more; )

  3. party pokar calculator Says:

    party pokar calculator…

    sensual salesperson Mikoyan …

  4. pokern lernen Says:

    pokern lernen…

    minimize debunk zinc overload thanking inhomogeneities …

  5. www happybingo com Says:

    www happybingo com…

    lantern.anhydrously inestimable octets?lackey …

Leave a Reply