Artur Bergman (crucially) wrote,
Artur Bergman
crucially

So, finally Wikia Search is released, and frankly it is not very good at ranking. (Though the whitelist and small index are way better). David wrote a post about it at http://daveman692.livejournal.com/322860.html , and thank you David.

What I think is cool is that we are treating the service as an open source project, with release early, release often. The important bit here is that the code is open (or will be, since I cannot find it right now), the index will be open and the algorithms will be open. It will take time to mature, but I have great hopes it will. (And I hope others will start using the resource too.)

One of the cool things we do is the use of a CDN. Each query has an unique URI and that URI is cached from your closest POP.

From my London colo the effect is dramatic.

crucially% curl -I --tcp-nodelay --write-out '\ntime %{time_total}\n' "http://re.search.wikia.com/search#arsdsdsdsdsdsdsdsdsd"
HTTP/1.1 200 OK
Date: Mon, 07 Jan 2008 09:44:46 GMT
Server: PWS/1.1.34
Connection: keep-alive
ETag: "10f1-1c3b-ca79cac0"
X-Px: ms m:lhr-tel-n3.panthercdn lhr-tel-n21
Content-Length: 7227
Content-Type: text/html
Last-Modified: Mon, 07 Jan 2008 06:15:47 GMT
Cache-Control: max-age=593357
Expires: Mon, 14 Jan 2008 06:34:03 GMT
--- Time 0.497

And when I run it again
crucially% curl -I --tcp-nodelay --write-out '\ntime %{time_total}\n' "http://re.search.wikia.com/search#arsdsdsdsdsdsdsdsdsd"
HTTP/1.1 200 OK
Date: Mon, 07 Jan 2008 09:44:49 GMT
Server: PWS/1.1.34
Connection: keep-alive
ETag: "10f1-1c3b-ca79cac0"
X-Px: ht lhr-tel-n21
Content-Length: 7227
Content-Type: text/html
Last-Modified: Mon, 07 Jan 2008 06:15:47 GMT
Cache-Control: max-age=593354
Expires: Mon, 14 Jan 2008 06:34:03 GMT
--- Time 0.011

It also significantly reduces the load on our servers.
Subscribe
  • Post a new comment

    Error

    default userpic

    Your reply will be screened

    Your IP address will be recorded 

    When you submit the form an invisible reCAPTCHA check will be performed.
    You must follow the Privacy Policy and Google Terms of use.
  • 0 comments