?

Log in

No account? Create an account
So, finally Wikia Search is released, and frankly it is not very… - Artur Bergman [entries|archive|friends|userinfo]
Artur Bergman

[ website | O'Reilly Radar ]
[ userinfo | livejournal userinfo ]
[ archive | journal archive ]

[Jan. 7th, 2008|11:07 am]
Artur Bergman
So, finally Wikia Search is released, and frankly it is not very good at ranking. (Though the whitelist and small index are way better). David wrote a post about it at http://daveman692.livejournal.com/322860.html , and thank you David.

What I think is cool is that we are treating the service as an open source project, with release early, release often. The important bit here is that the code is open (or will be, since I cannot find it right now), the index will be open and the algorithms will be open. It will take time to mature, but I have great hopes it will. (And I hope others will start using the resource too.)

One of the cool things we do is the use of a CDN. Each query has an unique URI and that URI is cached from your closest POP.

From my London colo the effect is dramatic.

crucially% curl -I --tcp-nodelay --write-out '\ntime %{time_total}\n' "http://re.search.wikia.com/search#arsdsdsdsdsdsdsdsdsd"
HTTP/1.1 200 OK
Date: Mon, 07 Jan 2008 09:44:46 GMT
Server: PWS/1.1.34
Connection: keep-alive
ETag: "10f1-1c3b-ca79cac0"
X-Px: ms m:lhr-tel-n3.panthercdn lhr-tel-n21
Content-Length: 7227
Content-Type: text/html
Last-Modified: Mon, 07 Jan 2008 06:15:47 GMT
Cache-Control: max-age=593357
Expires: Mon, 14 Jan 2008 06:34:03 GMT
--- Time 0.497

And when I run it again
crucially% curl -I --tcp-nodelay --write-out '\ntime %{time_total}\n' "http://re.search.wikia.com/search#arsdsdsdsdsdsdsdsdsd"
HTTP/1.1 200 OK
Date: Mon, 07 Jan 2008 09:44:49 GMT
Server: PWS/1.1.34
Connection: keep-alive
ETag: "10f1-1c3b-ca79cac0"
X-Px: ht lhr-tel-n21
Content-Length: 7227
Content-Type: text/html
Last-Modified: Mon, 07 Jan 2008 06:15:47 GMT
Cache-Control: max-age=593354
Expires: Mon, 14 Jan 2008 06:34:03 GMT
--- Time 0.011

It also significantly reduces the load on our servers.
LinkReply