4 ms·
This is the same technology that is used by the webgrepper tool [http://blekko.com/webgrep http://blekko.com/webgrep] (a grep for the web pages' sources). Disc
by krishna2 14y ago
This is the same technology that is used by the webgrepper tool [http://blekko.com/webgrep http://blekko.com/webgrep] (a grep for the web pages' sources).
Disclaimer: I work at blekko and I developed the webgrepper.
As a side note, we have used this for various other purposes - some fun ones being, store a big music collection (to extract meta data via mapjob), citizenship test q&a (to pick random questions), the 'joke of the day' (of course, this is our "hello world" example internally to new employees) ..etc.
- DennisP 14y agoIt looks like it'd be useful for a lot of stuff besides search engines. Is there any place to get more details?
- jsrfded 14y agoGreg has planned a whole series about the combinator architecture behind blekko's datastore. Greg and I have both presented aspects of the system at various conferences, but we're happy to chat about it with you directly too. I think this might be the first time it's been published on the web though.
- simonw 14y agoThere's a video of one of Greg's talks (from Surge 2011) here: http://lanyrd.com/2011/surge/shzth/ http://lanyrd.com/2011/surge/shzth/
- avstraliitski 14y agoJust a heads up - you are banned in China.