This article gives a wonderful overview of the challenges: "Why Writing Your Own Search Engine Is Hard" http://queue.acm.org/detail.cfm?id=988407 http://queue.

This article gives a wonderful overview of the challenges: "Why Writing Your Own Search Engine Is Hard" http://queue.acm.org/detail.cfm?id=988407 http://queue.acm.org/detail.cfm?id=988407 (site is down currently.) google cache: http://74.125.95.132/search?q=cache:13tlOSQwtjAJ:queue.acm.org/detail.cfm%3Fid%3D988407+writing+a+search+engine+is+hard&cd=1&hl=en&ct=clnk&client=safari http://74.125.95.132/search?q=cache:13tlOSQwtjAJ:queue.acm.o...