Google has a TWENTY year head-start of building server farms all over the world and hiring PhDs to develop the complex algorithms and software to do the indexin

Google has a TWENTY year head-start of building server farms all over the world and hiring PhDs to develop the complex algorithms and software to do the indexing. Can't just buy time on someone else's cloud network and hire a couple of coders to compete with that. You could throw a lot of money at it but not compete on years of investment. My brain is swiss-cheese these days, I wish I could remember the name of that one-man startup a decade ago that actually had a lightweight high-speed crawler and was making a serious attempt at competition. Was covered around here several times. But obviously they didn't succeed if I can't remember the name.