4 ms·
I guess I don't understand, if someone provides me with a storage cluster of the_whole_internet for free, won't my proprietary_search_algorithm significantly de
by trotsky 15y ago
I guess I don't understand, if someone provides me with a storage cluster of the_whole_internet for free, won't my proprietary_search_algorithm significantly degrade the IOPS and network bandwidth of the storage? Where would it all be? In some google data center that now anyone can demand colocation in? What happens when I accidentally or maliciously slow down Bing's updates and degrade their quality? And, as others mentioned, what happens when people push data into the index that doesn't represent what they're hosting?
It seems like this would be quite a complex project with a for the public good approach. Maybe it could work as an AWS project to sell amazon compute cycles.
- jerf 15y agoI suspect the only way to make this work would be for the "index" to actually be some sort of stream. It wouldn't be a "file" or "database". It would require probably on the order of hundreds of thousands of dollars worth of hardware just to receive the stream and run a hello-world map-reduce(-esque calculation) on it would be my guess. It's your job to turn that stream into a queryable database. As for your last two questions, there's nothing new whatsoever about them. Search engine pollution is ancient news.