2 ms·
I'd love to hear the story behind getting the data to the Internet Archive, from Cuil. 310TB is a massive amount of data, and was even more massive in 2007. The
by bluedino 14y ago
I'd love to hear the story behind getting the data to the Internet Archive, from Cuil. 310TB is a massive amount of data, and was even more massive in 2007. The biggest hard drive you could buy were only 500-750GB. If they were SAS drives they were probably only 300GB at the biggest. Did they just throw 6-8 racks worth of a SAN onto a truck and ship it over? What did they (Archive.org) do with it once they got it?
- adventured 14y agoHere are some photos of their hardware (business insider claimed their local setup held 7 petabytes in the article circa Nov 2009). http://static.businessinsider.com/image/4af8564f0000000000e660d4-590/their-local-data-center-holds-7-petabytes-of-data-heating-is-a-big-issue.jpg http://static.businessinsider.com/image/4af8564f0000000000e6... http://static.businessinsider.com/image/4af84e320000000000b72feb-590/server-cabinets-that-have-been-built-but-not-yet-deployed.jpg http://static.businessinsider.com/image/4af84e320000000000b7... http://static4.businessinsider.com/image/4af880fe00000000009cd72c-590/cuil-gets-about-five-complaints-a-day-from-webmasters-worldwide.jpg http://static4.businessinsider.com/image/4af880fe00000000009... http://www.businessinsider.com/cuil-office-tour-2009-11#cuil-is-currently-headquartered-in-menlo-park-in-an-building-once-occupied-by-tshirt-company-zazzle-1 http://www.businessinsider.com/cuil-office-tour-2009-11#cuil...