8 ms·
I usually follow DevOps Borat's definition [1]: "Big Data is any thing which is crash Excel." Many a true word spoken in jest. [1] https://twitter.com/DEVOPS
by twic 13y ago
I usually follow DevOps Borat's definition [1]:
"Big Data is any thing which is crash Excel."
Many a true word spoken in jest.
[1] https://twitter.com/DEVOPS_BORAT/status/288698056470315008 https://twitter.com/DEVOPS_BORAT/status/288698056470315008
- oinksoft 13y ago"Small Data is when is fit in RAM. Big Data is when is crash because is not fit in RAM." https://twitter.com/DEVOPS_BORAT/status/299176203691098112 https://twitter.com/DEVOPS_BORAT/status/299176203691098112
- xroche 13y agoThis is very inaccurate/misleading IMHO. Big Data is something which does not fit in a regular machine for a given operation. You can sort billions of records on an iPhone, for example. You can grep a string within a terabyte-file data on a single personal computer, and I am not convinced you'd go faster with a distributed system (reading the file on cold storage will be the limiting factor). People claiming to do "big data" in these situations do not generally understand the underlying concepts.
- dannypgh 13y agoWith a distributed storage system you should be able to read said terabyte file using far more disk heads. It would also be easier to engineer it so the terabyte file was entirely in RAM by distributing it across multiple machines (although single machines with TB ram capacity are no doubt continuing to become more common) Sure, store it on a single tape or disk and distributing the computation won't help. You need distributed storage to properly leverage distributed computation for otherwise I/O bound processes.
- com2kid 13y agoYou underestimate Excel! You can point Excel to a DB table and use pivot tables on top. I know it can at least get up to several million, didn't have a chance to test it beyond that! :)
- sam_sach 13y agoHaha, perfect.