4 ms·

What exactly is the authors point? Is he just upset about the terminology usage? Is he implying that he has "big-data" like it is some kind of pissing contest?

What exactly is the authors point? Is he just upset about the terminology usage? Is he implying that he has "big-data" like it is some kind of pissing contest? He never even explains what kind of scale he considers to be "big-data". He just says everything is lots of data and nothing is big data at all. Also his usage of childish memes makes me unable to take it seriously.

exelius 13y ago
It's from a mongodb shop, so big data means web scale!
- rogerbinns 13y ago
  Also mongodb likes to use a lot of storage space to actually store data - we see using at twice the number of bytes as the same data in JSON. The solutions are obvious - store it compressed https://jira.mongodb.org/browse/SERVER-164 https://jira.mongodb.org/browse/SERVER-164 - and tokenize repeated values like field names https://jira.mongodb.org/browse/SERVER-863 https://jira.mongodb.org/browse/SERVER-863 - note how many years those have been open without progress! Not that it really matters - mongodb's single per database lock means you'll have trouble inserting, updating or deleting data quickly enough for web scale!
YZF 13y ago
I think the point is that people often use the wrong tools thinking they have "big data" and therefore they must use the same techniques someone like Google uses. The difference is most likely Google has many orders of magnitude more data and does many more orders of magnitude processing on it. I think it is useful to have some rules of thumb as to when you need to apply more exotic techniques and tools vs. something where simple stuff works. So in that sense asking do you have "big data" or not can be useful...
- im3w1l 13y ago
  So let's skip the discussion about how much data is a lot. Around which dataset sizes are which methods appropriate?
Houshalter 13y ago
There was one meme, and it was just a picture of a dog.

exelius 13y ago

It's from a mongodb shop, so big data means web scale!

rogerbinns 13y ago
Also mongodb likes to use a lot of storage space to actually store data - we see using at twice the number of bytes as the same data in JSON. The solutions are obvious - store it compressed https://jira.mongodb.org/browse/SERVER-164 https://jira.mongodb.org/browse/SERVER-164 - and tokenize repeated values like field names https://jira.mongodb.org/browse/SERVER-863 https://jira.mongodb.org/browse/SERVER-863 - note how many years those have been open without progress! Not that it really matters - mongodb's single per database lock means you'll have trouble inserting, updating or deleting data quickly enough for web scale!

YZF 13y ago

I think the point is that people often use the wrong tools thinking they have "big data" and therefore they must use the same techniques someone like Google uses. The difference is most likely Google has many orders of magnitude more data and does many more orders of magnitude processing on it. I think it is useful to have some rules of thumb as to when you need to apply more exotic techniques and tools vs. something where simple stuff works. So in that sense asking do you have "big data" or not can be useful...

im3w1l 13y ago
So let's skip the discussion about how much data is a lot. Around which dataset sizes are which methods appropriate?

Houshalter 13y ago

There was one meme, and it was just a picture of a dog.