4 ms·

From the article, and relevant here: I’m worried that when people hear ‘5 OOMs off’, how they register it is, “Oh we have 5x less data than we need - we just n

by nmca 3y ago

From the article, and relevant here: I’m worried that when people hear ‘5 OOMs off’, how they register it is, “Oh we have 5x less data than we need - we just need a couple of 2x improvements in data efficiency, and we’re golden”. After all, what’s a couple OOMs between friends? No, 5 OOMs off means we have 100,000x less data than we need.

YetAnotherNick 3y ago
I meant 100,000x. At least for everyone I know, they have 100,000x data in mail/messaging/docs/notes/meeting etc. than their blog or any public site they own. Hell I would even say that if you just have all the meetings of zoom, it will be few order of magnitude higher than the entire public web.
- saulpw 3y ago
  If I have 1MB on my blog, 100,000x would be 100GB. Just, no. OOMs are not to be trifled with.
  - YetAnotherNick 3y ago
    How many people have blogs? How many people sent any message or created a google docs? The answer could easily be 10,000x times of people having blog. Also I was just counting text content as I mentioned. For reference, there are 175,000 authors in medium compared to billions using whatsapp or gmail or difference of around 50,000.
jodrellblank 3y ago
> "we just need a couple of 2x improvements in data efficiency, and we’re golden”" 100,000x is only seventeen 2x improvements. This[1] says world volume of data doubles every two years, citing a 2016 McKinsey study as the source. That puts it 34 years away. 2056. This[2] says the estimated compound growth rate of data creation is around 61%, that's a doubling time of 1.32 years and puts it 22 years away. 2045. It's not tomorrow, but it may not be all that far away. [1] https://rivery.io/blog/big-data-statistics-how-much-data-is-there-in-the-world/ https://rivery.io/blog/big-data-statistics-how-much-data-is-... [2] https://theconversation.com/the-worlds-data-explained-how-much-were-producing-and-where-its-all-stored-159964 https://theconversation.com/the-worlds-data-explained-how-mu...

by nmca 3y ago

YetAnotherNick 3y ago

I meant 100,000x. At least for everyone I know, they have 100,000x data in mail/messaging/docs/notes/meeting etc. than their blog or any public site they own. Hell I would even say that if you just have all the meetings of zoom, it will be few order of magnitude higher than the entire public web.

saulpw 3y ago
If I have 1MB on my blog, 100,000x would be 100GB. Just, no. OOMs are not to be trifled with.
- YetAnotherNick 3y ago
  How many people have blogs? How many people sent any message or created a google docs? The answer could easily be 10,000x times of people having blog. Also I was just counting text content as I mentioned. For reference, there are 175,000 authors in medium compared to billions using whatsapp or gmail or difference of around 50,000.

jodrellblank 3y ago

> "we just need a couple of 2x improvements in data efficiency, and we’re golden”" 100,000x is only seventeen 2x improvements. This[1] says world volume of data doubles every two years, citing a 2016 McKinsey study as the source. That puts it 34 years away. 2056. This[2] says the estimated compound growth rate of data creation is around 61%, that's a doubling time of 1.32 years and puts it 22 years away. 2045. It's not tomorrow, but it may not be all that far away. [1] https://rivery.io/blog/big-data-statistics-how-much-data-is-there-in-the-world/ https://rivery.io/blog/big-data-statistics-how-much-data-is-... [2] https://theconversation.com/the-worlds-data-explained-how-much-were-producing-and-where-its-all-stored-159964 https://theconversation.com/the-worlds-data-explained-how-mu...