4 ms·
Yeah I work with hundreds of GBs of data every day. I have worked on a dataset with 40 million images in the past. I am also aware of OpenAI, Google AI, etc. tr
by rg111 4y ago
Yeah I work with hundreds of GBs of data every day. I have worked on a dataset with 40 million images in the past. I am also aware of OpenAI, Google AI, etc. train on billions of images. Internally, I am aware of Amazon, Google, META handling really large datasets.
But that is now.
If you are old enough you must remember the early years of big data hype. It was not far from millions or tens of millions of rows.
Re: sensors on fitbits, I thought everyone would read between the lines, and consider hundreds of thousands of these devices sold every year (every month?) will definitely amount to "big data".
Either these companies are plainly hoarding all of it and running some kind of analysis, or they maybe are doing federated learning. From the cos' standpoint, yes, it is big data.
- bakuninsbart 4y agoFor a blow of the past for younger people I can really recommend Tanenbaum's Computer Architecture. Great book for understanding how a computer works, and the practical example he gives really illuminate well how far we've come!