3 ms·
> This is why it's foolish to go up against an ML product from Google, Facebook, or (maybe) Microsoft. I was sure someone will say this. I think it only appli
by visarga 8y ago
> This is why it's foolish to go up against an ML product from Google, Facebook, or (maybe) Microsoft.
I was sure someone will say this. I think it only applies for advertising, commerce and insurance. When it comes to learning ML models on images, text and games, big corporations don't have a unique trove of data. They only have the data advantage when it comes to personal data.
The more important advantage big corporations have is hiring the best and hiring more ML scientists and engineers. The job demand far outstrips the offer.
- bobthepanda 8y agoEh, the big companies have more resources to classify larger training data sets: e.g. Google reCAPTCHA
- throwawaymath 8y agoLarge tech firms absolutely have access to unqiue image, text and game(play) data. I'm surprised you think they don't. How many tech startups do you suppose have access to every single multiplayer game of Destiny (Microsoft), every user's profile photo and interest metadata (Facebook), or every user's search history and email (Google)? But wait, there's more! How many startups have ready access to usage statistics for every mobile app (Google, Apple)? How many startups have virtually the entire corpus of available ebooks on hand for mining (Google, Amazon)? What about traffic patterns (Google), or virtual reality game(play) data (Facebook)? Telemetry data from the most widely used operating systems and web browsers (Google, Apple, Microsoft)? Video content with official subtitles (Netflix, Amazon, Google, Apple, ...). And don't forget login and activity data through social login (Facebook, Google) and image training via reCAPTCHA (Google). I can go on and on here. You should reconsider how large the set of training material is that be acquired by mining massive amounts of "personal" data. Of course, this is completely orthogonal to the other major advantage large companies have; namely, they have vast sums of money to throw at compute and storage resources.
- nostrademons 8y agoImageNet has 14 million images. How many images does Google have available to them? They've got about 1000+ of my personal photos backed up on Google Photos, so if each of their 200M monthly active users is like me, that's 200 billion images from Google Photos alone. Then add every image crawled from the WWW for image search (that was several tens of billion when I was there, each tagged with text & structured data from its page of origin), every Street View photo (that was thousands of hard drives worth, measuring in the petabytes total), and high-res satellite images of the entire earth through their SkyBox/TerraBella acquisition. The Big Tech companies like to understate the size of their data advantage because it tempts competitors into doing stupid things that won't work in the market. Don't be fooled though - the majority of useful data is locked up inside proprietary silos.
- visarga 8y agoYou can have access to larger open datasets of images if you want, but it's expensive to train on such a large dataset. So the real advantage is having money for training models.
- laichzeit0 8y agoSure they have those images, but so what, it’s all unlabeled data. I think the labeled datasets we create for them with e.g. reCAPTCHA is infinitely more useful for training.
- shostack 8y agoAre they unlabeled though? If location sharing metadata exists, that's a decent chunk of location-tagged photos of places to have.
- TrackerFF 8y agoLot's of companies have _vast_ amounts of unique data, often reaching back many, many decades. For example, one company I worked with manufactured, installed, and did maintenance certain electrical / power and machine/mechanical products. They had archives full, dating back many decades, of error reports and such. Luckily for them, the equipment problems 50 years ago were no different from problems today, so the data was still highly relevant. The company went on to digitize all this data, structure it in a usable way, and then build (i.e hire in ML consultants) models on that data - which they used for predictive work - in this case, anomaly detection, early warning systems, etc. The net results were happier customers, less faults, less warranty expenses, etc. which in turn made them more competitive. This is just one example, but there are many others. Lots of data that the big tech giants do not have access to, but which is (or can be) of great value.