4 ms·
Data, data, data, data. 1990s don't have wikipedia, Youtube, megapixel cameras every which where, every single adult human hooked up to a sensor package 24 hour
by MilStdJunkie 3y ago
Data, data, data, data. 1990s don't have wikipedia, Youtube, megapixel cameras every which where, every single adult human hooked up to a sensor package 24 hours a day, and who knows what else. I know as a 1990s guy I would never have imagined the amount of data we would eventually all throw up into the ether even ten years later, to say nothing of today. Without that corpus . .
- reverius42 3y agoAnd none of those examples except Wikipedia were used to train the various LLMs. I wonder how much better multi-modal models are going to get if they start incorporating the 24/7 sensor data from billions of people.
- ldjkfkdsjnv 3y agoI cant wait for the time when someone trains a multimodal LLM on all of youtube
- rvba 3y ago"Don't forget to like and subscribe" On a side note, long time ago I saw someone who make a bot trained on a selected sample of chats between people on the internet - and the tool swore a lot.
- moomoo11 3y agoencyclopedia Britannia existed. I came to USA in late 90s and my school had the CD set.
- CorrectHorseBat 3y agoWikipedia is ~100 bigger than the Encyclopædia Britannica https://en.m.wikipedia.org/wiki/Wikipedia:Size_of_Wikipedia https://en.m.wikipedia.org/wiki/Wikipedia:Size_of_Wikipedia
- hn_thrwn 3y agoThat's honestly much smaller than I expected.
- throwaway2037 3y agoNice link! I never saw that page before. This quote surprised me: it should be noted that the amount of text added to Wikipedia articles every year has been constant since 2006, at roughly 1 gigabyte of (compressed) text added per year.
- tyre 3y agoYes, Wikipedia is surprisingly small. You can fit the whole thing on an iPad and access all of it without internet. Plenty of rabbit holes to fill even the longest airplane flight.
- signa11 3y agogpus don't forget the gpus ! compute was too slow for the task at hand.