4 ms·
Actually it turned out to be the opposite, vanilla data scraped from the internet is feeding these models
by greatpostman 4y ago
Actually it turned out to be the opposite, vanilla data scraped from the internet is feeding these models
- spiderice 4y agoHow is that the opposite? Big tech companies have all the vanilla data scraped from the internet, plus WAY more. Obviously both together will be more valuable than just the former.
- greatpostman 4y agoA team of 10 talented engineers can scrape and store that data. It won’t be perfect, but it’s nowhere near the barrier that people assumed.
- lostmsu 4y ago1 engineer can handle that alone. The Pile is under 1TB. The tech is there to do it from a phone in under a month.
- dragonwriter 4y ago> A team of 10 talented engineers can scrape and store that data. How do you scrape and store the nonpublic data held by any major corp?