3 ms·
> The more important takeaway: dozens of technologists at IBM spent more than three years and untold millions of dollars building the program specifically train
by hakuseki 6y ago
> The more important takeaway: dozens of technologists at IBM spent more than three years and untold millions of dollars building the program specifically trained for Jeopardy! prowess. Less than 10 years later, a general-purpose open-sourced technology without the massive mainframe or cooling fans can compete on the same level.
This statement from the article confused me. GPT-3 is general-purpose, but not open source, nor does it run without massive hardware, nor was it developed without spending millions of dollars.
- atleta 6y agoYep, it's not only open sourced, it's not even open access. (I get the reason, but somehow, maybe due to the fact that it's from an organization called OpenAI, a lot of people seem to think that everyone could use it if they wanted to.)
- gwern 6y agoYou could compare it to T5 instead. T5 does awesome at trivia, both the code and trained models are available, and it'll run on ordinary hardware. (Not sure if one could argue 'the millions of dollars' part, but that GB R&D wasn't spent for the purpose of trivia playing like the Watson Jeopardy system was aimed at doing, so seems reasonably fair to me - the trivia playing is merely the byproduct of the target capabilities of translation, knowledge graph construction etc).