2 ms·
I don't remember them saying "$100 billion models are all you need for AGI." Don't suppose you have a link?
by tim333 2y ago
I don't remember them saying "$100 billion models are all you need for AGI." Don't suppose you have a link?
- skepticATX 2y agoIt’s not an exact figure, but plenty of employees claimed that after we train a model with 2-3 orders of magnitude of compute over GPT-4 we’d reach AGI, which puts us at $10-$100 billion. See Situational Awareness for one example of this.
- BoiledCabbage 2y agoTwo years ago Altman made clear that progress needs more than model scale / parameter count to scale. https://www.reddit.com/r/mlscaling/comments/12mktym/sam_altman_size_of_llms_wont_matter_as_much/ https://www.reddit.com/r/mlscaling/comments/12mktym/sam_altm... This summer he made a comment saying "we can make GPTs 5,6,7 more powerful" and someone editorialized it as being "via parameter count/scale" which he didn't say.