3 ms·
It’s not an exact figure, but plenty of employees claimed that after we train a model with 2-3 orders of magnitude of compute over GPT-4 we’d reach AGI, which p
by skepticATX 2y ago
It’s not an exact figure, but plenty of employees claimed that after we train a model with 2-3 orders of magnitude of compute over GPT-4 we’d reach AGI, which puts us at $10-$100 billion.
See Situational Awareness for one example of this.
- BoiledCabbage 2y agoTwo years ago Altman made clear that progress needs more than model scale / parameter count to scale. https://www.reddit.com/r/mlscaling/comments/12mktym/sam_altman_size_of_llms_wont_matter_as_much/ https://www.reddit.com/r/mlscaling/comments/12mktym/sam_altm... This summer he made a comment saying "we can make GPTs 5,6,7 more powerful" and someone editorialized it as being "via parameter count/scale" which he didn't say.