Two years ago Altman made clear that progress needs more than model scale / parameter count to scale. https://www.reddit.com/r/mlscaling/comments/12mktym/sam_a

Two years ago Altman made clear that progress needs more than model scale / parameter count to scale. https://www.reddit.com/r/mlscaling/comments/12mktym/sam_altman_size_of_llms_wont_matter_as_much/ https://www.reddit.com/r/mlscaling/comments/12mktym/sam_altm... This summer he made a comment saying "we can make GPTs 5,6,7 more powerful" and someone editorialized it as being "via parameter count/scale" which he didn't say.