> What does it mean from cost and benchmark pov to have a 10 Trillion parameter model? To me it means that we've hit the top end of the S-curve with regards to

> What does it mean from cost and benchmark pov to have a 10 Trillion parameter model? To me it means that we've hit the top end of the S-curve with regards to effects of scaling - if the tool isn't remarkably better despite the scale, then we're firmly in diminishing returns territory.