> I'd bet that what he, and the competition, is realizing is that the bigger models are too expensive to run. I think it's likely that they're out of training

> I'd bet that what he, and the competition, is realizing is that the bigger models are too expensive to run. I think it's likely that they're out of training data to collect. So adding more parameters is no longer effective. > most people don't need a brilliantly intelligent assistant, they just need a not-dumb assistant. I tend to agree, and I think their pathway toward this will all come from continuing advances in fine tuning. Instruction tuning, RLHF, etc seem to be paying off much more than scaling. I bet that's where their investment is going to be turning.