I think one of the biggest mistakes is that they just mostly put money into compute. They’d be better off investing in high-quality, human-generated data that c

I think one of the biggest mistakes is that they just mostly put money into compute. They’d be better off investing in high-quality, human-generated data that covers every metric they’re interested in. That’s both knowledge and domain-specific application. Id go further for multi-modal to license examples of everything a human sees, hears, and does in their life up to college age. Keep mixing that with new architectures to match human performance. Then, lots of spin-offs of textual and multi-modal models with domain-specific, fine tuning like CompSci people are doing. If they did that, we’d see even larger leaps in their performance. They could also build custom models on this stuff while charging customers for the data mixes they use. Those sales would incentivize more high-quality data to be created.