3 ms·
You're just using wishful assumptions and circular reasoning to promote a silly investment ("Let's assume our investment pays off, that alone makes it worthwhil
by dns_snek 3y ago
You're just using wishful assumptions and circular reasoning to promote a silly investment ("Let's assume our investment pays off, that alone makes it worthwhile to invest in.").
You could just as easily spend trillions and end up with less than 20% improvement over GPT-4. Future gains are not guaranteed.
- atleastoptimal 3y ago> Future gains are not guaranteed. That's why OpenAI and others have put a lot of research into predictive scaling laws, different architectures, etc. Their confidence is bolstered by an understanding of the limits of what scaling alone can do, but it's clear there are avenues that haven't been explored yet, given that every largest chat model is the best chat model by a predictable margin.