2 ms·
> We haven't hit the wall yet. The models are iterative improvements, but I haven't seen night and day differences since GPT3 and 3.5
by OsrsNeedsf2P 2y ago
> We haven't hit the wall yet.
The models are iterative improvements, but I haven't seen night and day differences since GPT3 and 3.5
- anon373839 2y agoYeah. Scaling up pretraining and huge models appears to be done. But I think we're still advancing the frontier in the other direction -- i.e., how much capability and knowledge can we cram into smaller and smaller models?
- Davidzheng 2y agoTbh such a big jump from current capability would be ASI already
- YetAnotherNick 2y agoBecause 3.5 has a new capability which is following instructions. Right now we are in 3.5 range in conversation AI and native image generation, both of which feels magical.