4 ms·
* ChatGPT 3.5. But it's also within spitting distance of GPT4, which is very exciting.
by generalizations 3y ago
* ChatGPT 3.5. But it's also within spitting distance of GPT4, which is very exciting.
- make3 3y agoperformance is logarithmic as a function of money invested in compute, so maybe it's close but it's also far away
- valine 3y agoGPT4 is more difficult to measure I think. The value I get from GPT4 is in the details it gets right on very obscure, complex questions. I'm not sure benchmarks are capturing how far GPT4 is ahead of other models. For simple stuff it's not that much better than 3.5.