3 ms·
It's interesting for sure. There's also the fact that he didn't use the sota (GPT-4). I'm not saying that would be perfect. But i would be surprised if it wasn'
by famouswaffles 4y ago
It's interesting for sure. There's also the fact that he didn't use the sota (GPT-4). I'm not saying that would be perfect. But i would be surprised if it wasn't big leap over 3.
- weaksauce 4y agoit wasn't mentioned anywhere in there which version of the model he was using... how are you so sure?
- famouswaffles 4y agohe references 3 when he talks about passing the exam. and i guess i doubt he'd evaluate 4 and not say anything about it.
- weaksauce 4y agothey didn't specifically mention 3 in the linked article or in the linked linked article and they ran both 3 and 4 against those exams so I'm not sure either way. probably was 3 but I can't be certain.