3 ms·
o1 sort of techniques (tree search, test-time training type things) have not hit any recognizable plateau. There's still low hanging fruits all around.
by FeepingCreature 2y ago
o1 sort of techniques (tree search, test-time training type things) have not hit any recognizable plateau. There's still low hanging fruits all around.
- blharr 2y agoThis discussion includes o1. It's marginal improvement compared to, say, GPT-3 to GPT-4.