3 ms·
4.2x doesn't mean anything if you don't tell me what "accuracy" Sonnet 3.5 had.
by Imnimo 2y ago
4.2x doesn't mean anything if you don't tell me what "accuracy" Sonnet 3.5 had.
- samatdav 2y agoI agree. Our local early results were promising were a higher percentage of code change requests produced a functionally correct output. We will post more metrics and data in the future.