44 ms·
The new Claude Sonnet 3.5 does something like that in my experience.
by nopinsight 2y ago
The new Claude Sonnet 3.5 does something like that in my experience.
- trq_ 2y agoYeah wouldn't be surprised if the big labs are doing more than just arg max in the sampling.