4 ms·
The arguable caveat is Sonnet may run faster (although this isn't known for sure, due to more tokens being used for the same task), so you can potentially get m
by energy123 4mo ago
The arguable caveat is Sonnet may run faster (although this isn't known for sure, due to more tokens being used for the same task), so you can potentially get more done in a synchronous iterative workflow
I don't really believe this however, because so much time is spent fixing up after models, that a slower but more intelligent model is a net time saver in my experience.
- kolinko 4mo agoFrom my benchmarks, sadly, it doesn't seem to be the case much. Surprisingly. I found Sonnet comparable in speed to Opus (sic), but perhaps I was testing it wrong?
- riverbirch 4mo agoI can confirm this, I too I'm not seeing much of a difference in practice
- usef- 4mo agoGiven the chip shortage, I wonder if they push Sonnet to the older chips. It presumably requires less memory.