4 ms·
I get about 35-40tok/sec on a 3090. It's actually about the same speed when accounting for how much more responsive my system is to Anthropic's saas infrastruc
by CoolGuySteve 6mo ago
I get about 35-40tok/sec on a 3090.
It's actually about the same speed when accounting for how much more responsive my system is to Anthropic's saas infrastructure
- tills13 6mo agoI keep forgetting have a 3080 laying around... Gotta figure that out.