3 ms·
> It's twice as fast and half the cost. is a great trick with language. Because if you just pay for computing time, half the time equals half the cost. But whe
by kappuchino 2y ago
> It's twice as fast and half the cost.
is a great trick with language. Because if you just pay for computing time, half the time equals half the cost. But when you phrase it that way, it sounds for some people like 4 times. So ...
- sebzim4500 2y agoFor a lot of things you need to pay more for more speed, so that's why I specified both. Otherwise they could probably make it way faster but also much more expensive by doing less batching, speculative decoding, etc.