3 ms·
Per frontier token. You're not calculating the cost of a fixed quality asset here. Old hw running non-frontier models will be very valuable. In fact, we have tw
by chermi 5mo ago
Per frontier token. You're not calculating the cost of a fixed quality asset here. Old hw running non-frontier models will be very valuable. In fact, we have two direct examples: older server gpus actually appreciating and the very obvious fact that not everyone always use MAX FULL EFFORT BEST MODEL no matter what.
- deleted 5mo ago[deleted]
- vb-8448 5mo agoNot consumer hw ... and if we speak about local llm we cannot assume most of us can put a rack in their basement Already today is not possible to run deep seek v4 pro locally, and I cannot imagine that in 2 years we will be.