3 ms·
You are right assuming that model capabilities are determined only by model size. But consider that OpenAI is saying they have a way of scaling intelligence wit
by modeless 2y ago
You are right assuming that model capabilities are determined only by model size. But consider that OpenAI is saying they have a way of scaling intelligence with inference time compute, not just model size. If that proves out, reducing latency per output token potentially becomes as valuable as or even possibly more valuable than scaling model size. Speed becomes intelligence. And Cerebras has 1/10 the latency per token of anything else.