4 ms·
> this future has AI like a commodity Thats why I like the idea of openrouter so much. Next token prediction is a perfect place to run a marketplace and compet
by hansonkd 2y ago
> this future has AI like a commodity
Thats why I like the idea of openrouter so much. Next token prediction is a perfect place to run a marketplace and compete on price / speed.
It's hard for me to see a future where the long term winners aren't just the chipmakers and energy companies.
With the o3 benchmarks its becoming apparent the primary thing from keeping current generation of models from getting smarter is more processing power. If somehow chips got 10x faster tomorrow, it still wouldn't be fast enough. Even at 1000x faster than current performance, those $3k o3 queries now cost $3 which are still too much.
If you invest in a data center, any amount of billions you put in will not future proof it because faster chips are always around the corner and you will be at the mercy of suppliers.
If you invest in a model, even if you invested billions in 1-10 years people will be able to run equivalently powerful models on consumer hardware.
I'm loving the competitive system LLMs created by having a unified API interface allowing you to swap out models and providers with single lines of code.