4 ms·
i got shivers thinking about a future ai dynamic pricing and automatic gateway choosing the cheapest provider available
by 6thbit 6mo ago
i got shivers thinking about a future ai dynamic pricing and automatic gateway choosing the cheapest provider available
- nhecker 6mo agoOpenrouter already does this, unless I've misunderstood the premise.
- 6thbit 6mo agoThey can route between models but you pay the standard rate for whichever model is selected (plus 5% fee). Afaik all current model providers have fixed prices per tokens which don't vary depending on, say, demand or hardware availability.
- nubg 6mo agoshivers? as in it frightens you? i believe there is no way around tokens being prices like gasoline at the gas station - it changes every hour. Any other system means you are either over- or underspending.