3 ms·
is there a website where i can compare openai, anthropic and gemini models on cost/token ?
by misiti3780 10mo ago
is there a website where i can compare openai, anthropic and gemini models on cost/token ?
- jsnell 10mo agoThere are plenty. But it's not the comparison you want to be making. There is too much variability between the number of tokens used for a single response, especially once reasoning models became a thing. And it gets even worse when you put the models into a variable length output loop. You really need to look at the cost per task. artificialanalysis.ai has a good composite score, measures the cost of running all the benchmarks, and has 2d a intelligence vs. cost graph.
- misiti3780 10mo agothanks
- deaux 10mo agoFor reference the above completely depends on what you're using them for. For many tasks, the number of tokens used is consistent within 10~20%.
- int_19h 10mo agohttps://openrouter.ai/models https://openrouter.ai/models
- rrhartjr 10mo agohttps://www.llm-prices.com/ https://www.llm-prices.com/
- deaux 10mo agohttps://www.helicone.ai/llm-cost https://www.helicone.ai/llm-cost Tried a lot of them and settled on this one, they update instantly on model release and having all models on one page is the best UX.