3 ms·
No, that's a rumor lots of people have been taking at face value. If you do the math, inferrence is very lucrative. Here someone deployed a big model, the c
by Kuinox 11mo ago
No, that's a rumor lots of people have been taking at face value.
If you do the math, inferrence is very lucrative.
Here someone deployed a big model, the costs are $0.20/1M token
https://lmsys.org/blog/2025-05-05-large-scale-ep/ https://lmsys.org/blog/2025-05-05-large-scale-ep/