3 ms·
> but you have to be ready for many days of computation... I was thinking since we have API prices in tokens and now it looks like self hosted inference on hig
by alchemist1e9 4y ago
> but you have to be ready for many days of computation...
I was thinking since we have API prices in tokens and now it looks like self hosted inference on high end GPUs for similar models. Then based on electricity prices there will be a self-hosted prices in tokens. Then how close are these already? What is the markup today from roughly the raw electricity cost that OpenAI has.