4 ms·
Given its 4$ per month[1] and they are a non-profit with just 55M$ revenue. How is GPU cost and hence their with OpenAI for this going to work if it becomes rea
by itissid 2y ago
Given its 4$ per month[1] and they are a non-profit with just 55M$ revenue. How is GPU cost and hence their with OpenAI for this going to work if it becomes really-good and 100's of millions of kids start using it?
Renting a 24GB VRAM Runpod is ~0.5$ per hour. How can the math work out unless you have to have a non-profit energy company and a server farm attached?
[1] https://osboncapital.com/khanmigo-ai-public-vs-private/ https://osboncapital.com/khanmigo-ai-public-vs-private/
[2] https://www.runpod.io/gpu-instance/pricing https://www.runpod.io/gpu-instance/pricing
- Tomte 2y agoBill Gates is a fan, as are many other rich people. I‘d assume that Khan doesn‘t strictly need to be breaking even (although it would be great).
- dghlsakjg 2y agoThe math seems about right to me. Using a chatbot for an hour might only use a minute or two of computer time, I would be genuinely surprised if a human could hit ten minutes of compute time/hour of interaction. Most responses in my technical chats are under 5 seconds, so using a full hour of GPU time is going to take A LOT of questions. I heavily use ChatGPT via a desktop client and my own key, and I am at $3.90 for the month after making a mistake where I accidentally was sending a 30k token prompt repeatedly, that cost me about $2. Using an optimized approach, it is VERY hard to incur a $4/month bill. I imagine that Khan academy has a much better bulk-pricing agreement with openAI, and that they can probably have a caching layer that can look for previously asked questions.
- glial 2y ago> if it becomes really-good and 100's of millions of kids start using it If it actually works, this is the ideal outcome.