The math seems about right to me. Using a chatbot for an hour might only use a minute or two of computer time, I would be genuinely surprised if a human could h

The math seems about right to me. Using a chatbot for an hour might only use a minute or two of computer time, I would be genuinely surprised if a human could hit ten minutes of compute time/hour of interaction. Most responses in my technical chats are under 5 seconds, so using a full hour of GPU time is going to take A LOT of questions. I heavily use ChatGPT via a desktop client and my own key, and I am at $3.90 for the month after making a mistake where I accidentally was sending a 30k token prompt repeatedly, that cost me about $2. Using an optimized approach, it is VERY hard to incur a $4/month bill. I imagine that Khan academy has a much better bulk-pricing agreement with openAI, and that they can probably have a caching layer that can look for previously asked questions.