4 ms·
Very cool idea! One question, how much is this costing you out of pocket to host this? The OpenAI GPT4 part must be not nothing.
by thefourthchime 3y ago
Very cool idea! One question, how much is this costing you out of pocket to host this? The OpenAI GPT4 part must be not nothing.
- liorgrossman 3y agoThank you! Currently it's about: * Rendering the screenshot (urlbox): $0.02 * GPT-4V 1K input tokens = $0.01 * GPT-4V 1K output tokens = $0.03 * GPT-4V Vision pricing (per image size): $0.008 Total: 6.8 cents per a single audit May not seem like much, but I see a lot of traffic coming from HN, so say 10K people use it, it'll cost $680...
- liorgrossman 3y agoEventually, Hacker News ended up bringing 20,000+ visitors. Had to upgrade our urlbox screenshot API account twice in 1 hour just to keep up with the demand. This Hacker News post could have cost $1,000+ if the API rate limit hadn't kicked in. Oh well, silver linings... Since almost no one could use the app (too many people, and not enough quota from OpenAI), I added a $1.99 one-time payment per audit. This would probably decrease the number of users and also help cover the insanely high costs.
- thefourthchime 3y agoThanks for following up, I've had ideas for something in the same light, but need to be careful not going bankrupt!