3 ms·
10M items @ 10 tokens each ("20 bottles of ferric chloride" etc) plus 10M tokens out (category) is 100M tokens in 10M tokens out. Claude Haiku is $0.25 per 1M
by HarHarVeryFunny 2y ago
10M items @ 10 tokens each ("20 bottles of ferric chloride" etc) plus 10M tokens out (category) is 100M tokens in 10M tokens out.
Claude Haiku is $0.25 per 1M tokens in, $1.05 per 1M out, so cost would be ~$35.
GPT-4o mini is even cheaper at $0.15 per 1M in.
Of course if your volume justifies the hardware cost you could always run Llama locally, for the cost of the electricity used.