2 ms·
GPT-4o mini is 33x cheaper than GPT-4o, or 66x cheaper in batch mode. But the article says: > I also tried GPT-4o mini but yielded significantly worse results
by simonw 2y ago
GPT-4o mini is 33x cheaper than GPT-4o, or 66x cheaper in batch mode. But the article says:
> I also tried GPT-4o mini but yielded significantly worse results so I just continued my experiments with GPT-4o.
Would be interesting to compare with the other inexpensive top tier models, Claude 3 Haiku and Gemini 1.5 Flash.
- edublancas 2y agoauthor here: I'm working on a follow-up post where I benchmark pre-processing techniques (to reduce the token count). Turns out, removing all HTML works well (much cheaper and doesn't impact accuracy). So far, I've only tried gpt-4o and the mini version, but trying other models would be interesting!