4 ms·
A innovative case of using the LLMs. > The total cost to my OpenAI account was $22. Of that amount, about $8 was testing the prompts and running on the (cheape
by ankitg12 3y ago
A innovative case of using the LLMs.
> The total cost to my OpenAI account was $22. Of that amount, about $8 was testing the prompts and running on the (cheaper) Turbo API. The final run on GPT-4 cost $14; if I had completely replicated our work from 2017 on GPT-4 it would have cost $140.
Seems like coming up with good prompt itself is quite costly at around 1/3rd of the total cost. I wonder if there are any ways to iterate on the prompts cheaply?
- underwater 3y ago$8 is cheap. The relatively high cost is only because the final analysis wasn't run on more passages.
- renonce 3y agoI would call $8 cheap even if it means 1/3rd of the total cost.