3 ms·
The problem with it is that it uses a 30k~ token system prompt (albeit "cached"), and very quickly the usage goes up to a few million. I can easily spend over $
by koakuma-chan 1y ago
The problem with it is that it uses a 30k~ token system prompt (albeit "cached"), and very quickly the usage goes up to a few million. I can easily spend over $10 a day.