8 ms·
Yeah if you're doing a big coding session up near the limits of context even with prompt caching each reply can be ~80¢ or something, so you can definitely blow
by joshjob42 2y ago
Yeah if you're doing a big coding session up near the limits of context even with prompt caching each reply can be ~80¢ or something, so you can definitely blow through $200 on the API if you are using it heavily.