3 ms·
This looks really useful. Any thoughts on managing costs? I've been developing against gpt-4, and it runs up charges quickly. I've been thinking I will need to
by anotherpaulg 3y ago
This looks really useful.
Any thoughts on managing costs? I've been developing against gpt-4, and it runs up charges quickly. I've been thinking I will need to be careful about adding live api calls in any sort of testing situations.
Wondering if your tool has any features to help avoid/minimize wasted api usage?
- typpo 3y agoThe tool maintains an LRU cache on disk by default - which means repeat identical requests will be fetched from cache instead of the live API.