3 ms·
There are some libraries that can extract keywords that don't require a call to GPT. I wonder if those would be cheaper and work?
by sharemywin 4y ago
There are some libraries that can extract keywords that don't require a call to GPT. I wonder if those would be cheaper and work?
- tudorg 4y agoThanks for the idea, the cost wouldn't be a lot smaller because the question summary doesn't consume so many tokens compared to the context, however the latency would be improved significantly if we avoid one round-trip.