2 ms·
Quick question out of curiosity: how do you handle the token limit of ChatGPT?
by juujian 3y ago
Quick question out of curiosity: how do you handle the token limit of ChatGPT?
- Dennizz 3y agoRight now it's pretty simple: First I drop the table/column information if the token limit gets exceeded otherwise (this is shown as a warning in the UI). Then if the limit still gets exceeded, the I show an error to the user. I plan to make this process more smart eventually.