3 ms·
Maybe because it's easier this way to estimate the data size before you send it to the API.
by abeshkek919 3y ago
Maybe because it's easier this way to estimate the data size before you send it to the API.
- WiSaGaN 3y agoI am not sure about that. You are already using API, should be trivial to use a tokenizer to get the number. Also prompt is just minor part of the cost. You have much less control in the completion part, which is the majority of the cost.