3 ms·
They recently added logit biases, so that's a start.
by potatoman22 3y ago
They recently added logit biases, so that's a start.
- remilouf 3y agoIt's limited to 300 logit biases at a time. Knowing GPT4's vocabulary is ~100k tokens it's not nearly enough to get reliable guided generation. Although it could work in some cases, and another advantage of this work is that we can determine that before generating.