3 ms·
You also need some kind of beam search or rejection sampling since JSON tokens to not exactly correspond to logits. edit: They describe this more carefully in
by bmc7505 3y ago
You also need some kind of beam search or rejection sampling since JSON tokens to not exactly correspond to logits.
edit: They describe this more carefully in the paper.