3 ms·
You could have the models output a confidence alongside next-token then weight the penalty by the confidence.
by aeternum 11mo ago
You could have the models output a confidence alongside next-token then weight the penalty by the confidence.
loading thread…