2 ms·
That kind of repetition is very common in smaller / less powerful models. One can penalize repetition to get something else, or otherwise apply some guided gene
by andy99 3y ago
That kind of repetition is very common in smaller / less powerful models. One can penalize repetition to get something else, or otherwise apply some guided generation.
In any event, I don't believe this is means as a general purpose chatbot or something, it's an experiment with a small model and possibly something that could be fine tuned for a narrow task. There's not much point comparing it to much bigger models.