3 ms·
How do this kind of models know when to stop? Does anyone has an idea.
by MichaelRazum 3y ago
How do this kind of models know when to stop? Does anyone has an idea.
- kevincox 3y agoIIRC as well as characters they can output a "stop token" which tells the generation loop to exit.