3 ms·
Since LLMs are loosely based on NM models, it seems research on newer sampling methods like Mirostat might help here.
by astrange 3y ago
Since LLMs are loosely based on NM models, it seems research on newer sampling methods like Mirostat might help here.