3 ms·
LLMs are deterministic if you want them to be. If you eagerly argmax the output you will get the same sequence for the same prompt every time
by ein0p 2y ago
LLMs are deterministic if you want them to be. If you eagerly argmax the output you will get the same sequence for the same prompt every time