3 ms·
It's output is non-deterministic because the next word is sampled from the topN highest scored continuations. The algorithm itself is deterministic.
by hackinthebochs 3y ago
It's output is non-deterministic because the next word is sampled from the topN highest scored continuations. The algorithm itself is deterministic.