4 ms·
LLM inference already isn't deterministic, the watermarking technique only limits the space of possible random seeds. There is no reason to believe that this su
by PufPufPuf 1mo ago
LLM inference already isn't deterministic, the watermarking technique only limits the space of possible random seeds. There is no reason to believe that this subset of seeds somehow produces lower quality output.