3 ms·
The entire watermarking scheme is based on replacing a random number generator with a seeded random number generator. This cannot change the "voice" of the LLM
by mrguyorama 2mo ago
The entire watermarking scheme is based on replacing a random number generator with a seeded random number generator.
This cannot change the "voice" of the LLM. It was already letting a random number generator choose which adjectives to use. Now that random number generator encodes a tiny signal.
But fundamentally the way it writes has not changed.
It's not making it choose different words. It's a minor change to how it chooses between multiple nearly identical words, where in the current case it literally flips a coin.