35 ms·
The watermarking is independent of the model. The model itself has the probability weights to determine the next token. The watermark is similar to things like
by rhdunn 2mo ago
The watermarking is independent of the model. The model itself has the probability weights to determine the next token. The watermark is similar to things like temperature and top_p/top_k in that the watermark adjusts the probabilities in a deterministic way that changes over time to hide tells from word choices.