3 ms·
From the Alpaca report (https://crfm.stanford.edu/2023/03/13/alpaca.html https://crfm.stanford.edu/2023/03/13/alpaca.html): > we watermark all the model output
by 7373737373 4y ago
From the Alpaca report (https://crfm.stanford.edu/2023/03/13/alpaca.html https://crfm.stanford.edu/2023/03/13/alpaca.html):
> we watermark all the model outputs using the method described in Kirchenbauer et al. 2023, so that others can detect (with some probability) whether an output comes from Alpaca 7B
https://arxiv.org/abs/2301.10226 https://arxiv.org/abs/2301.10226
> We propose a watermarking framework for proprietary language models. The watermark can be embedded with negligible impact on text quality, and can be detected using an efficient open-source algorithm without access to the language model API or parameters. The watermark works by selecting a randomized set of "green" tokens before a word is generated, and then softly promoting use of green tokens during sampling. We propose a statistical test for detecting the watermark with interpretable p-values
- thisiswater 4y agoThere is no reason this couldn't be watermarked with the individual user, though the if it detects them probabilisticly then it could be difficult to make the case to take action on inferences made.