3 ms·
I don’t understand how the watermarking is supposed to affect the LLMs being trained. Isn’t the watermarking some hidden data in the PDF file itself and the tex
by echoangle 2y ago
I don’t understand how the watermarking is supposed to affect the LLMs being trained. Isn’t the watermarking some hidden data in the PDF file itself and the text contained in the PDF is the same for everyone? And aren’t the LLMs trained with the extracted plain text, not the PDF itself? How would the LLM training be different if there’s a watermark?
- sshine 2y agoThe watermarks are both PDF metadata and slight variation in wording. The metaphor of a watermark indeed falls short, and it should perhaps be called fingerprinting.
- echoangle 2y agoYou’re saying publishers of scientific papers slightly adjust the wording and this is used to detect who „leaked“ the version of the paper? If I and someone else download the same paper, the wording would change? How would that work if I want to quote them?