3 ms·
The temperature setting controls randomness output of the LLM. We paraphrase all the time to avoid plagiarism and that's just somewhat randomized retelling of
by pmarreck 3y ago
The temperature setting controls randomness output of the LLM.
We paraphrase all the time to avoid plagiarism and that's just somewhat randomized retelling of the same idea.
If you set the temperature to 0 in an LLM it's basically in "decompress/rote mode". I don't think this is qualitatively the same as "copying", possibly more akin to "memorization". I haven't seen very many demonstrations of verbatim-copy output that wasn't done with a temperature of or near 0.
- eviks 3y agoHow is the fact that there is a flag to disable plagiarism relevant for the issue that there is plagiarism?
- pmarreck 3y agoBecause enabling "plagiarism mode" is a conscious action that a human takes, it does not default to "plagiarize" no more than a machine that has simply stored the verbatim copy of an article, when asked to print it out, is "plagiarizing". Plus, citations are showing up in LLM's now.
- eviks 3y agoAlso, you can't avoid plagiarism by paraphrasing because paraphrasing is a form of plagiarism. The key here is whether you cite the source, which the model doesn't https://www.scribbr.com/frequently-asked-questions/is-paraphrasing-considered-plagiarism/ https://www.scribbr.com/frequently-asked-questions/is-paraph...
- pmarreck 3y agothat's coming. some LLM's are already starting to do that