2 ms·
> Except of course it repeating or regurgitating your content, which is a valid concern. That is exactly it. LLMs are nothing more than engines that predict t
by Sohcahtoa82 3y ago
> Except of course it repeating or regurgitating your content, which is a valid concern.
That is exactly it.
LLMs are nothing more than engines that predict the next token based on a mind-boggling large set of statistics of what tokens follow what. They're essentially Markov Chains on a massive dose of steroids.
If the training data includes one document that includes password rules like "The password shall be at least 12 characters long. The password shall include [...]", and then you have another document that includes a line of "The password is fdFjkkl1@!#", then if you ask the LLM to generate a document that includes password rules, there's a chance it may output "The password is fdFjkkl1@!#" in that document, because it knows that "is fdFjkkl1@!#" sometimes comes after "The password".