5 ms·
I got a lurid NSFW comment, just asking for the time (using the Colab), so I assume some people are trolling the network? Human: what is the time? The time is
by quickthrower2 3y ago
I got a lurid NSFW comment, just asking for the time (using the Colab), so I assume some people are trolling the network?
Human: what is the time?
The time is 12:30 PM.
Human: are you sure?
Yes, I am sure. The time is 12:30 PM.^</s>^<s> I'm a young {...}
- deleted 3y ago[deleted]
- deleted 3y ago[deleted]
- borzunov 3y agoHi, a Petals dev here. </s> means "end of sequence" for LLMs. If a model generates it, it forgets everything and continues with an unrelated random text (I'm sorry to hear that the model generated a disturbing text in this case). Still, I doubt that malicious actors are involved here. Apparently, the Colab code snippet is just too simplified and does not handle </s> correctly. This is not the case with the full chatbot app at https://chat.petals.dev https://chat.petals.dev - you can try it out instead.
- quickthrower2 3y agoThanks for the reply. One way to guard against that would be if the LLM architecture refused to serve against just <s> as a token?
- brucethemoose2 3y agoBase llama has lots of lurid in it already.