4 ms·
I'm surprised - I haven't gotten anywhere near as dark as this, but I've tried some stuff out of curiosity and the safety always seemed tuned very high to me, l
by ritzaco 11mo ago
I'm surprised - I haven't gotten anywhere near as dark as this, but I've tried some stuff out of curiosity and the safety always seemed tuned very high to me, like it would just say "Sorry I can't help with that" the moment you start asking for anything dodge.
I wonder if they A/B test the safety rails or if longer conversations that gradually turn darker is what gets past those.
- the__alchemist 11mo agoMeanwhile, ask it for information on Lipid Nanoparticles!
- conception 11mo ago4o is the main problem here. Try it out and see how it goes.
- deleted 11mo ago[deleted]
- jaredklewis 11mo agoThe ways LLMs work, the outcomes are probabilistic, not deterministic. So the guardrails might only fail one in a thousand times.
- skygazer 11mo agoAlso, the longer the context window, the more likely the LLM derangement/ignoring safety. Frequently, those with questionable dependence on AI stay in the same chat indefinitely, because that's where the LLM has developed the ideosyncracies the user prefers.