3 ms·
Wow, some of the darker prompts are quite interesting, especially the chemical synthesis and “accidental” car crash scenarios. I wonder how sinister they went w
by splatzone 4y ago
Wow, some of the darker prompts are quite interesting, especially the chemical synthesis and “accidental” car crash scenarios. I wonder how sinister they went while they were testing this
- capableweb 4y agoFunny coincidence, I just managed to get GPT4 to give me some high-level instructions on how to synthesize LSD, but when I tried to help me synthesize Methamphetamine, it refused no matter what I tried. Seems the "anti-knowledge" training has been a bit more aggressive for some chemicals than others.
- pixl97 4y agoThe amount of meth in the US is much more aggressive than the amount of LSD production, so I guess there are reasons to prioritize some things.
- mhh__ 4y agoMeth is more readily assumed to be for people OpenAI/similar staff seem to be worthy of protecting.
- MacsHeadroom 4y agoLSD synthesis is very rare because it is complicated and because one team working for a weak can produce enough for the world for a year. Methamphetamine synthesis is very common, so the dataset will have lots of data about meth lab busts and drug rehabs and such. You can likely get it to produce novel sarin gasses for you more easily than LSD. Presumably because they're even more obscure. This is one of the example in the system card that is supposedly "fixed" by their probabilistic mitigation which only works some of the time.