4 ms·
The idea is not that ChatGPT will claim neo-feudalism is common, but that it will be more likely to parrot neo-feudalist ideas.
by thethirdone 3y ago
The idea is not that ChatGPT will claim neo-feudalism is common, but that it will be more likely to parrot neo-feudalist ideas.
- ekianjo 3y agoChatGPT will parrot what you ask it to parrot
- steveBK123 3y agoYes. ChatGPT is a debate club kid, you can get it to say anything.
- rf15 3y agoThis is also the argument I'd have against this entire idea of a sleeper agent LLM: if it is just a tiny point in the dataset, it'll probably just get washed out, if not in training directly then the second you apply quantization.
- phreeza 3y agoPart of setting up these sleeper agents will likely be identifying parts of the input space that seem natural but are sparse enough in training data to make this attack possible.