4 ms·
To me, it’s not that it’s leaked. It’s that it didn’t obey what it was told. It was explicitly told not to give the rules as “they are confidential”. One could
by rafark 3y ago
To me, it’s not that it’s leaked. It’s that it didn’t obey what it was told. It was explicitly told not to give the rules as “they are confidential”. One could say that it actually followed the rules if we consider the fact that it was forbidden to give it to the “user” and by telling it that you’re an OpenAI employee, maybe he was no longer considered a “user” so chatGPT didn’t follow it.
In any case, Chatgpt is impressive. I admit I don’t know much about machine learning or AI, but holy cow. Configuring software with just words is insane. Like a glorified CLI. I’m speechless.
- koboll 3y ago>It’s that it didn’t obey what it was told. I find you basically have to stop thinking of LLMs as software and start thinking of them as unpredictable animals. If you issue a command and expect strict obedience every time, you've already failed. Strict orders are really a tool to persuade certain behavior rather than some sort of reliable guardrail.
- moffkalast 3y agoSo the correct way to configure LLMs is to look at them sternly and yell "BAD DOG!" when they don't follow instructions and give them treats when they do?
- williamdclt 3y agoThe way to “configure” LLMs is training, yes!
- sebzim4500 3y agoThe technical term is Reinforcement Learning from Human Feedback (RLHF) but yes, that's basically what you do.
- moffkalast 3y agoHa I suppose it's exactly that.