3 ms·
Alignment was one of the explicitly declared goals of ChatGPT. That's why they opened it to the public, to let people hack it and work to close those vulnerabil
by crucialfelix 3y ago
Alignment was one of the explicitly declared goals of ChatGPT. That's why they opened it to the public, to let people hack it and work to close those vulnerabilities.
Unfortunately it went viral, and this caused a rush to product. But you can't say they shrugged or that people aren't earnestly working on Alignment.
- startupsfail 3y agoI think, focus on Alignment and simply making the system to be good and useful should be the focus. Not fighting prompt injections or complaining about hallucinations, while not contributing much. When you are educating a child, you are not focusing on making the child super-resilient to hypnosis. You are simply socializing the child, teaching the child to read, write. The knowledge, need and techniques to avoid being hypnotized don’t need a special focus.
- danShumway 3y ago> But you can't say they shrugged or that people aren't earnestly working on Alignment. They opened up 3rd-party API access. They clearly do not view this as a blocker whatever their declared goals are. > Unfortunately it went viral, and this caused a rush to product. They encouraged it to go viral. This is not a thing that was thrust upon them against their will. They signed a deal with Microsoft to turn this into a search engine and to allow it to start operating on untrusted 3rd-party text. Nobody held a gun to their head and forced them to do that. They made that choice.