2 ms·
If someone's going to ask you gotcha questions which they're then going to post on social media to use against you, or against other people, it helps to have pr
by pjc50 1y ago
If someone's going to ask you gotcha questions which they're then going to post on social media to use against you, or against other people, it helps to have pre-prepared statements to defuse that.
The model may not be able to detect bad faith questions, but the operators can.
- pmichaud 1y agoI think the concern is that if the system is susceptible to this sort of manipulation, then when it’s inevitably put in charge of life critical systems it will hurt people.
- pjc50 1y agoThere is no way it's reliable enough to be put in charge of life-critical systems anyway? It is indeed still very vulnerable to manipulation by users ("prompt injection").
- klaff 1y agohttps://www.businessinsider.com/even-top-generals-are-looking-to-ai-chatbots-for-answers-2025-10 https://www.businessinsider.com/even-top-generals-are-lookin...
- ben_w 1y agoJust because neither you nor I would deem it safe to put in charge of a life-critical system, does not mean all the people in charge of life-critical systems are as cautious and not-lazy as they're supposed to be.
- mrguyorama 1y agoThe system IS susceptible to all sorts of crazy games, the system IS fundamentally flawed from the get go, the system IS NOT to be trusted. putting it in charge of life critical systems is the mistake, regardless of whether it's willing to say slurs or not