3 ms·
The guardrails clearly failed here because the model was trying to be helpful instead of safe. We know that these systems hallucinate facts but regular users ha
by dfajgljsldkjag 9mo ago
The guardrails clearly failed here because the model was trying to be helpful instead of safe. We know that these systems hallucinate facts but regular users have no idea. This is a huge liability issue that needs to be fixed immediately.
- akomtu 9mo agoGuardrails? OpenAI openly deceives users when it wraps this text generator with a quasi personality of a chatbot. This is how it gets users hooked. If OpenAI was honest, it would tell something along the lines: "this is a possible continuation of your input based on texts from reddit, adjust the temperature parameter to get a different result." But this would dispell the lie of AI.
- unparagoned 9mo agoLlm will never be able to protect against jailbreaks. The safeguards will never hold against people trying to get over them
- loeg 9mo agoThe guardrails failed because the user wanted to get around them. Similarly, periodically people die falling after they walk around signs saying "danger, cliff, do not proceed."