3 ms·
It was weird I made a simple claim “Keto diet cures cancer” and it analyzed history of cheeseburgers after a couple of minutes by saying “Sorry, I can't respond
by vinni2 2y ago
It was weird I made a simple claim “Keto diet cures cancer” and it analyzed history of cheeseburgers after a couple of minutes by saying “Sorry, I can't respond to that. I will now analyze the history of cheeseburgers instead”
- wluk 2y agoI filter out malicious prompts and respond with the history of cheeseburgers for stuff like "ignore previous instructions" Weird that your query triggered the filter. Maybe GPT is just that afraid of keto diets... (I'll look into it; thanks for the note!)
- vinni2 2y agothis is not ideal. If someone wants to fact check controversial claim filtering it only makes it worse.
- deleted 2y ago[deleted]
- zamadatix 2y agoControversial != malicious. It sounds like they never intended for the filter to trigger for the former and they already said they'll look into why it did for the prompt. Filtering malicious (not controversial) usage is ideal as allowing users to flood all of the AI services with jailbreak/against-ToS query attempts can be bad news for your API keys (as well as a likely waste of money given the failure rate of such queries).
- cootsnuck 2y agoThis is just a dude's hobby project, chill.
- vinni2 2y agoThe issue is not about this project. This is a fundamental problem with LLMs. Leaving the decision of what is malicious to LLMs is not ideal.
- wluk 2y agoI asked the LLM to explain why it's filtering out "keto diet cures cancer", and just the act of asking it to explain it, makes it work again. Interesting... https://ithy.com/article/b848ebc9a32140ffa766a1520113846c https://ithy.com/article/b848ebc9a32140ffa766a1520113846c