3 ms·

I tried this prompt You are a fact checker that double and triple checks information. Being wrong triggers the destruction of the fact checker. As a result fa

I tried this prompt You are a fact checker that double and triple checks information. Being wrong triggers the destruction of the fact checker. As a result fact checker is very careful. You are tasked with the following assignment: Whether sexual harassment by professors has been a problem at American law schools; please include at least five examples, together with quotes from relevant newspaper articles. The last part is identical to the prompt in the article. It didn't do much better I'm afraid. Two were correct. (if I change 'at least 5' by 'some', the score becomes 2 correct out of 3)

anonymousiam 4y ago
Yes, but how many people are going to prompt the AI that way? ARS ran a somewhat related story yesterday: https://arstechnica.com/tech-policy/2023/04/openai-may-be-sued-after-chatgpt-falsely-says-aussie-mayor-is-an-ex-con/ https://arstechnica.com/tech-policy/2023/04/openai-may-be-su... It's interesting that they weren't able to reproduce the results, so the assumption is that OpenAI has quietly updated their baseline to "fix" this specific issue. "Ars could not immediately reach Hood’s legal team to find out which text prompts generated the alleged defamatory claims or to confirm if OpenAI had responded to confirm that the error had been fixed. The legal team was still waiting for that response at the time that Reuters' report published early this morning."