2 ms·
Absolutely the user has some responsibility. However, chatbots seem to have a history of being attributed greater competence than they have, including by people
by abeppu 3y ago
Absolutely the user has some responsibility. However, chatbots seem to have a history of being attributed greater competence than they have, including by people who know at least partially how they work. If a google engineer whose actual job is to work with an identify issues in the outputs of a similar model can be fooled into believing that it's _sentient_, I think it's appropriate for OpenAI to expect that when they open their product to a large audience that it's going to be trusted to a risky degree.
In addition to humans' predisposition to see a knowing/thinking agent when they interact with language, there are now plenty of widely reported outcomes where e.g ChatGPT passes the bar exam, ChatGPT's answers to medical questions are generally judged better than those of doctors (on a web forum), etc. Any person googling around about ChatGPT will find plenty of content about its amazing abilities including the "sparks of AGI" microsoft paper.
OpenAI's copy says that you can "get instant answers" or "learn something new". It does not say "get responses which may or may not be answers and which may or may not be correct" and "learn something which may or may not be true".
Does OpenAI bear 100% responsibility for the model saying it likely generated student-provided text? Probably not. Does it bear more than 0% responsibility? I think so.