2 ms·
What sort of questions do you ask out of curiosity?
by Banditoz 3y ago
What sort of questions do you ask out of curiosity?
- miiiiiike 3y agoI don’t want scrapeable answers out there, I want to see ChatGPT cross this little Rubicon on its own. Vaguely: Questions that most people think they know the correct answers to but, in my experience, don’t.
- lairv 3y agoI think it's fair to want to keep an evaluation private so that it doesn't become part of a train set, but you should know that OpenAI uses users chat data to improve their models (not for entreprise)
- archiepeach 3y agoThis does sound like a test that is almost "set up to fail" for an LLM. If the answer is something that most people think they know, but actually don't then it won't pass in an LLM which is essentially a distillation of the common view.