4 ms·
How do you know that ChatGPT is teaching you about the topic? It doesn't know what is right or what is wrong.
by multjoy 1y ago
How do you know that ChatGPT is teaching you about the topic? It doesn't know what is right or what is wrong.
- tough 1y agoIt can consult any sources about any topic, ChatGPT is as good at teaching as the pupil's capabilities to ask the right questions, if you ask me
- multjoy 1y agoIt may well consult any source about the topic, or it may simply make something up. If you don't know anything about the subject area, how do you know if you are asking the right questions?
- ryandrake 1y agoLLM fans never seem very comfortable answering the question "How do you know it's correct?"
- mystraline 1y agoI'm a moderate fan of LLMs. I will ask for all claims to be backed with cited evidence. And then, I check those. In other cases, of things like code generation, I ask for a test harness be written in and test. In some foreign language translation (High German to english), I ask for a sentence to sentence comparison in the syntax of a diff.
- the_snooze 1y agoI like to ask AI systems sports trivia. It's something low-stakes, easy-to-check, and for which there's a ton of good clean data out there. It sucks at sports trivia. It will confidently return information that is straight up wrong [1]. This should be a walk in the park for an LLM, but it fails spectacularly at it. How is this useful for learning at all? [1] https://news.ycombinator.com/item?id=43669364 https://news.ycombinator.com/item?id=43669364
- giantrobot 1y agoBut just because it's wrong about sports trivia doesn't mean it's wrong about anything else! /s [0] [0] https://en.m.wikipedia.org/wiki/Gell-Mann_amnesia_effect https://en.m.wikipedia.org/wiki/Gell-Mann_amnesia_effect