3 ms·

I can ask ChatGPT to write code and assess myself whether it's correct or not. (It's frequently not, but it can still be useful for certain tasks.) I can ask it

I can ask ChatGPT to write code and assess myself whether it's correct or not. (It's frequently not, but it can still be useful for certain tasks.) I can ask it to explain something about the industry I work in or adjacent fields and have a pretty good sense of whether it's leading me in the right direction. But if I asked it to teach me about, say, Chinese history, I would have very little ability to assess whether it's telling me the truth or sprinkling little falsehoods into things. I would only be able to catch the most blatant mistakes; the rest would require more detailed independent research. Now imagine you're a kid who's still learning reading comprehension and hasn't yet developed a functional BS detector. You're not going to have much of an ability to separate truth from fiction, but you're likely going to trust this thing that sounds authoritative.

welshwelsh 2y ago
While these are all valid concerns, they also apply to human teachers. Humans spew bullshit all the time. But that's OK. A teacher's knowledge doesn't need to be perfect, it just needs to be better than the student's. If ChatGPT explains Chinese history in a way that is 80% accurate, to a student whose understanding of Chinese history is 10% accurate, the student will walk away with a better understanding of Chinese history.
- camdenreslink 2y ago
  This seems very incorrect to me. Human teachers make mistakes, or understand details of something incorrectly sometimes, but it doesn't come up in every lesson. It only happens occasionally, and sometimes a student will correct them/challenge them on it. ChatGPT makes mistakes literally every time I use it (in a domain that I'm knowledgable in). How is that the same thing? Being given incorrect information is worse than not having the knowledge at all IMO.
  - nopinsight 2y ago
    Do you mean GPT-3.5 (free) or GPT-4 (paid)? Their performance and hallucination rates are very different. GPT-4o (the best current model) is now becoming available to free, registered users now. What do you think of it? Unless your domain is very specialized, I think GPT-4T, GPT-4o, and Claude 3 Opus for example are quite good.
    - camdenreslink 2y ago
      I use GPT 4, and it still constantly invents things and presents them to me with authority. I haven’t tried GPT-4o yet.
      - nopinsight 2y ago
        I do find that current LLMs are quite bad at design problems and answering very specific questions for which they may lack sufficient training data. I like them for general Q&A though. A different architecture or an additional component might be needed for them to generalize better for out-of-training-distribution questions.
Myrmornis 2y ago
Yes, that's fair, but I think we can do better in our education revolution than just plonking kids down in a classroom with ChatGPT! If we take a fairly constrained subject like high school algebra, we should be able to, for example, study its BS rate by having knowledgeable testers converse with it at length, and thus perhaps produce AIs suitably calibrated and QA'd for classroom usage. But I should go read Sal's book, it sounds promising.

welshwelsh 2y ago

While these are all valid concerns, they also apply to human teachers. Humans spew bullshit all the time. But that's OK. A teacher's knowledge doesn't need to be perfect, it just needs to be better than the student's. If ChatGPT explains Chinese history in a way that is 80% accurate, to a student whose understanding of Chinese history is 10% accurate, the student will walk away with a better understanding of Chinese history.

camdenreslink 2y ago
This seems very incorrect to me. Human teachers make mistakes, or understand details of something incorrectly sometimes, but it doesn't come up in every lesson. It only happens occasionally, and sometimes a student will correct them/challenge them on it. ChatGPT makes mistakes literally every time I use it (in a domain that I'm knowledgable in). How is that the same thing? Being given incorrect information is worse than not having the knowledge at all IMO.
- nopinsight 2y ago
  Do you mean GPT-3.5 (free) or GPT-4 (paid)? Their performance and hallucination rates are very different. GPT-4o (the best current model) is now becoming available to free, registered users now. What do you think of it? Unless your domain is very specialized, I think GPT-4T, GPT-4o, and Claude 3 Opus for example are quite good.
  - camdenreslink 2y ago
    I use GPT 4, and it still constantly invents things and presents them to me with authority. I haven’t tried GPT-4o yet.
    - nopinsight 2y ago
      I do find that current LLMs are quite bad at design problems and answering very specific questions for which they may lack sufficient training data. I like them for general Q&A though. A different architecture or an additional component might be needed for them to generalize better for out-of-training-distribution questions.

Myrmornis 2y ago

Yes, that's fair, but I think we can do better in our education revolution than just plonking kids down in a classroom with ChatGPT! If we take a fairly constrained subject like high school algebra, we should be able to, for example, study its BS rate by having knowledgeable testers converse with it at length, and thus perhaps produce AIs suitably calibrated and QA'd for classroom usage. But I should go read Sal's book, it sounds promising.