There’s a different model of chatbot interaction where the AI provides hints that may be wrong, but they’re helpful, because you consider solutions that you did

There’s a different model of chatbot interaction where the AI provides hints that may be wrong, but they’re helpful, because you consider solutions that you didn’t think of yet. This doesn’t require intelligence. The Oblique Strategies card deck does a similar thing, and you’re drawing randomly from a deck of cards. AI-provided hints are considerably better guesses than a deck of cards can give you. When writing code using GPT4 and Code Interpreter, it often guesses right the first time about what the bug is in some code. Other times it will guess wrong, repeatedly, so I need to undo and tell it more specifically what to do. Does GPT4 understand trigonometry? I went back and forth on this. Yes, it does! But no it doesn’t, it just got lucky. But yes, it does, if you ask it to explain the math first. But no, it doesn’t, it got lucky again. What seems clear is that it “understands” context very well. It will make guesses that are entirely appropriate when writing code that does calculations using trigonometry. It will come up with plausible explanations, given that we are doing trigonometry. They still seem to be guesses, though. In the short term, AI chatbots don’t learn, cannot learn, because they implement a pure function. When you start a new chat, the state is reset. Instead, we learn to give them better context and get better results. The learning is in the prompt engineering.