In elementary school they hardcode the multiplication table and they do test for them, at least it was my experience. For some weird reason we were taught to re

In elementary school they hardcode the multiplication table and they do test for them, at least it was my experience. For some weird reason we were taught to remember 8x125 is 1000. It came handy maybe 3 times in the past 35 years, but in those cases people looked at me like a wizard :) > Test's are useful precisely to gauge human retention/understanding Indeed, and these models are also compressing information they were trained on. It makes sense to test them how well can we access and query that knowledge. I'm not saying at all, that passing tests make them human or anything like us, but it speaks a lot about the quality of the model. It's not the ultimate quality check of course, but it's an important one, because you can assign a score to the results of the test. > Its like applauding the calculator for doing math. Show that calculator to Charles Babbage, he would be in awe :) This is probably the leap why most people are freaking out, it feels a significant step towards intelligent machines regardless of the system under the hood. I actually tested ChatGPT, (like a few million other people). I'm not saying it was done with scientific rigour of course. It passed a few flawlessly and failed some other. I believe I know what I'm interacting with, I've read about how GPT works and I'm planning to learn more. Don't worry about my enthusiasm :)