3 ms·
This is an article by GMU professor of economics Bryan Caplan, published April 3, 2023. Caplan writes: > Did GPT-4 just get lucky when it retook my last midter
by bumbledraven 4y ago
This is an article by GMU professor of economics Bryan Caplan, published April 3, 2023. Caplan writes:
> Did GPT-4 just get lucky when it retook my last midterm? Does it have more training data than the designers claim? Very likely not, but these doubts inspired me to give GPT-4 my latest undergraduate exam… This is for my all-new Econ 309: Economic Problems and Public Policies class, so zero prior Caplan exams exist.
> The result: GPT-4 gets not only an A, but the high score! This is the real deal. Verily, it is Biblical. For matters like this, I’ve often told my friends, “I’ll believe it when I put my fingers through the holes in his hands.” Now I have done so.
- sbierwagen 4y agoFrom Bryan's previous post: >ChatGPT scored poorly on my Fall, 2022 Labor Economics midterm. A D, to be precise. The performance was so poor compared to the hype that I publicly bet Matthew Barnett that no AI would be able to get A’s on 5 out of 6 of my exams by January of 2029. Three months have passed since then. So he was off by a mere 81 months.
- intelVISA 4y agoIf an LLM scores highly on a test was the ML model smart or the test dumb?
- arthurcolle 4y agoChatGPT exhibited less than stellar performance when asked to resolve P =? NP, believe it or not!
- HDThoreaun 4y agoDepends on the test.