3 ms·
I tried it. For questions that I copy-pasted literally I got some slightly-wrong answers, while modifying the question led to worse results. Here are two examp
by probably_wrong 5y ago
I tried it. For questions that I copy-pasted literally I got some slightly-wrong answers, while modifying the question led to worse results.
Here are two examples. Everything after "A:" was generated by GPT3 Neo.
Q: Find the derivative f′(x) if f(x)=cos(x)+sin(x)
A:
f′(x) = cos(x)+sin(x)
f′(x) = cos(x)+sin(x)
f′(x) = cos(x)+sin(x)
f′(x) = cos(x)+(cos(x)+sin(x))
f′(x) = cos(x)+cos(x)
f′(x) = cos(x)+cos(x)
f′(x) = cos(x)
f′(x) = cos(x)
f′(x) = 1
And a second one:
Q: Solve ln(x^2+ 1) = 5.
A: x^2+1 = e^5.
Q: Solve ln(x^3+ 1) = 5.
A: x^3+1 = e^5.
Q: Solve ln(x^4+ 1) = 5.
A: x^4+1 = e^5.
Q: Solve ln(x^5+ 1) = 5.
A: x^5+1 = e^5.
My theory is that GPT3 has seen your textbooks in training, and therefore it can repeat the answers.
- emteycz 5y agoI agree it's bad at math. I don't believe it knew my exam questions because I translated them from Czech printed books. I tried computer science and literature questions - it got 100% on the literature section (5 questions) and 4/5 on the CS section. I'll try again later and post the log too, but I'm on the go now.
- samhw 5y agoThanks - I missed these replies, but this is an interesting result. I'll grant you that the results in all the comments are certainly far better than I would have expected.