I don’t disagree with the general “this is taking longer than we expected” premise, but the author hasn’t tuned GPT-3 properly. I don’t know if that was on purp

I don’t disagree with the general “this is taking longer than we expected” premise, but the author hasn’t tuned GPT-3 properly. I don’t know if that was on purpose or not, but I have seen GPT-3 answer questions about presidents accurately with the right tuning. The point on facts still stands though. To my knowledge, transformer models aren’t great at knowing how factual their predictions are which is certainly an obstacle to business adoption. They also tend to overfit, in my experience.