5 ms·
If I ask ChatGPT how transformers work the results are sufficient but brief. It’s difficult to probe ChatGPT, and it doesn’t have an intuition for your weak poi
by ipnon 4y ago
If I ask ChatGPT how transformers work the results are sufficient but brief. It’s difficult to probe ChatGPT, and it doesn’t have an intuition for your weak points like a tutor does. If I ask ChatGPT about who influenced John Maynard Keynes however it will hallucinate a whole corpus of economists and papers that never existed but whose existence is proposed so confidently it is incredulous.
Mainly we should appreciate the dearth of capabilities that arise merely as emergent properties of ever larger language models. Some kind of architecture will be needed for each use case, which means we once again find ourselves facing difficult engineering problems.