4 ms·

i wonder how much all the redundant and slightly different resources on the internet today close that gap... this paper is from 1984. also would be curious ho

by a-dub 4y ago

i wonder how much all the redundant and slightly different resources on the internet today close that gap... this paper is from 1984. also would be curious how good today's llms are at getting someone to grok a topic they're having trouble grasping... (this can be actually a hard problem as it can require understanding the misunderstanding in order to guide away from it effectively.)

ipnon 4y ago
If I ask ChatGPT how transformers work the results are sufficient but brief. It’s difficult to probe ChatGPT, and it doesn’t have an intuition for your weak points like a tutor does. If I ask ChatGPT about who influenced John Maynard Keynes however it will hallucinate a whole corpus of economists and papers that never existed but whose existence is proposed so confidently it is incredulous. Mainly we should appreciate the dearth of capabilities that arise merely as emergent properties of ever larger language models. Some kind of architecture will be needed for each use case, which means we once again find ourselves facing difficult engineering problems.