4 ms·
LLMs demonstrably model their training data, which has a correspondence to the structure in the world captured in the data[1][2]. This goes far beyond just sear
by hackinthebochs 4y ago
LLMs demonstrably model their training data, which has a correspondence to the structure in the world captured in the data[1][2]. This goes far beyond just searching a database for the closest relevant response. The question is what does that mean regarding understanding? I go into that in some detail here[3].
[1] https://arxiv.org/abs/2210.13382 https://arxiv.org/abs/2210.13382
[2] https://twitter.com/leopoldasch/status/1638848881558704129 https://twitter.com/leopoldasch/status/1638848881558704129
[3] https://www.reddit.com/r/naturalism/comments/1236vzf/ https://www.reddit.com/r/naturalism/comments/1236vzf/