3 ms·
LLMs demonstrably model their training data, which has a correspondence to the structure in the world[1][2]. The question is what does that mean regarding under
by hackinthebochs 4y ago
LLMs demonstrably model their training data, which has a correspondence to the structure in the world[1][2]. The question is what does that mean regarding understanding? I go into that in some detail here[3].
[1] https://arxiv.org/abs/2210.13382 https://arxiv.org/abs/2210.13382
[2] https://twitter.com/leopoldasch/status/1638848881558704129 https://twitter.com/leopoldasch/status/1638848881558704129
[3] https://www.reddit.com/r/naturalism/comments/1236vzf/on_large_language_models_and_understanding/ https://www.reddit.com/r/naturalism/comments/1236vzf/on_larg...