4 ms·
AlphaGo learned to play Go by playing with itself. Why couldn't LLM do the same? They got plenty of information to be used as a starting point, so surely they c
by vbezhenar 2y ago
AlphaGo learned to play Go by playing with itself. Why couldn't LLM do the same? They got plenty of information to be used as a starting point, so surely they can figure out some novel information eventually.
- ainoobler 2y agoAlphaGo was playing by very specific rules. What are the rules for LLMs to do the same?
- treyd 2y agoLLMs aren't logically reasoning through an axiomatic system. Any patterns of logic they demonatrate are just recreated from patterns in input data. Effectively, they can't think new thoughts.
- NiloCK 2y agoDo you think they sometimes hallucinate? Do you think a collection of them can spot one another's hallucinations? Do you think that, on occasion, some hallucinations will at least directionally be under explored good ideas?
- ricopags 2y agoThe massive LLMs trained on webscale data aren't. But some are, in fact: https://arxiv.org/abs/2407.07612 https://arxiv.org/abs/2407.07612
- czl 2y ago> Effectively, they (LLMs) can't think new thoughts. This is true only if you assume that combining existing thought patterns is not new thinking. If they can't learn a certain pattern from training data, indeed they would be stuck. However, their training data keeps growing and updating, allowing each updated version to learn more patterns.