2 ms·
I don't think scaling LLMs will get there but there are other ways to use neural nets. For example MuZero uses a deep neural network to learn games through self
by tim333 1y ago
I don't think scaling LLMs will get there but there are other ways to use neural nets. For example MuZero uses a deep neural network to learn games through self play and:
>Starting from random play, and given no domain knowledge except the game rules, AlphaZero achieved within 24 hours a superhuman level of play in the games of chess and shogi [a similar Japanese board game] as well as Go, and convincingly defeated a world-champion program in each case https://www.theguardian.com/technology/2017/dec/07/alphazero-google-deepmind-ai-beats-champion-program-teaching-itself-to-play-four-hours https://www.theguardian.com/technology/2017/dec/07/alphazero...
And MuZero did similar, surpassing AlphaGo. So while LLMs may be bad at thinking and learning, other neural net arrangements may do well.