6 ms·
You could say that predicting the next token is their only action, and minimizing the loss their only goal. It's a kind of impoverished environment. Imagine a h
by visarga 5y ago
You could say that predicting the next token is their only action, and minimizing the loss their only goal. It's a kind of impoverished environment. Imagine a human living in a cave, seeing only a scrolling line of text. Would that human learn anything new by getting out of its cave? Plato was so right, intelligence needs access to the full environment.
- FeepingCreature 5y agoI mean, isn't the whole point of Plato that we do everything we do, which is a lot, certainly enough to be dangerous, just by sitting in a cave and manipulating levers while watching a shadow? This does not make text-trained AI seem safer. Seen another way, the lesson of Plato is "Shadows On A Cave Wall Are All You Need - arxiv.com"