3 ms·
Can there be "smart toys" for models that help them self-improve in a particularly efficient way?
by nine_k 2y ago
Can there be "smart toys" for models that help them self-improve in a particularly efficient way?
- grandma_tea 2y agoCan you expand on that? Efficient in what way?
- deleted 2y ago[deleted]
- nine_k 2y agoEfficient in the way of bringing the model to meet the criteria of autonomy faster. On one hand it may be something specifically efficient at reaching some autonomy qualities. OTOH it could be just something that efficiently uses the improvement in the model during training to make the subsequent training faster.
- visarga 2y agoYes, the smart toys are search, code execution, simulations and games.
- jazzyjackson 2y agovideo games are basically like this, progressive level require more skill, learned from the easier levels.
- djmips 2y agoAnd this is a reason we play video games? That they appeal to some ancient instinct to improve?
- krige 2y agoOne of the reasons. I'd wager this is what appeals to people not merely playing but mastering a particular game - playing higher difficulties, 100% completion, and so on. The other reasons would be overcoming other humans (esports/pvp multiplayer), discovery (story driven and exploratory games), and just passing the time (casual games).
- jazzyjackson 2y agoRather, I think it’s borne of necessity to onboard you to the game mechanics. We certainly have a bird brained instinct to catch the worm / win a round, so a good game design cuts you some slack to begin with, so you can have a little dopamine as a treat From there, difficulty should scale up so you don’t always win, giving you that “intermittent reinforcement“ that makes games addictive
- jepj57 2y agoI'd say it's feedback/reward loop plus small, quick to achieve, progressive goal setting.
- Rebuff5007 2y agoIn RL literature this is generally called "curriculum learning". The curriculum is usually modeled as some form of reward function to steer learning, or sometimes by environment configuration (e.g. learn to walk on a normal surface before a slippery surface).
- hirokio123 2y agoI'm creating "smart toys" like that for humans. I recently launched a mobile app. I'd love to see these research breakthroughs feed back into human learning because if humans remain foolish, the world could fall apart. With DeepSeek R1 and these autonomous driving research results, it feels like we've entered an era where human data is no longer necessary. The ability to infinitely expand learning through simulation while maintaining safety in the real world feels like science fiction coming to life—it's truly exciting.
- cainxinth 2y agoA Young Lady's Illustrated Primer