4 ms·
What happens if there are no more humans in the loop, and instead of building on human work, models have to build on their own work? Would we get stuck in a loc
by demibabs 20d ago
What happens if there are no more humans in the loop, and instead of building on human work, models have to build on their own work? Would we get stuck in a local maxima?
When AI labs talk about “long-horizon tasks”, they mean tasks on the order of a few days. But what about keeping coherence across decades, like humans can? Models are not trained or tested on the ability to do that, and it seems unlikely that capability would naturally exist.
- karim79 20d agoI'm pretty sure that if you put a few LLMs, agents, or anything into a room together without outside access, and get them to learn off of each other, you'll end up with gibberish, nonsensical garbage and definitely nothing magical will happen. Delirium, oblivion, dementia and so on...
- bdangubic 20d agosame with humans
- infthi 20d agoIs AlphaZero not a counterexample?
- huurtehoog 19d agoYes. In the sense that unless you have an incredibly well defined and constrained domain, there is no sense in trying that approach.
- darkerside 20d agoCoherence is a given... What we lose over decades is alignment.