2 ms·
The recent advance of reasoning in o1 preview seems to have not been widely understood by the media and even LeCun in this case. o1 preview represents a new tra
by twobitshifter 2y ago
The recent advance of reasoning in o1 preview seems to have not been widely understood by the media and even LeCun in this case. o1 preview represents a new training paradigm using reinforcement learning on the reasoning steps applied to the solution. This step allows for reasoning to be developed just like AlphaZero is able to ‘reason’ and come up with unique solutions. The reinforcement learning in o1preview means that the ‘repeating facts learned’ arguments no longer apply. Instead the AI is free to come up with its own reasoning steps that lead to correct answers and these reasoning steps are refined over time. It can continue to train and get better by repeatedly answering the same questions, the same way alphazero can play the same game multiple times.
- david-gpu 2y agoI don't think it is comparable to alpha zero, because in the latter case there is an easily verifiable endpoint: whether it won the match or not. With o1 they still rely on human-curated "correct" answers; the system is not able to decide by itself what a correct answer is like alpha zero does. Thus, while it leads to improved reasoning vs prior art, it is not yet bootstrapping. It may be useful in constrained fields like coming up with proofs of theorems, though.
- maskil 2y agoYou still will need clear benchmarks as the reward for RL. With Chess, the rules are simple but you may not have a clear loss function for a complicated architectural challenge.
- Reubend 2y agoI don't think that's correct. As I understand it, O1 can use reinforcement learning to optimize its chain of thought, but each individual "thought" is still subject to the performance of the LLM. Therefore, while it can generate new strategies to approach a problem, the implementation of each step within the strategy is limited by a probabilistic approach. Contrast that with AlphaZero, which can come up with strategies that are 100% unique (in theory), since it isn't constrained by any human training. I think O1 is a step forward, but not a massive leap in technology.
- namaria 2y agoI recently wrote a small essay on my field of expertise and asked chatgpt o1 about it. It consistently misunderstood my arguments, and construed correct sounding but subtly wrong interpretations and explanations. I wouldn't trust it about any subject I don't dominate so it feels kinda pointless to use it at all.