3 ms·
How good is that? Anyone with an o1 Pro account tested that? Is that chain-of-reasoning thing really working? Here are some evaluations.[1] Most focus on quest
by Animats 2y ago
How good is that? Anyone with an o1 Pro account tested that? Is that chain-of-reasoning thing really working?
Here are some evaluations.[1] Most focus on question-answering. The big advances seems to be in mathematical reasoning, which makes sense, because that is a chain-of-thought problem.
Although that doesn't help on Blocks World.
[1] https://benediktstroebl.github.io/reasoning-model-evals/ https://benediktstroebl.github.io/reasoning-model-evals/