2 ms·
It drops from 50 to 33,96. Still the best, o1 on variable is around 2 times better than Claude on original test. The rest of the llm are far away, single digit
by aucisson_masque 2y ago
It drops from 50 to 33,96.
Still the best, o1 on variable is around 2 times better than Claude on original test.
The rest of the llm are far away, single digit.
It makes me wonder if o1 is finally getting intelligent? LLM are not supposed to understand these problems when you change variable and values, they have to rely on preexisting data of absolutely identical solved problem to give a correct answer.
I didn't follow LLM development but I heard one times that chatgpt is now composed of multiple LLM and maybe they put multiple artificial intelligence with purpose of problems solvings or trigonometry for instance.
That would explain the reason it's so much better.