4 ms·
We don’t know o1 thinks in English. What we see is a summary of the thinking process. My guess is it “thinks” in non-eligible tokens
by MaxLeiter 2y ago
We don’t know o1 thinks in English. What we see is a summary of the thinking process.
My guess is it “thinks” in non-eligible tokens
- disqard 2y agoDid you mean to write "non-legible" ?
- letmevoteplease 2y agoThe o1 release blog post contains 8 full examples of o1 chains of thought (not the summarized versions visible to users). They're English. https://openai.com/index/learning-to-reason-with-llms/#chain-of-thought https://openai.com/index/learning-to-reason-with-llms/#chain... I have seen the summaries dip into completely random languages like Thai, so it might switch between languages occasionally.