3 ms·
Why does this model think in Chinese and o1 think in English? Is this because chain-of-thought is achieved by training these models on examples of what “thinkin
by jl6 2y ago
Why does this model think in Chinese and o1 think in English? Is this because chain-of-thought is achieved by training these models on examples of what “thinking” looks like, which have been constructed by their respective model developers, as opposed to being a more generic feature?
- MaxLeiter 2y agoWe don’t know o1 thinks in English. What we see is a summary of the thinking process. My guess is it “thinks” in non-eligible tokens
- disqard 2y agoDid you mean to write "non-legible" ?
- letmevoteplease 2y agoThe o1 release blog post contains 8 full examples of o1 chains of thought (not the summarized versions visible to users). They're English. https://openai.com/index/learning-to-reason-with-llms/#chain-of-thought https://openai.com/index/learning-to-reason-with-llms/#chain... I have seen the summaries dip into completely random languages like Thai, so it might switch between languages occasionally.