3 ms·
all the reasoning still comes from pretraining data
by dominotw 17d ago
all the reasoning still comes from pretraining data
- bigmadshoe 17d agoI think they mean reasoning their way to the need for a web search.
- jasonjmcghee 17d agoOr other kind of search / knowledge acquisition / computer use etc to get the information needed
- binlog 17d agoSays who? Models can also use results from tool calls in their reasoning loops.
- dominotw 17d agosome logic here https://www.lesswrong.com/posts/HYCGA2p4bBG68Yufh/thinking-about-reasoning-models-made-me-less-worried-about https://www.lesswrong.com/posts/HYCGA2p4bBG68Yufh/thinking-a...