3 ms·
>A chatbot is exactly and only a short term recombination of existing ideas is exactly my point. You missed my point. I'm saying humans have finite context win
by threethirtytwo 9mo ago
>A chatbot is exactly and only a short term recombination of existing ideas is exactly my point.
You missed my point. I'm saying humans have finite context windows as well.
Look at how claude keeps passing it's context window down the chain. It creates a summary. It can spend thousands of tokens to coalesce on a conclusion, and only that conclusion needs to be passed on to the next context window. The research can be tossed. That's how human discovery works. We don't need the whole context window, we produce major discoveries because we pass the conclusion down the chain.
LLMs can do it too. We just never fully tried it.