The idea that updating weights is particularly necessary is questionable. Memory augmented llms are computationally universal. https://arxiv.org/abs/2301.04589

The idea that updating weights is particularly necessary is questionable. Memory augmented llms are computationally universal. https://arxiv.org/abs/2301.04589 https://arxiv.org/abs/2301.04589 and make no mistake, in context learning can be used in a meaningful way to resolve deficiencies. gpt-3 getting 98.5% accuracy (on even very large numbers) on addition arithmetic by describing the algorithm of addition to be performed on 2 numbers. https://arxiv.org/abs/2211.09066 https://arxiv.org/abs/2211.09066 In context learning is just overpowered. It's essentially implicit fine-tuning https://arxiv.org/abs/2212.10559v2 https://arxiv.org/abs/2212.10559v2 as for asking questions, llms can do that just fine. anyone who's used bing will tell you as much. You don't know what subjective experience cGPT may or may not be having. just like i don't actually know for you or you for me. you've simply chosen to assume such.