It seems like it'll be a big advantage if the actual models could, especially for on-device or privately deployed LLMs that should learn about the preferences o

It seems like it'll be a big advantage if the actual models could, especially for on-device or privately deployed LLMs that should learn about the preferences of their users and their changing environments. Do you have any idea why the models don't change? They may not need to, if "context" is enough to prompt them, but it's not clear to me why not.