Sure, but local LLMs are getting smaller all the time... so it could in the not so distant future ship with its own locally-hosted LLM embedded (no data leaving

Sure, but local LLMs are getting smaller all the time... so it could in the not so distant future ship with its own locally-hosted LLM embedded (no data leaving your device). I guess it could always be relegated to plugins, but I suspect over the next 5 years the line is going to get a lot blurrier.