I agree, it's far more the 'training data' than the model architecture. Given that Windows 11 is such a surveillance/advertisement machine I'm sure they sit on

I agree, it's far more the 'training data' than the model architecture. Given that Windows 11 is such a surveillance/advertisement machine I'm sure they sit on years of user movements MS can use to build a OS-running AI, similar to what Anthropic has been trying with 'computer use'. That's where I see Microsoft's niche in the future, and it's an enormous niche: how many people do 'data entry' as a full-time job who'd be unemployed once an LLM can move data from random sources into an Excel sheet by operating a simulated computer?