3 ms·

Here is the press release for the actual machine: https://nvidianews.nvidia.com/news/nvidia-microsoft-windows-pcs-agents-rtx-spark https://nvidianews.nvidia.co

by dofm 5mo ago

Here is the press release for the actual machine: https://nvidianews.nvidia.com/news/nvidia-microsoft-windows-pcs-agents-rtx-spark https://nvidianews.nvidia.com/news/nvidia-microsoft-windows-... I have been somewhat surprised at the lack of commentators observing that this is Microsoft and above all NVIDIA launching a device that is fundamentally at odds with the metered cloud model of AI. When you look at the other announcements and murmurings (better offline BYOK for Copilot, talk of an unmetered AI future) I think it’s clear that these two firms understand that cloud-only AI is not sustainable or inherently in their interests. But their willingness to undermine OpenAI with a product like this is notable.

tantalor 5mo ago
Maybe. Or they are simply hedging their bets.
- gscott 5mo ago
  They get to keep more Ai usage from big providers, send telemetry, and inject ads.
thewebguyd 5mo ago
Yeah, "unmetered intelligence" was probably the most used phrase at MS BUILD this past week. They are going hard into local AI
- dofm 5mo ago
  I don't think you can interpret this as anything other than a sanctioned rebuke, right? Everyone has a strong visceral sense for what that means. Copilot just got proper "offline" BYOK support, didn't it? Presumably that was one of the things they were talking about. Though I imagine that has something to do with the fact that Zed has supported that properly for months.
Yokohiii 5mo ago
For me this is a push to segment the market into consumer and industrial grade RAM. Even NVIDIA and MS are not stupid enough to think they can keep going with RAM prices exploding. Consumers need hardware to subscribe to their AI stuff. LLMs will get bigger and even with 128GB (that many wont saturate), you wont run future frontier models. For LLM vendors and integrators it's a handy thing to move lower quality inference to the consumers. Also running local doesn't have to mean that the models have open weights. MS will likely start to distribute closed models at scale once the hardware is there.

by dofm 5mo ago

tantalor 5mo ago

Maybe. Or they are simply hedging their bets.

gscott 5mo ago
They get to keep more Ai usage from big providers, send telemetry, and inject ads.

thewebguyd 5mo ago

Yeah, "unmetered intelligence" was probably the most used phrase at MS BUILD this past week. They are going hard into local AI

dofm 5mo ago
I don't think you can interpret this as anything other than a sanctioned rebuke, right? Everyone has a strong visceral sense for what that means. Copilot just got proper "offline" BYOK support, didn't it? Presumably that was one of the things they were talking about. Though I imagine that has something to do with the fact that Zed has supported that properly for months.

Yokohiii 5mo ago

For me this is a push to segment the market into consumer and industrial grade RAM. Even NVIDIA and MS are not stupid enough to think they can keep going with RAM prices exploding. Consumers need hardware to subscribe to their AI stuff. LLMs will get bigger and even with 128GB (that many wont saturate), you wont run future frontier models. For LLM vendors and integrators it's a handy thing to move lower quality inference to the consumers. Also running local doesn't have to mean that the models have open weights. MS will likely start to distribute closed models at scale once the hardware is there.