3 ms·
> Purpose-Built for Agentic AI From the "fridge purpose-built for storing only yellow tomatoes" and "car only built for people whose last name contains the let
by dmitrygr 7mo ago
> Purpose-Built for Agentic AI
From the "fridge purpose-built for storing only yellow tomatoes" and "car only built for people whose last name contains the letter W" series.
When can this insanity end? It is a completely normal garden-variety ARM SoC, it'll run Linux, same as every other ARM SoC does. It is as related to "Agentic $whatever" as your toaster is related to it
- dpe82 7mo agoThe power and importance of marketing is deeply underappreciated by us technical types.
- LogicFailsMe 7mo agoAnd yet more than a little Gavin Belson "Box III" vibes here. Fortunately, no signature edition.
- dwb 7mo agoI don’t underappreciate it, but I do despise it.
- pdpi 7mo ago> It is as related to "Agentic $whatever" as your toaster is related to it These things have hardware FP8 support, and a 1.8TB/s full mesh interconnect between CPUs and GPUs. We can argue about the "agentic" bit, but those are features that don't really matter for any workload other than AI.
- kibibu 7mo agoWould cloud gaming platforms benefit from the interconnect?
- pdpi 7mo agoDon't think they would. Games aren't nearly as hungry for memory bandwidth as LLMs are. Also, I expect that the VRAM/GPU/CPU balance would be completely out of whack. Something would be twiddling its thumbs waiting for the rest of the hardware.
- dmitrygr 7mo agomem bw between cores matters for .... literally all workloads that are not single-core (read: all). And FP8 matters not at all cause inference on cpu is too slow to be of any use whatsoever in the days of proper accelerators
- pezezin 7mo agoThe huge interconnect would also useful be for HPC tasks. The FP8 not so much, HPC still loves FP64.
- pwg 7mo ago> It is a completely normal garden-variety ARM SoC To mis-quote the politician quip: How can you tell a marketer is lying? Answer: His/her mouth is moving.