3 ms·
What price is this sitting at? Because if its software support is decent then Intel might have just managed to break into the hardware for AI on the edge. Examp
by tonetegeatinst 1y ago
What price is this sitting at? Because if its software support is decent then Intel might have just managed to break into the hardware for AI on the edge. Examples like self hosted LLM finetuning and RAG on a old dell or HP server with these type of cards on them.
- Aurornis 1y ago> Examples like self hosted LLM finetuning and RAG on an old dell or HP server with these type of cards on them. This won’t be in the price range of an old Dell server or a fun impulse buy for a hobbyist. 160GB of raw LPDDR5X chips alone is not cheap. This is a server/workstation grade card and the price is going where the market will allow. Consider that an nVidia card with almost half the RAM is going to cost $8K or more. That price point is probably the starting point for where this will be priced, too.
- vardump 1y agoThat nVidia card is going to have 5x the memory bandwidth. LPDDR5X is going to be rather low bandwidth. (My guess is Intel's card is only going to have about 400 GB/s bandwidth.)
- matt-p 1y agoLast year's M4 max MacBook is 520GB/s and (I expect) that should be closer to 1TB/s in a year or two by the time they are using ddr5. It would be deeply embarrassing if they had worse performance than apples cheaper laptop.
- matt-p 1y agoMaybe not old but if this was say a 6k card that would make it accessible to pretty much any business and at least some hobbyists. 160GB of Lpddr5 should be less than 2k, so it's easily doable if they've got the will. 4 x 5090s is 128GB and probs much more powerful at ~8k, so it would need to be 6/7k to make it make sense.