6 ms·
Intel Announces Arc Pro B70 and Arc Pro B65 GPUs
- pjmlp 7mo agoNew cards in 2026, and targeting Vulkan 1.3?!
- genpfault 7mo ago600 GB/s of memory bandwidth isn't anything to sneeze at. ~$1000 for the Pro B70, if Microcenter is to be believed: https://www.microcenter.com/product/709007/intel-arc-pro-b70-single-fan-32gb-gddr6-pcie-50-graphics-card https://www.microcenter.com/product/709007/intel-arc-pro-b70... https://www.microcenter.com/product/708790/asrock-intel-arc-pro-b70-creator-32gb-gddr6-pcie-50-graphics-card https://www.microcenter.com/product/708790/asrock-intel-arc-...
- qingcharles 7mo agoI think the B65 is priced at $650. Both supported by llamacpp I believe. With that power draw you could run two of them.
- giancarlostoro 7mo agoIntel GPU prices have stayed fine, but I do wonder if they are viable for Inference if they will wind up like Nvidia GPUs, severely overpriced.
- hedgehog 7mo agoRecent kernels have SR-IOV support for these chips too. B&H has them listed for $950. https://www.bhphotovideo.com/c/product/1959142-REG/intel_33p01ib0bb_arc_pro_b70_32gb.html https://www.bhphotovideo.com/c/product/1959142-REG/intel_33p... When 32GB NVIDIA cards seem to start at around $4000 that's a big enough gap to be motivating for a bunch of applications.
- robotnikman 7mo agoI'm probably going to snag one of the Intel cards just for the SR-IOV and use with VM's
- hedgehog 7mo agoDepending what you're doing AMD's support for VirtIO Native Context might be a useful alternative (I think it gives less isolation which could be good or bad depending on use).
- scrubs 7mo agoI tried to use SRIOV to virtualize mellanox nics with vlans on redhat Linux. Long story short it did not work. Per Nvidia the os has to also run open switch. This work was on an already complex setup in finance ... so adding open switch was considered too much additionally complexity. This requirement is not something I run across in the docs. Anybody know better?
- hedgehog 7mo agoThe situation in networking is a lot different than graphics. I don't know much other than that it depends on what specific protocol, card, firmware, and network topology you're using and there's not really generic advice. If the question is setting up Ethernet switching inside the card so VFs can talk to the network, then I think the Linux switchdev tools can configure that on their own without Open vSwitch but you probably need to find someone who understands your specific type of deployment for better advice.
- jauntywundrkind 7mo agoI tend to agree that the vram size and bandwidth is the core thing, but this B70 Pro allegedly has 387 int8 tops vs a 5090 having 3400 int8 tops. 600 compares vs 1792GB/s. I'm delighted so see an option with quarter the price! But man, a tenth the performance? https://www.techpowerup.com/347721/sparkle-announces-intel-arc-pro-b70-and-intel-arc-pro-b65-series-graphics-cards https://www.techpowerup.com/347721/sparkle-announces-intel-a... https://www.tomshardware.com/pc-components/gpus/nvidia-announces-rtx-50-series-at-up-to-usd1-999 https://www.tomshardware.com/pc-components/gpus/nvidia-annou...
- wmf 7mo agoIt's more like a 70 class card with extra VRAM.
- adgjlsfhk1 7mo agoespecially for exploratory work 1/10th the perf is fine. Intel isn't able to compete head to head with Nvidia (yet), but vram is capability while speed is capacity. There will be plenty of use cases where the value prop here makes sense.
- ColonelPhantom 7mo ago838 seems to be the real INT8 TOPS number for the 5090; going from 800 to 3400 takes an x2 speedup for sparsity (so skipping ops) and another x2 speedup for FP4 over INT8. So it's closer to half the speed than a tenth. Intel also seems to be positioning this card against the RTX PRO 4000 Blackwell, not the 5090, and that one gets more like 300 INT8 TOPS. It also has less memory but at a slightly higher bandwidth. The 5090 is much faster and IIRC priced similarly to the PRO 4000, but is also decidedly a consumer product which, especially for Nvidia, comes with limitations (e.g. no server-friendly form factor cards available, and there are or used to be driver license restrictions that prevented using a consumer card in a data center setup).
- jauntywundrkind 7mo agoThank you for the correction. That seemed way too lopsided to be believed. This assessment balances the memory to tops ratio much much more evenly, which is to be expected! I was low key hoping someone would help me make sense of how wildly disparate figures were, but I wasn't seeing. AMD R9700 is 378/766 tops int8 dense/sparse. 644GB/s of 32GB memory. ~$1400. To throw one more card into the mix. Intel undercutting that nicely here. You're right that for companies, the pro grade matters. For us mere mortals, much less so. Features like sr-iov however are just fantastic so see! Good job Intel. AMD has been trickling out such capabilities for a decade (cards fused for "MxGPU" capability) & it makes it such an easier buy to just offer it straight up across the models.
- cmovq 7mo agoI mean it kind of is considering that's comparable to a 5070 which has 672 GB/s? Benefit of NVIDIA being the only one using GDDR7 for now I guess.
- daemonologist 7mo ago7800 XT has 624 GB/s as well, and can be found for $400 used. 16 GB of course.
- BizarroLand 7mo agoI've heard ROCm is still a crapshoot though. Is that true?
- daemonologist 7mo agoIf you stick with your OS/package manager-distributed version, installation isn't painful anymore (provided that version approximately overlaps with your generation of GPU). It's okay for inference, and okay for training if you don't stray too far beyond plain torch. If you want to run code from a paper or other more esoteric stuff you're still going to have a bad time. I don't have an Intel dGPU, but I suspect the situation there is even worse. I mean you go to the torch homepage: https://pytorch.org/get-started/locally/ https://pytorch.org/get-started/locally/ and Intel isn't even mentioned. (It's here though: https://docs.pytorch.org/docs/stable/notes/get_start_xpu.html https://docs.pytorch.org/docs/stable/notes/get_start_xpu.htm...)
- varispeed 7mo agoThe product would be excellent in 2024, but now it's a landfill filler. You can run some small models at pedestrian speed, novelty wears off and that's it. Intel is not looking in the future. If they released Arc Pro B70 with 512GB base RAM, now that could be interesting. 32GB? Meh.
- throwaway85825 7mo agoIt's true that it's severely late and missed it's market window but 512gb just isn't possible.
- WarmWash 7mo agoWake me when they wake up and release a middling card with 128GB memory.
- Weryj 7mo agoBuy 4?
- electronsoup 7mo agoWhich mainboards are cheap and have 4 pcie16x (electrical) slots, that don't need weird risers to fit 4 GPUs
- irishcoffee 7mo agoIf your actual gripe is risers, sounds like a "you" problem, not a technical problem.
- MrDrMcCoy 7mo agoEven if you're fine with risers, that might not be enough. If the bridge lanes are PCIe Gen 3, as many consumer boards have, your Gen 5 card might not init. I extensively tested several motherboards to try and get my AM5 CPU talking to a triple Radeon AI Pro 9700 XT setup, and they absolutely refuse to come up on PCIe3. I was using dummy EDID plugs for them, so they think they have a display, ruling out that issue. What I eventually had to do was buy a used Threadripper box to run those cards, because PCIe Gen 4 definitely works.
- irishcoffee 7mo agoTo be super blunt, this also sounds like a “you” problem.
- SmellTheGlove 7mo agoConsumer CPUs don't have enough PCIE lanes to do that. Even if they had physical x16 slots, at most two of them would be x16. What's cheap to you? You can find Epyc 7002/7003 boards on ebay in the $400 range and those will do it. That's probably the best deal for 4x PCIE 4.0 x16 and DDR4. Probably $500 range with a CPU. That's in the ballpark of a mid to high end consumer setup these days.
- nickthegreek 7mo agoBoth have 32gb vram. Could be a pretty compelling choice.
- cptskippy 7mo agoThey certainly look viable as replacements for my Tesla P40 for virtual workloads.
- vessenes 7mo agoNot sure why you'd want this over an apple setup. M4 max is 545GB/s of memory bandwidth - $2k for an entire Mac Studio with 48GB of RAM vs 32 for the B70.
- hedgehog 7mo agoBeing able to keep infrastructure on Linux is a big advantage.
- RestartKernel 7mo agoHow many compatibility issues is MacOS realistically expected to spur? Windows DX felt unusable to me without a Linux VM (and later WSL), but on MacOS most tooling just kinda seems to work the same.
- einr 7mo agoIt’s not the tooling for me, macOS is just bad as a server OS for many reasons. Weird collisions with desktop security features, aggressive power saving that you have to fight against, root not being allowed to do root stuff, no sane package management, no OOB management, ultra slow OS updates, and generally but most importantly: the UNIX underbelly of macOS has clearly not been a priority for a long time and is rotting with weird inconsistent and undocumented behaviour all over the place.
- wolfhumble 7mo ago> Weird collisions with desktop security features Linux is not immune to BIOS/UEFI firmware attacks either. Secure Boot, TPM, and LUKS can work well together, but you still depend on proprietary firmware that you do not fully control. LogoFAIL is a good example of that risk, especially in an evil maid scenario involving temporary physical access. I think Apple has tighter control over this layer.
- functional_dev 7mo ago
- whalesalad 7mo agoAnyone running an ARC card for desktop Linux who can comment on the experience? I've had smooth sailing with AMD GPU's but have never tried Intel.
- wyre 7mo agoThere was the video a little while back where LTT built a computer for Linus Torvalds and they put an Intel Arc card inside, so I'd imagine Linux support is at the very least, acceptable. [1] https://www.youtube.com/watch?v=mfv0V1SxbNA https://www.youtube.com/watch?v=mfv0V1SxbNA
- toofy 7mo ago> they put an Intel Arc card inside just add a little bit: linus requested the card be intel as well.
- oakpond 7mo agoRunning dual Pro B60 on Debian stable mostly for AI coding. I was initially confused what packages were needed (backports kernel + ubuntu kobuk team ppa worksforme). After getting that right I'm now running vllm mostly without issues (though I don't run it 24/7). At first had major issues with model quality but the vllm xpu guys fixed it fast. Software capability not as good as nvidia yet (i.e. no fp8 kv cache support last I checked) but with this price difference I don't care. I can basically run a small fp8 local model with almost 100k token context and that's what I wanted.
- lostmsu 7mo ago> small fp8 local model with almost 100k token context Would not fit Qwen3.5 27B would it? That's the SOTA
- oakpond 7mo agoThis is a fp16 model. That's 54G in weights. I can load it only with fp8 quantization enabled (>= 128k context). I run into this error during generation though: https://github.com/vllm-project/vllm/issues/36350 https://github.com/vllm-project/vllm/issues/36350. Looks like an issue with the flash attention backend. But yeah, if you are OK with fp8 quantization on this model, it fits. I expect with 64G VRAM it will fit without quantization
- DiabloD3 7mo agoSince they fired the entire Arc team and a lot of the senior engineers already updated their Linkedins to reflect their new positions at AMD, Nvidia, and others, as well as laying off most of their Linux driver team (GPU and non-GPU), uh... WTF?
- wtallis 7mo agoThis is a chip they've had lying around for a while. It's the same architecture as used in the Arc B580 that launched at the end of 2024; this is just a slightly larger sibling. Intel clearly knew that their larger part wouldn't make for a competitive gaming GPU (hence the lack of a consumer counterpart to these cards), but must have decided that a relatively cheap workstation card with 32GB might be able to make some money.
- DiabloD3 7mo agoStill seems crooked to sell a GPU that is already lost their driver team and will get no new meaningful updates.
- wtallis 7mo agoDoes it need a huge driver team pushing out big updates in order to be suitable for the kind of Pro use cases it's targeted at? They're explicitly not going after the gaming market so they don't need to be on the treadmill of constant driver updates delivering workarounds and optimizations for the latest game releases. They're still going to be employing some developers for driver maintenance for the sake of their iGPUs, and that might be enough for these cards.
- throwaway85825 7mo agoNow if they launched the 32GB workstation card in 2024 with cheap RAM it would have been a success.
- staticman2 7mo agoYou are exaggerating, right? They didn't really fire the entire Arc team did they? I couldn't find a source saying that.
- deleted 7mo ago[deleted]
- tbyehl 7mo agoWhere's the A310 / A40 successor? Gimme some SR-IOV in a slot-powered, single-width, low-profile card.
- jmward01 7mo agoI think this shows a shift in model architecture. MOE and similar need more memory for the compute available than just one big model with a lot of layers and weights. I think this is likely a trend that will accelerate. You build the trade-off in which encourages even more experts which means more of a tradeoff, so more experts.....
- zozbot234 7mo agoMost people doing local inference run the MoE layers on CPU anyway, because decode is not compute constrained and wasting the high-bandwidth VRAM on unused weights is silly. It's better to use it for longer context. Recent architectures even offload the MoE experts to fast (PCIe x4 5.0 or similar performance) NVMe: it's slow but it opens up running even SOTA local MoE models on ordinary hardware.
- jmward01 7mo agoI think you are making my point. Having a little slower, but a lot more, memory on the card would speed this use-case up a lot and remove the need to go to system memory or make it available for very rarely used experts allowing for even larger MOE models running with good performance.
- zozbot234 7mo agoI think speeding up long context and opening up the use of models with larger shared layers is ultimately more relevant than hosting unused MoE layers. Of course you could do that as a last resort, i.e. when running with a smaller context that leaves some VRAM free to use.
- jmward01 7mo agoLong context will be solved and capped and turned into a theta 1 operation or, at worst, theta log(n). People don't have infinite perfect recall so agents don't need it. Also, there are really good solutions to it that just aren't explored enough right now since transformer architectures are where everyone is dumping money and time. I suspect very soon somone will have a much better system that just takes over and then the idea of context limits will be a thing of the past. I've actually built something myself that allows infinite context/perfect recall in theta 1 (minor asterisk here as there has to be but meh). I know others have solutions too.
- SkyeCA 7mo ago32GB of vram for a decent price? I wonder if these will work well for VR, because vram is my current main issue.
- aruametello 7mo ago(VR enthusiast here, mostly under windows) intel support has been mild to non existent in the VR space unfortunately. Given the very finicky latency + engine support i wouldn’t bet on a great experience, but hope for the best for more competition in this market. (even amd has a lot of caveats comparing to nvidia) Footnotes: * critical "as low as it can be" low latency support on intel XE is still not as mature as nvidia, amd was lagging behind until recently. * Not sure about "multiprojection" rendering support on intel, lack of support can kill vr performance or make it incompatible. (the optimized vr games often rely on it)
- HerbManic 7mo agoIt looked like when Intel jumped into this space, they tried to do everything at once. It didnt work well, they were playing catch up to some very mature systems. They are now being much more selective and restrained. The down side is that things like VR support are put on the back burner for years. Good for most people but if you need that fuctiobality and they dont have it, go somewhere else.
- mikelitoris 7mo agoToo little too late, classic Intel
- SmellTheGlove 7mo agoAny idea if it'll be possible to mix these with nvidia cards? Adding 32GB to a single 3090 setup would be pretty nice.
- kadoban 7mo agoThe last go around they looked good on paper and then Intel just didn't make any of them to sell. Announce all you want, if you don't ever ship anything I could buy, who gives a shit.
- cmxch 7mo agoThe B60 (and the dual edition) were an entire exercise in how NOT to launch a product. They let people have the B50 but only released the B60 late in the cycle.
- kadoban 7mo agoI wasn't even aware they ever _really_ released the B60. When I got bored of paying attention it was ~months after "release" and they just didn't exist to buy. I do technically see them on ebay, so yeah apparently they're out there.
- cmxch 7mo agoThe B60 was released but strictly on a B2B basis until a couple of months ago. The B60 dual, a much rarer bird, was scalped heavily enough to be unobtainable.
- cmxch 7mo agoGood to see that Intel learned to release product to more than just resellers. Now can we have a 64gb B70 that’s worldwide available and not marked to unicorns like the Maxsun B60 Dual model has been?
- lostmsu 7mo agoNothing like Crossfire/SLI? Not possible to efficiently connect multiple cards for one large model?
- thefounder 7mo agoWhy don’t they make an GPU optimised for inference/batch jobs with 1 TB of ram ? Everyone wants to run the biggest models locally.
- esperent 7mo agoI'm not sure it's really possible. Take a look at the die shot of a 5090: http://dieshot.com/wp-content/uploads/2025/03/Dieshot-GB202-24.10x31.60-Layout-%E6%8B%B7%E8%B4%9D-1172x1536.jpg http://dieshot.com/wp-content/uploads/2025/03/Dieshot-GB202-... It has 32gb of RAM and memory controllers are about 10% of the the total area. What would you have to do for 1024gb of RAM? Not to mention the price would be astronomical.
- thefounder 7mo agoHow is Apple packing 512gb of ram on their cpu?
- whaleofatw2022 6mo agoIIRC Apple is using the lower channel width options in LPDDR5. I.e. instead of 64 bit channels they do 16 (or maybe 32) bit. That lowers the die area needed on the chip for memory controllers. But it also impacts bandwidth, AFAIK an M4 ultra is still on the order of 1/4 the bandwidth of something like a 5090
- jeremie_strand 7mo ago[flagged]
- mmwelt 7mo agoAt the end of the 2nd paragraph: > Intel will provide certified drivers for Windows 11, Windows 10, and Linux. Windows 11, OK. Linux, OK. But why Windows 10 for a new product?!