10 ms·
A800 40GB Active Graphics Card
- jsheard 3y agoThis isn't new, it was announced a while ago. The A800 is a variant of the previous generation A100 chip which Nvidia cooked up specifically to sneak under the sanctions imposed on China, but with the US cracking down further they are now cutting their losses and selling them off in other markets.
- intpx 3y agoAnnounced awhile ago but available now.
- jsheard 3y agoTrue, and it's still in-stock if you happen to have £15,000 burning a hole in your pocket.
- brudgers 3y agoFor business at scale, a capital cost of 15,000 money units can be rounding error. And for some people -- though not me -- it is actually pocket money and less than a weekend in Vegas.
- vjjsejj 3y agor/iamveryrich leaking?
- karolist 3y ago"some people have more money than you", still, 15k USD is a lot, even without this perspective.
- brudgers 3y agoMy perspective is “It’s not for me.” And by extension “not for you.” Like Ferraris, houses in Pebble Beach, and many many other things. Modulo the fact that people will spend $15k customizing a Honda Civic.
- adastra22 3y agoI've got a fire-proof pocket you can put it in.
- verall 3y ago"sneak under" vs "comply with" If the US did not want NV to sell any GPU to any Chinese company, they could make that the law instead
- deleted 3y ago[deleted]
- jsheard 3y agoWell the US did follow up by also banning the exports of the A800/H800 models tailored to precisely comply with the earlier sanctions, so presumably the intent was to stop export of GA100/GH100 silicon altogether and they didn't anticipate Nvidia rules-lawyering the sanctions by reconfiguring it.
- photonbeam 3y agoThey absolutely anticipate that, its just about how well the people actually draft regs, or not
- declaredapple 3y ago> so presumably the intent was to stop export of GA100/GH100 silicon altogether They should have just written this in the regulations. Instead they're making nvidia waste resources making a product that complied with regulations.
- forgetfreeman 3y agoI mean fuck around and find out. Folks want to slide right up to the edge of legal definitions that's fine, but playing victim when the powers that be see you do it and nudge the line closer to the spirit of the original intent is laughable. It's not like the concept of legislation was invented two weeks ago and folks are shambling around trying to figure out what it all means.
- declaredapple 3y agoIt's just frustrating for me to see people write rules, and then say "hey not like that!". It wastes everyone's time, the point of regulations is to draw the line and have no ambiguous meaning. It's like putting up a speed limit sign that says "55mph" and then ticketing them for speeding going "53mph". If they want people to go 35mph, they should just made the limit 35mph!
- dheera 3y agoNVIDIA's new GPUs have horribly confusing names. Are higher numbers better or lower numbers better? A6000? A100? A800? And H > A > V > K, I think? And there's no T100 for Tesla and J100 for Jetson? But there's a Tesla V100 (Tesla Volta 100) and a Jetson Xavier which is neither Jetson nor Xavier architecture but Volta architecture? Can we please just have monotonically increasing product names in terms of compute capacity and stop jumping around the alphabet? I know they name architectures after scientists, that's cool, but at least they could do what Ubuntu does with release names and go in alphabetical order.
- riehwvfbk 3y agoIt's even worse than that. L > H > A, but that's for the data center cards. If you want the latest Ada Lovelace core in a workstation card, that's an RTX 4000 Ada Edition series (and it does not use the old Quadro naming). This is different from a Quadro RTX 4000 - that's two generations behind, a Turing. An RTX A4000 is one generation back, an Ampere. Oh, and gaming cards which may give you better performance for less are mashed into the same numbering scheme. An RTX 4070 is a gaming card, and it exist in vanilla, Super, Ti, and Ti Super flavors. And what makes a card "gaming" vs "workstation"? The first have a gaudier-looking heatsink and less memory. Makes sense, right?
- kristianp 3y agoSorry, I posted this because this(1) page highlights the "A800 active" as new. Perhaps the model with a fan is new? (1) https://www.nvidia.com/en-au/design-visualization/desktop-graphics/#nv-accordion-d53da78f87-item-bfbfb49f10 https://www.nvidia.com/en-au/design-visualization/desktop-gr...
- justinclift 3y ago(2023) As per: http://web.archive.org/web/20231103222724/https://www.nvidia.com/en-us/design-visualization/a800/ http://web.archive.org/web/20231103222724/https://www.nvidia...
- zingelshuher 3y agoFor those who want to run big models: AGX Orin 64GB is 'just' $2K. Not much processing power, but 64GB of shared memory is quite a lot for 2K.
- wmf 3y agoA slightly more expensive Mac Studio is probably a better buy than Orin at this point.
- ComputerGuru 3y agoCare to explain why? The Orin option seems massively more scalable and you can put in as beefy a machine as you want without paying the Apple tax which scales exponentially with machine specs.
- jjtheblunt 3y agoexponentially is some exponentially scaled hyperbole. that said, i agree with your question!
- FlyingAvatar 3y agoNot the OP, but I would suspect the Mac Studio will retain its value better than an application specific product.
- karolist 3y agoYou will be able to resell that 192G Mac Studio for 3-4k after a few years easily, which you've bought for 6k. There's nothing competing with Apple Silicon right now for local LLMs when you look at TCO.
- wmf 3y agoI don't understand anything you're saying. Orin is not scalable at all and (IMO) overpriced given its slow CPU and GPU and it's limited to 64GB of soldered RAM while Macs can go up to 192GB. AFAIK Orin is limited to a special build of Ubuntu and has no community.
- abdullahkhalids 3y agoHow large models can this run? Generally, is there a resource that has a table of how much VRAM each of the open source models require, especially at different quantization levels? I am pretty confused about these Mixture of Experts models like Mixtral 8x7B.
- eterevsky 3y agoIt looks like it's pretty expensive, but it's possible to buy A16 with 64G of memory for around $3k
- teleforce 3y agoThanks it looks like a Goldilocks GPU for personal HPC with 64GB memory to perform AI training. Not sure why this GPU is not on my radar before this.
- olliej 3y agoI recognize that these massive memory GPUs are for "AI" applications, but it really is amazing (exponential growth, I know, I know) when I think back to being at uni when I was super excited to get a Real(tm) High performance(r) GPU that had a truly massive 16Mb of ram :D (and a whopping 64Mb of system ram!)