5 ms·
I love finding hacky ways to save money on hardware, but unfortunately NVidia is just too good at the game and the 170HX was destined for the landfill at birth.
by gymbeaux 3y ago
I love finding hacky ways to save money on hardware, but unfortunately NVidia is just too good at the game and the 170HX was destined for the landfill at birth. God forbid a few of us enthusiasts get A100 performance for under a grand.
The next best thing is a 3090 or the like with a broken PCIe power connector or some other minor defect. My 3090 is simply missing the bit that holds the clip of the power connector in, however it’s a snug fit anyway and with the cables crammed into my case as they are, I don’t think it’s going anywhere. I paid $200 less than market for that 3090 as a result. Less than a gram of plastic. $200 off.
Meanwhile, as the article points out, AMD is nowhere near as hostile towards its customer base, and modified Radeon cards can apparently be had for $100 or so (from China). The caveat of course is no CUDA support, so it’s kind of moot.
- renewiltord 3y agoAMD is hostile in a much more meaningful way - APIs are junk, drivers are buggy, hardware doesn't work. Useless for AI. You will get nothing done. Save your money. Better to get working hardware for more than non-working hardware for less. (Tokens/s)/dollar is 0 on AMD. You will waste time.
- Havoc 3y ago> Tokens/s)/dollar is 0 on AMD. You do realise llama.cpp works on some and cards right?
- consp 3y agoMaybe also blame Nvidia for making a closed source API in your rant.
- mananaysiempre 3y agoThat’s not hostility, that’s just suckage. Suckage can be solved with time, if years of it on occasion. Hostility can only be solved by the customer base jumping ship.
- izacus 3y agoSomeone asking you to pay money for quality isn't hostility.
- mananaysiempre 3y agoBut them asking for as much money as (they think) you can bear because you’ve got nowhere else to go is. And on a market with a single real choice the difference between the two is of quantity, not of quality. I’d say Nvidia is leaning towards the hostility side these days, although my absolute revulsion for software locks may be colouring my perspective. To be clear, “hostility” is not the word I would’ve chosen, as it attributes emotions to entities that don’t really experience them. Perhaps it’s more useful to talk about whether the company cares if the customers feel exploited or not; and I don’t think Nvidia does (think this will hurt their sales).
- mccrory 3y agoI agree it isn’t hostility it is monopoly
- smoldesu 3y agoOnly if you consider software a commodity. Which... sorry to inject my personal opinion here, but it's not. Software is a finite intellectual product designed by motivated human laborers. The hardware can be a commodity, and the design can be a competitive advantage, but software layer is specifically what people consider "monopolized". Nvidia is not the only company designing GPGPU hardware, and they're not the only company capable of affording commodity silicon from TSMC. The only high-demand thing they entirely control seems to be CUDA, a software feature other companies are too lazy to reproduce. Maybe it's the rest of the market that's being anticompetitive?
- deleted 3y ago[deleted]
- cpp712 3y ago
- Zardoz84 3y ago> drivers are buggy so you don't use linux
- FeepingCreature 3y agoAnything that does not live in AMD's ecosystem manages to avoid suckage. The AMD linux drivers are fine because Linus would not let them get away with the sort of shit they have to be doing in their internal repos. As geohot memorably noted, "this will generate dead loop." If their commit messages are like that in Linux, what is their code like when nobody is looking? The ROCM drivers are shit. They somehow manage to get an enormous edifice of effort 99% working, then they bungle their package repository. Repeatedly. AMD have a tremendous ability to shoot themselves in the foot five feet from the end of the race, and the thing is, at this point you have to anticipate it. They have the capability to succeed, but not the temperament.
- 7speter 3y agoROCM drivers also puzzle me because it works on an exclusive selection of gpus instead of the whole lineup of a given architecture family. I keep reading about how theres ROCM support for the 7900xtx, and I guess theres no support for the 7600?
- JonChesterfield 3y agoYou on windows by any chance?
- nullifidian 3y agoThe situation has been changing rapidly since summer. According to my research, if you combine their desktop and cuda bugginess (for 7900 XTX) they are approaching the nvidia level of bugginess on linux, which is surprisingly quite high (much much higher than what it was say 5 years ago when nvidia just worked). One just needs a glimpse at their forum https://forums.developer.nvidia.com/c/gpu-graphics/145 https://forums.developer.nvidia.com/c/gpu-graphics/145 to gauge the situation. I just bought a 4090 and the desktop experience I get is much worse than what I had with the gpu embeded in the Ryzen 7950x: Wayland doesn't work, in Xorg there is tearing in mpv, alt-tab sometimes breaks in gnome. When I launch memory intensive cuda kernels the whole desktop becomes unresponsive. The drivers spews Xid errors in dmesg and breaks for certain applications, such as embergen.
- gymbeaux 3y agoI’ve stopped trying to use NVidia on Linux. I will usually have the display plugged into a Ryzen APU and have the NVidia GPU headless for compute stuff.
- nullifidian 3y agoThere are some positive movements though. For example the addition of explicit synchronization that the nvidia driver needs to function properly into DRI3 / Xwayland https://gitlab.freedesktop.org/xorg/xserver/-/merge_requests/967 https://gitlab.freedesktop.org/xorg/xserver/-/merge_requests... is active as of right now, and it seems that it will succeed. The corresponding mutter issue https://gitlab.gnome.org/GNOME/mutter/-/merge_requests/3300 https://gitlab.gnome.org/GNOME/mutter/-/merge_requests/3300
- gymbeaux 3y agoI will say my experience with Nvidia + Wayland has been better than most it seems. It may be because I typically use Fedora which sticks to pure GNOME while Ubuntu and Pop_OS bastardize GNOME. Still, my main complaint is that moving windows around and so on is not smooth. I forget what the term for it is… the window gets jagged and it’s like parts of it are moving at different speeds.
- OtomotO 3y agoMy last nvidia card was bought in 2007. Since then I am on AMD. I game, I build games, work on GPU related stuff. I refuse to buy Nvidia until they open source their drivers. I don't care about windows, I am on linux solely and there, from my experience, AMD is doing an excellent job
- nullifidian 3y agoAMD's drivers weren't open in 2007 either and for a number of years after that.
- sspiff 3y agoFirst open source amdgpu release was 2015, so 8 years later. You could probably reasonably stretch an Nvidia 8800 GTX (the absolute top card in 2007) to 2012 if you were thrifty with the settings and resolution. But by 2015 you couldn't run most games at all I would wager.
- OtomotO 3y agoI never said they were in 2007, I said I bought my last Nvidia card in 2007. In 2011 I was using R600, without any problems. Since then the situation improved steadily, especially when Steam got native support.
- omneity 3y agoThere is some CUDA support on AMD. I'm using it on a daily basis, it's much more production ready than you would expect. Do you use pytorch or something else?
- gymbeaux 3y agoHow do you have “some” CUDA support? I’m aware of the AMD HIP API that ports CUDA code to run on AMD GPUs, but that’s not CUDA at that point. Im also aware of the geohot (George Hotz) project for bringing native CUDA to AMD GPUs, but I think he abandoned it because AMD wasn’t throwing him any bones. Cupy on Python is mostly what I use.
- latchkey 3y agoThis is what they are referring to: https://github.com/ROCm-Developer-Tools/HIPIFY https://github.com/ROCm-Developer-Tools/HIPIFY
- capableweb 3y ago> but I think he abandoned it because AMD wasn’t throwing him any bones. I haven't heard about the "bringing native CUDA to AMD GPUs", sounds really interesting. I did come across a picture of Geohot with a ton of AMD GPUs though, wasn't that enough for him or what?
- gymbeaux 3y agoHN is where I heard about it! About 3 months ago I think. I think this is it: https://news.ycombinator.com/item?id=36189705 https://news.ycombinator.com/item?id=36189705
- omneity 3y agoPytorch can use the 'cuda' device on AMD GPUs, not talking about HIP. It works as a drop-in replacement if your ROCm API level matches your target CUDA level. (i.e matmul on fp16 won't be supported on old AMD GPUs for example)
- 7speter 3y agoCould a card like this work for something like object recognition? Those tiny google tpus that are supposed to be 25 dollars are 100 dollars now, and I’m wondering if the prices get low enough, would these be a viable alternative (along with an undervolt)?
- gymbeaux 3y agoRaspberry Pis and other “small things” like Project Coral are ridiculously overpriced. It’s ironic because whenever I see someone post on Reddit about their tiny rack of Raspberry Pis in their closet, people always ask in the comments what they’re using the cluster for, and the OP always says something along the lines of “just fucking around.” If I’m on a budget, my first choice is probably going to be an older, used Nvidia GPU. Maybe a 1050 or one of the older Quadros. The Quadros will get you the most VRAM per dollar, but the GPU will be rather weak, in the realm of a 1050 perhaps, while the 1050 will have better/longer driver support and be physically smaller, quieter, and use less energy. If those aren’t an option, I would take a closer look at ROCm and HIP. It seems like AMD is prioritizing support for newer GPUs like the Radeon VII, so a $50 RX480 is probably not a good investment, despite the low price.