4 ms·
4060 Ti w/16 GB seems like a sweet spot for machine learning hobbyists. Only bummer from what I can see is the 128 bit bus.
by throwaway5959 3y ago
4060 Ti w/16 GB seems like a sweet spot for machine learning hobbyists. Only bummer from what I can see is the 128 bit bus.
- MuffinFlavored 3y ago> The $399 RTX 4060 Ti will ship on May 24th with just 8GB of VRAM, while a 16GB model is due in July priced at $499. Is that accurate?
- eddiewithzato 3y agoI don’t think that’s enough, cloud solutions are still cheaper and faster I believe
- cavisne 3y agoGaming class GPU's provide much better $/FLOPS (ie a 4090 is ~5x better value than a H100) https://timdettmers.com/2023/01/30/which-gpu-for-deep-learning/#GPU_Deep_Learning_Performance_per_Dollar https://timdettmers.com/2023/01/30/which-gpu-for-deep-learni... Nvidia forces corporations to buy datacenter GPU's for CUDA licensing reasons, and adds a significant margin on top.
- eddiewithzato 3y agothis is not a 4090 and even then your article mentions experiments are better on a cloud solution. Where they only recommend getting a top of the line GPU if you are doing longer than a year work
- throwaway5959 3y agoI unfortunately don’t have $2000 to spend on a GPU. Would be nice though.
- bee_rider 3y ago*60 TI always seems to be a nice mid-market pick.
- satiric 3y agoAMD's 6800XT should be a pretty good competitor to it; 500 bucks, 16GB vram, and a 256 bit bus. And the 6800XT is already available
- mhh__ 3y agoGood luck with the software
- paulryanrogers 3y agoWhy? Buggy drivers? No CUDA?
- throwaway5959 3y agoNo CUDA.
- dragonwriter 3y agoROCm is a thing, though (but not on Windows.)
- goosedragons 3y agoDon't forget about the Intel Arc A770. 16GB VRAM, 256bit bus for $350. Can use OneAPI for machine learning too.
- pseudo0 3y agoUnless a better option comes out in the next few months, I might pick one up. It seemed a bit pointless to upgrade to anything below 16 GB, and up until now that meant a 3090 or 4090. And the prices for those are pretty steep for hobbyist use.
- singularity2001 3y agoThe mac mini comes with 32GB
- throwaway5959 3y agoNowhere near the same computation for floating point.
- arvinsim 3y agoHow big of a factor is the 128 bit bus?