3 ms·
Plenty - you could do both with an R9700. Unless it's CUDA only, a fair amount of software now supports AMD ROCm. And if you're already wanting to write an in
by rdx-amw 2mo ago
Plenty - you could do both with an R9700.
Unless it's CUDA only, a fair amount of software now supports AMD ROCm. And if you're already wanting to write an inference engine, 32G will be more than fine.
I've had a R9700 and it'd run the lower quants (4-5 bit?) of Qwen 3.5 27B reasonably attached to Hermes Agent. Not quite a 3090, but still respectable speeds.
- FloatArtifact 2mo agoYou say that as it's in the past, have you moved on to something else?
- rdx-amw 2mo agoNo, the R9700 I have got fried by a power supply fault, and GPU replacements are not always trivial. Of the two affordable options for good 32G compute, the R9700 would be the best of the two (compared to the Arc Pro B70).
- scott01 2mo agoInteresting, how did the fault happen for you? Was the PSU underpowered? I have a 850W unit, so you think it’ll be enough?
- rdx-amw 2mo agoAccidental - miswired PCIe power such that it went back into a SATA/molex modular port. Somehow managed to not break anything else though, but an experience not to repeat.
- jake_and_fatman 2mo ago[dead]