3 ms·
> my server is a qnap tvs-473e with an embedded amd cpu/gpu That's your problem. I googled and it looks like one of these all-in-one appliances like a drobo o
by loxias 3y ago
> my server is a qnap tvs-473e with an embedded amd cpu/gpu
That's your problem. I googled and it looks like one of these all-in-one appliances like a drobo or whatever's popular these days. That's not a server. (At least, I wouldn't call it a server. It's an all-in-one appliance, or toy, depending on perspective) And yegods, that price...
Spend $500, get an actual computer, not some priced up appliance, and you'll have a much better time. Regardless of if you spend it on more CPU or more GPU. You can get a used computer off ebay for $100 and shove a $400 graphics card in it. Or maybe get a ryzen 7 7700x, I'm looking at a mobo+cpu combo with that for $500 right now.
Finally, to make sure this response does contain a answer to what you asked: ;-)
if you can run this stuff in a container on your appliance already, but it's very slow, congrats! I'd call that a win. I looked up the chip, the RX-421BD, it's of similar power as an Athelon circa 2017. I think my router might have more compute power. You _do_ have those 512 shader cores, given effort, you could try and get them to do something useful. But I wouldn't assume it's possible (well, maybe you don't mind writing your own shaders ;-)). Just because the chip has "some gpu" doesn't mean it has "the right kind of gpu you'd need to hijack for lots of matrix multiplies, without writing the assembly yourself".
Sorry this isn't more helpful, but it's the truth.
- KeplerBoy 3y agoSomething to add: if your NAS-Server is advertised with it's dual 4K capable HDMI ports, you know you're looking at a consumer toy targeted at people who hoard (pirated) media and not for serious stuff.
- loxias 3y agoHah! I hadn't even noticed that, I just saw "I could build that for 1/4th the cost"+"wtf, only 4 drives?" Stuff like this prompts a dual response in me. :) It always gives me a strong urge to educate "it's not that hard, and it's fun" to build it yourself. AND it always makes me kick myself for not commercializing the expandable media servers I started building in the early 2000s, for me, for the dorm, for my friends, i.e. exactly the people you identify. :)
- Jimbabwe 3y agoMeh I bought this 5 years ago because there was a sale on 10tb hard drives and I thought “Why shouldn’t I become a data hoarder?” And now it runs homeassistant and frigate and MeTube and jellyfin and if it doesn’t work for ollama then I’ll probably just deal with it, lol.
- loxias 3y agoFair enough, fair enough. Also I'm a data hoarder too, have been since pre-reddit. internet high five. :) I've gotten a lot of mileage (at least 15 years) off of centralizing all my storage, and centralizing all my compute, but _not_ having them be the same box. YMMV, of course. Unrelated, cool, I hadn't heard of any of those 4 programs, I'm googling now and some look useful. Thanks! Possibly saving me some time in my next project...