4 ms·

ah yes, good idea. Link to one on amazon please?

• smoldesu 3y ago
  A link to a homeserver? You'd probably end up building it yourself, unless you want to pay a premium for a prebuilt. A good LLM build maximizes the amount of VRAM you're getting for AI workloads. Shop around for a 3090 24gb if that's within your price range, and then build backwards from there. Cheaper options include the 3060 12gb and the various other 16-20gb CUDA-enabled cards. Then find a motherboard that maxes out your card's PCI bandwidth and select a budget CPU that fits the socket and won't bottleneck your GPU. Add your memory, storage and install an OS. Then you're done.
  • andrewfromx 3y ago
    hehe there's gotta be an already bundled "desktop" i can buy?
    • smoldesu 3y ago
      If you want to be on the cutting edge (eg. HEDT, ECC, 14th gen/Zen 4 CPUs, etc.) then there aren't many integrators that will be able to bundle all the newest tech. If you're looking to maximize the performance-per-dollar and efficency for your usecase, self-built is really the only option. If you still insist on paying next-gen prices for last-gen hardware, Lenovo and Dell have you covered: https://www.lenovo.com/us/en/p/workstations/thinkstation-p-series/thinkstation-p620/wmd00000429 https://www.lenovo.com/us/en/p/workstations/thinkstation-p-s... https://www.dell.com/en-us/shop/scc/sr/workstations/precision-desktops/all-nvidia-graphics?appliedRefinements=39145 https://www.dell.com/en-us/shop/scc/sr/workstations/precisio...