4 ms·
Because GPU-Servers that can run a typical LLM are less than 5k, which includes installation. Really, running an LLM seems to be no more complicated than runnin
by awesomeMilou 3y ago
Because GPU-Servers that can run a typical LLM are less than 5k, which includes installation. Really, running an LLM seems to be no more complicated than running a NAS from a system administrators perspective.
Emphasis on running, not training.
- MichaelZuo 3y ago5k can't even get you 80 GB of VRAM on a GPU. How is that possible?