3 ms·
A maximum of 8GB vRAM in 2025 is quite limiting. You can only run the smallest large language models on those laptops.
by speedgoose 1y ago
A maximum of 8GB vRAM in 2025 is quite limiting. You can only run the smallest large language models on those laptops.
- SlowTao 1y agoMaybe this laptop is not for you then. That's cool. But if you don't need to run LLM's these will be fine.
- speedgoose 1y agoYes I guess some could also be fine with a privacy focused mechanical typewriter. When Apple and AMD sell very descent laptop hardware (M4 or Ryzen AI Max), I find the Intel/Nvidia combo with only 8GB a bit conservative.
- marssaxman 1y agoYour world must be so different from mine! It would never occur to me to care about such a thing. I was content with 8GB of main RAM in my dev laptop until about a year ago.
- exiguus 1y agoThe vRam for example limits you running local llms. Basically, the formula for this is: 1GB of vRAM can handle 1B parameters. There are ways to overcome this, but the easiest way for the best performance, is just to have enough vRAM.
- marssaxman 1y agoIf running local LLMs were a thing I ever wanted to do, I'm sure that would be something that mattered to me.