3 ms·
Your world must be so different from mine! It would never occur to me to care about such a thing. I was content with 8GB of main RAM in my dev laptop until abo
by marssaxman 1y ago
Your world must be so different from mine! It would never occur to me to care about such a thing.
I was content with 8GB of main RAM in my dev laptop until about a year ago.
- exiguus 1y agoThe vRam for example limits you running local llms. Basically, the formula for this is: 1GB of vRAM can handle 1B parameters. There are ways to overcome this, but the easiest way for the best performance, is just to have enough vRAM.
- marssaxman 1y agoIf running local LLMs were a thing I ever wanted to do, I'm sure that would be something that mattered to me.