3 ms·
If all you want is to be able to run it, but don't care about speed, you can run it on a Dell R720, they support hundreds of gigabytes of RAM. https://ollama.c
by thijson 2y ago
If all you want is to be able to run it, but don't care about speed, you can run it on a Dell R720, they support hundreds of gigabytes of RAM. https://ollama.com/ https://ollama.com/ makes it easy to download. They're pretty cheap compared to a Mac Studio. I got an R820 for a few hundred dollars, it has 256GB of RAM, with room for much more.
- freedomben 2y agoFurthermore you can get used versions of these pretty cheap on ebay. I bought some years back for experimenting with openshift in my homelab and was able to get some pretty insane hardware for $600 USD. Processors are slow, but it will run.