3 ms·
Nice, that's definitely a sweet deal
by Zambyte 3y ago
Nice, that's definitely a sweet deal
- XCSme 3y agoThanks, I chose a 3090 instead of 4070ti, it was around $200 cheaper and has 24GB vs 16GB VRAM and a similar performance. The only drawback is the 350W TDP. I still struggle with the RAM issue on Ollama, where it uses 128GB/128GB RAM for Mixtral 24.6GB, even though Docker limit is set to 90GB. Docker seems pretty buggy on Windows...