3 ms·
What is the recommended hardware to run a model like that locally on a desktop PC?
by kleiba 2y ago
What is the recommended hardware to run a model like that locally on a desktop PC?
- tadasv 2y agoyou can easily run 8b yi coder on 4090 rtx. Probably could do on a smaller gpu (16GB). I have 24gb, and run it through ollama.