2 ms·
You also need to leave space for other apps. If you run a 27B model on a 32GB machine you may find that you can't productively run other apps. I have 64GB and
by simonw 2y ago
You also need to leave space for other apps. If you run a 27B model on a 32GB machine you may find that you can't productively run other apps.
I have 64GB and I can only just fit a bunch of Firefox and VS Code windows at the same time as running a 27B model.