3 ms·
You could definitely run an 8B model on that, and some of those are getting very capable now. The problem is that often you can't run anything else. I've had t
by simonw 2y ago
You could definitely run an 8B model on that, and some of those are getting very capable now.
The problem is that often you can't run anything else. I've had trouble running larger models in 64GB when I've had a bunch of Firefox and VS Code tabs open at the same time.
- xdavidliu 2y agoI thought VSCode was supposed to be lightweight, though I suppose with extensions it can add up