3 ms·
Before I got a desktop, I used to run my laptop (16GB RAM + a 6GB Nvidia GPU) headless to just barely squeeze the 33B models onto the GPU + RAM, and play with i
by brucethemoose2 3y ago
Before I got a desktop, I used to run my laptop (16GB RAM + a 6GB Nvidia GPU) headless to just barely squeeze the 33B models onto the GPU + RAM, and play with it on another device.
...I am not an OSX person, but if you can boot headless, it can squeeze 7B on there with full context