3 ms·
If you can run any models on llama.cpp, that might be a good indicator of which StableLM models you'll be able to run. I easily ran 7B int 4 ggml models on an
by wsgeorge 3y ago
If you can run any models on llama.cpp, that might be a good indicator of which StableLM models you'll be able to run.
I easily ran 7B int 4 ggml models on an MBP with 16gig RAM. Same works on a MBA with 8 gig RAM, but you'll have to not run any other memory-hogging app.