3 ms·
I thought Mixtral required 34GB of RAM to run at that quantization? Yet RAM requirements aren't mentioned anywhere (in your links).
by tmikaeld 3y ago
I thought Mixtral required 34GB of RAM to run at that quantization?
Yet RAM requirements aren't mentioned anywhere (in your links).
- biscuitech 3y ago[dead]