4 ms·
192gb or 256gb of RAM would be enough ! We could run real time large MoE models, REAPed for our usage (e.g. english agentic coding), dynamic quant 2-4bits
by ttoinou 4mo ago
192gb or 256gb of RAM would be enough ! We could run real time large MoE models, REAPed for our usage (e.g. english agentic coding), dynamic quant 2-4bits