3 ms·
It’s already available. I had it running yesterday morning in an M3 MAX 128GB. I get about 6tps. https://www.reddit.com/r/LocalLLaMA/s/MSsrqWHYga https://www.r
by Art9681 3y ago
It’s already available. I had it running yesterday morning in an M3 MAX 128GB. I get about 6tps.
https://www.reddit.com/r/LocalLLaMA/s/MSsrqWHYga https://www.reddit.com/r/LocalLLaMA/s/MSsrqWHYga