11 ms·
M4 max 128gb ram. LM studio MLX with full 128k context. It works well but has a long 1 minute initial prompt processing time. I wouldn’t buy a laptop for thi
by zackify 1y ago
M4 max 128gb ram.
LM studio MLX with full 128k context.
It works well but has a long 1 minute initial prompt processing time.
I wouldn’t buy a laptop for this, I would wait for the new AMD 32gb gpu coming out.
If you want a laptop I even consider my m4 max too slow to use more than just here or there.
It melts if you run this and battery goes down asap. Have to use it docked for full speed really
- pram 1y agoYep I have an M4 Max Studio with 128GB of RAM, even the Q8 GGUF fits in memory with 131k context. Memory pressure at 45% lol
- discordance 1y agoHow many tokens per second are you both getting?
- bicepjai 1y agoDo you also have tokens per second metric ?