2 ms·
On a M4 Max 128GB via LM Studio: query: "make me a snake game in python with pygame" (mlx 4 bit quant) mlx-community/gemma-3-27b-it-qat@4bit: 26.39 tok/sec •
by jonaustin 1y ago
On a M4 Max 128GB via LM Studio:
query: "make me a snake game in python with pygame"
(mlx 4 bit quant) mlx-community/gemma-3-27b-it-qat@4bit:
26.39 tok/sec • 1681 tokens 0.63s to first token
(gguf 4 bit quant) lmstudio-community/gemma-3-27b-it-qat:
22.72 tok/sec • 1866 tokens 0.49s to first token
using Unsloth's settings: https://docs.unsloth.ai/basics/tutorial-how-to-run-and-fine-tune-gemma-3 https://docs.unsloth.ai/basics/tutorial-how-to-run-and-fine-...
- yencabulator 1y agoI genuinely would have expected a $3,500+ setup to do better than just 10x pure-CPU on a AMD Ryzen 9 8945HS.
- jonaustin 1y agoFind another laptop that does that well.