3 ms·Another data point: 17.6 tokens/s on an M4 Max 40 core GPUby andrewmunsell 2y agoAnother data point: 17.6 tokens/s on an M4 Max 40 core GPU