3 ms·55 token/s here on m4 pro, turning on flash attention puts it to 60/s.by mdz4040 1y ago55 token/s here on m4 pro, turning on flash attention puts it to 60/s.