4 ms·On my M1 Ultra LlaMA 65B generates ~3 tokens per second (using 16 threads).by magoghm 4y agoOn my M1 Ultra LlaMA 65B generates ~3 tokens per second (using 16 threads).