3 ms·Wow! 6 to 8 tokens per second. And less than a tenth of the cost of a GPU setup.by rahimnathwani 2y agoWow! 6 to 8 tokens per second. And less than a tenth of the cost of a GPU setup.