2 ms·At this speed this is only suitable for time insensitive applications..by misternintendo 1y agoAt this speed this is only suitable for time insensitive applications..daveed 1y agoI mean it's a raspberry pi...layer8 1y agoI’d argue that chat is a time-sensitive application, and 13 tokens/s is significantly faster than I can read.