4 ms·
Yeah, GPT3.5, in a phone, at ~1,000 tokens/sec ... nice!
by moralestapia 3y ago
Yeah, GPT3.5, in a phone, at ~1,000 tokens/sec ... nice!
- mlyle 3y ago> at ~1,000 tokens/sec 12 tokens per second.
- moralestapia 3y agoWhoops, made the same mistake as @ignoramous :P