4 ms·
This response is so dense with numbers and special characters that it's probably about 1000 tokens. So at 1 token/s, it takes almost 17 minutes to generate this
by pavlov 26d ago
This response is so dense with numbers and special characters that it's probably about 1000 tokens. So at 1 token/s, it takes almost 17 minutes to generate this on the MacBook Pro.
- bel8 26d agoAnd it probably takes longer for a human to compile all that info.
- springtimesun 26d agoBut, Kimi thought for 36k tokens before writing it.
- embedding-shape 26d agoAnd maybe author sent ~1K tokens as the starting prompt, and possibly some more stuff in the system prompt, and add on top of that that Apple hardware is famously bad at prompt processing.