3 ms·
> People can read at a rate around 10 token/sec. It really depends on the type of content you're generating: 10tk/s feels very slow for code but ok-ish for tex
by littlestymaar 1y ago
> People can read at a rate around 10 token/sec.
It really depends on the type of content you're generating: 10tk/s feels very slow for code but ok-ish for text.