5 ms·
Huh, Hacker News ? It's pretty easy to measure token/s in streaming response ? I'm missing something ?
by throwaway888abc 3y ago
Huh, Hacker News ? It's pretty easy to measure token/s in streaming response ? I'm missing something ?
loading thread…