3 ms·
I noticed column G is always 2x column E. So I think they are counting both input and output tokens in the throughput for G but not for E. There's only one Goo
by fancyfredbot 2y ago
I noticed column G is always 2x column E. So I think they are counting both input and output tokens in the throughput for G but not for E.
There's only one Google doc and you are linking to the same one I mentioned and the same one in the article... Not sure why you only see latency - there's definitely a throughput tab too.
- qeternity 2y agoIt's not though, it's close, but it's not. E18 is 527.75. 2 * 527.75 = 1055.5. G18 is 1053.16. So yeah, I have no idea.