2 ms·
Oh, that's much better then. A good metric to share is the tokens per second per user for the node rather than the total throughput of the node. It disambiguate
by beffjezos 5mo ago
Oh, that's much better then. A good metric to share is the tokens per second per user for the node rather than the total throughput of the node. It disambiguates what's being optimized for much better than your blog post currently does.
- technoabsurdist 5mo agosounds good feedback taken, thanks beffjezos