3 ms·
> long running I really dislike this as a measure. A LLM on CPU is also long running cause it’s slow. I get what it’s meant to convey but time is such a terri
by Havoc 10mo ago
> long running
I really dislike this as a measure. A LLM on CPU is also long running cause it’s slow.
I get what it’s meant to convey but time is such a terrible measure of anything if tk/s isn’t static