2 ms·
I'd like to meet the person who's been using a 1 token/second system as their primary LLM for at least a few weeks. Anyone? I think 1 token/second is optimisti
by dns_snek 5mo ago
I'd like to meet the person who's been using a 1 token/second system as their primary LLM for at least a few weeks. Anyone?
I think 1 token/second is optimistic here - and even then it's over 11 days per million tokens.