2 ms·
My daily struggle is trying to make a 7B model respond in under 500ms without breaking the bank. This hits home.
by clem_rw 1mo ago
My daily struggle is trying to make a 7B model respond in under 500ms without breaking the bank. This hits home.