3 ms·Does it run in 8x80G? Or does the KV cache and other buffers push it over the edge?by azinman2 1y agoDoes it run in 8x80G? Or does the KV cache and other buffers push it over the edge?