4 ms·So how many generation T/s we can expect for a dense model? I assume we can go up to 120B using fp8?by eurekin 1y agoSo how many generation T/s we can expect for a dense model? I assume we can go up to 120B using fp8?