2 ms·The weights are int4, so you'd only need 8xH100by wongarsu 9mo agoThe weights are int4, so you'd only need 8xH100