3 ms·I get about the same speed (35 tok/s) out of 13B Llama2 on a 4070 Ti, FWIW.by kilnr 3y agoI get about the same speed (35 tok/s) out of 13B Llama2 on a 4070 Ti, FWIW.