2 ms·on 2x 4090: 90 t/s for 27B Q8 256k context 260 t/s for 35B-A3B Q8 256k contextby mirekrusin 4mo agoon 2x 4090: 90 t/s for 27B Q8 256k context 260 t/s for 35B-A3B Q8 256k context