RTX 4080 Llama-2-77b-chat-hf-q4f32_1 210.6742 tokens/sec, decoding: 20.7758 tokens/sec Can't tell if its really taking advantage of the all the power of the c

RTX 4080 Llama-2-77b-chat-hf-q4f32_1 210.6742 tokens/sec, decoding: 20.7758 tokens/sec Can't tell if its really taking advantage of the all the power of the card, though.