The title could be made much clearer by saying "X" tokens per second, with "Y" model,on "Z" hardware, and what the model load time was. The quantisation level a

The title could be made much clearer by saying "X" tokens per second, with "Y" model,on "Z" hardware, and what the model load time was. The quantisation level and byte size helps too.