I got better performance of 20.18 tokens per second using tinyllama-1.1b-chat-v1.0.Q8_0.llamafile from https://huggingface.co/Bojun-Feng/TinyLlama-1.1B-Chat-v1.

I got better performance of 20.18 tokens per second using tinyllama-1.1b-chat-v1.0.Q8_0.llamafile from https://huggingface.co/Bojun-Feng/TinyLlama-1.1B-Chat-v1.0-llamafile/tree/main https://huggingface.co/Bojun-Feng/TinyLlama-1.1B-Chat-v1.0-l... If anyone is reading this and had trouble with a larger model, that might be the one to try next.