Maybe I can do one better... For the 'create_chat_completion' on this line: https://github.com/simonw/llm-smollm2/blob/afed0963b3a8bcca17c83f451a161eb2edbc59fe

Maybe I can do one better... For the 'create_chat_completion' on this line: https://github.com/simonw/llm-smollm2/blob/afed0963b3a8bcca17c83f451a161eb2edbc59fe/llm_smollm2/__init__.py#L63 https://github.com/simonw/llm-smollm2/blob/afed0963b3a8bcca1... I changed it to: completion = model.create_chat_completion( messages=messages, temperature=0.2, top_p=0.9, presence_penalty=0.06, frequency_penalty=0.5, repeat_penalty=1.0, ) I took as many parameters as I could from their documentation: https://github.com/huggingface/smollm/tree/main/text#transformers https://github.com/huggingface/smollm/tree/main/text#transfo... And then added some to reduce repeating. I then used the prompt "Write a 10 line poem on computers." (note the fullstop), to get: In the realm of computation, where magic and science intertwine, The art of programming and the art of computing. Computers are machines that can think, they are computers. They can do what humans cannot – to create. Computers are machines that can think, they are computers. Computers are machines that think, they are computers. Computers are machines that think, they are computers. Computers are machines that think, they are computers. Computers are machines that think, they are computers. Computers are machines that think, they are computers. Computers are machines that think, they are computers. Computers can think, they can think. Computers can be thought of as a machine that thinks. Computers can be thought of as a machine that thinks. Still not perfect, but the parameters seem to make a massive difference. I think it's entirely possible to get something reasonable out of this model.