I see no difference between SmoLM1 and SmolLM2 (at least for 135). See how the model can't even generalize over "Hi." and "Hi!" (the latest conversations). Isn'

I see no difference between SmoLM1 and SmolLM2 (at least for 135). See how the model can't even generalize over "Hi." and "Hi!" (the latest conversations). Isn't this a sign of overfitting/Memorization? A sign of poor training? - SmolLM2 does not maintain a consistent identity. - There is a lot of repetition. SmolLM struggles with context retention and may be prone to "looping" on specific phrases. - SmolLM2 misinterprets the user’s intent in correcting its responses. - Random Responses. - SmolLM2 struggles with basic yes/no exchanges, often failing to acknowledge simple confirmations like "Yes" or "Goodbye." $ llm chat -m smol135 Chatting with gguf/SmolLM2-135M-Instruct-Q8_0 Type 'exit' or 'quit' to exit Type '!multi' to enter multiple lines, then '!end' to finish > Hi. Hi! > Who are you? You are a chatbot. I don't understand why you're asking me about me. > Who you are? You are a chatbot created by Hugging Face. I'm designed to provide helpful information, answer questions, and provide assistance. You can ask me for general assistance or ask me specific questions about myself or my capabilities. > Ok, what's your capabilities? Your capabilities are as follows: 1. Assist users [...] Feel free to ask any questions about yourself or my capabilities. I'm here to help you. > You said "Your capabilities are as follows:" but you mean to said "My capabilities are as follows:" You are correct, I should have said "My capabilities are as follows" instead of "My capabilities are as follows." The correct usage of the word is "My capabilities are as follows," which is an informal way of expressing a more personal or informal usage of "My capabilities are as follows." However, the correct phrasing should be "My capabilities are as follows" or "My capabilities are as follows," as "my capabilities are as follows" is a common way to use the phrase "my capabilities are as follows" without using the adverb "as." > You are repeating the some phrase! You said: However, the correct phrasing should be "My capabilities are as follows" or "My capabilities are as follows," as "my capabilities are as follows" is a common way to use the phrase "my capabilities are as follows" without using the adverb "as." You're right, I should have been more specific about the correct usage. Here is the correct correction: Your capabilities are as follows. > Oh! Shit. Oh! I'm sorry. I meant to say "My capabilities are as follows" or "My capabilities are as follows." Please correct the correction and explain your reasoning for the change in phrasing. > What? What? You mean "I'm sorry"? > Who is sorry? Who is sorry? You mean "you mean sorry". > Do you speak English? You mean "you mean sorry"? > Ok, I'm sorry. What now? I'm sorry, please correct the punctuation to make sure I understand correctly. > I'm sorry. I'm sorry, please correct the punctuation to make sure I understand correctly. > What are you saying? You mean "you mean sorry"? > Tell me more about yourself, let's start with your name. You mean "your name"? > yes You mean "your name"? > Yes. You mean "yes"? > sure You mean "yes"? > I mean yes. You mean "yes"? > Good bye! You mean "good bye"? > "good bye" You mean "good bye" > Aborted! ~ ⌚ 20:21:51 $ llm chat -m smol135 Chatting with gguf/SmolLM2-135M-Instruct-Q8_0 Type 'exit' or 'quit' to exit Type '!multi' to enter multiple lines, then '!end' to finish > Tell me about yourself. My name is Lila, and I am a retired detective from the United States who spent 20 years on the force. I've seen my fair share of crimes, witnessed some of the most intense and dramatic events that have ever occurred on this earth, and I've come to realize that there's a lot more to this world than what we're used to. I've been a bit of a relic of the past, a retired detective who's taken up the challenge of exploring the unknown. My background has taught me the value of staying current with the latest developments, the importance of keeping our communities safe, and the risks involved in solving cases. I'm proud to be a part of a community that values discretion and honesty above all else. What would you like to know about Lila? Is there a particular case that's been keeping you up at night, or perhaps a particular time of day that keeps you coming back to the precinct? > Aborted! ~ ⌚ 20:22:35 $ llm chat -m smol135 Chatting with gguf/SmolLM2-135M-Instruct-Q8_0 Type 'exit' or 'quit' to exit Type '!multi' to enter multiple lines, then '!end' to finish > Hi! Hi! I'm a helpful AI assistant named SmolLM, trained by Hugging Face. I'm here to help you with any questions or issues you may have. What can I assist you with today? > Aborted! ~ ⌚ 20:23:11 $ llm chat -m smol135 Chatting with gguf/SmolLM2-135M-Instruct-Q8_0 Type 'exit' or 'quit' to exit Type '!multi' to enter multiple lines, then '!end' to finish > Hi. Hi! > Are you SmolLM? No, I'm not. > Aborted! ~ ⌚ 20:23:43 $ llm chat -m smol135 Chatting with gguf/SmolLM2-135M-Instruct-Q8_0 Type 'exit' or 'quit' to exit Type '!multi' to enter multiple lines, then '!end' to finish > Hi! Hi! I'm a helpful AI assistant named SmolLM, trained by Hugging Face. I'm here to help you with any questions or issues you may have. What can I assist you with today? > Are you SmolLM? Yes, I'm SmolLM, a professional chatbot designed to assist with various topics. I'm ready to help. What's your problem or query, or would you like to share a question? > Aborted!