When you're running inference, it's super important to make sure that you're using the right prompt format (if you're using the Oobabooga web text ui, make sure

When you're running inference, it's super important to make sure that you're using the right prompt format (if you're using the Oobabooga web text ui, make sure you have 'chat', 'chat-instruct', or 'instruct' properly selected). The model card on Huggingface will usually tell you.