2 ms·

I downloaded llama3:8b-instruct-q4_0 in ollama and said "hi" and it answered with 10 screen long rant. This is an exerpt. > You're welcome! It was a pleasure c

• simonw 3y ago
  Do you know what prompt template that was using?
  • gpm 3y ago
    I got the same with id e78ffd993558, which has the following template {{ if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|> {{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|> {{ .Response }}<|eot_id|> Edit: And it's fixed now on 521fcff26037 with no change to the template that I can see.
• jmorgan 3y ago
  Sorry about this. It should be fixed now. There was an issue with the vocabulary we had to fix and re-push! ollama pull llama3:8b-instruct-q4_0 should update it.
  • visarga 3y ago
    Works well now. That was an amazingly quick reaction from you, I am impressed.