5 ms·
Oh :( Maybe the settings? Could you try temperature = 1.0, top_k = 64, top_p = 0.95, min_p = 0.0
by danielhanchen 1y ago
Oh :( Maybe the settings? Could you try
temperature = 1.0, top_k = 64, top_p = 0.95, min_p = 0.0
- canyon289 1y agoDaniel, thanks for being here providing technical support as well. Cannot express enough how much we appreciate your all work and partnership.
- danielhanchen 1y agoThank you and fantastic work with Gemma models!
- simonw 1y agoMy topping only lets me set temperature and top_p but setting them to those values did seem to avoid the infinite loops, thanks.
- danielhanchen 1y agoOh fantastic it worked! I was actually trying to see if we can auto set these within LM Studio (Ollama for eg has params, template) - not sure if you know how that can be done? :)