4 ms·
Open source models have an explicit endoftext token, yes. You can set llama.cpp to keep generating after that and it often instantly goes offtopic.
by astrange 3y ago
Open source models have an explicit endoftext token, yes.
You can set llama.cpp to keep generating after that and it often instantly goes offtopic.
- llm_trw 3y agoNot only off topic but out of sample. The old style LLM hallucinations where it starts spitting out random tokens like: nxrt$$.full #`,,, jump #43one daisy daisy give me your answer ###