3 ms·
For me it generated a random title like "Translate to French", "Summarize in 4 words" or "Rewrite in short time." for the chat.
by nvalis 3y ago
For me it generated a random title like "Translate to French", "Summarize in 4 words" or "Rewrite in short time." for the chat.
- matthewdgreen 3y agoThey seem to have partially fixed it. In the past it would produce a special token "<|endoftext|>" and then immediately after that the LLM would ramble on about a completely random topic, which was either a hallucination or possibly leaking the answer to someone else's query (which would be much more interesting!) Now it looks like they've added a band-aid to suppress text output, but the chat titles indicate that some kind of text processing is still taking place in the background.