3 ms·
LLM chat models are not autocomplete. They can recognize and respond to user text, which is not the same thing as completing it. If you prompted GPT-2 with a qu
by astrange 3y ago
LLM chat models are not autocomplete. They can recognize and respond to user text, which is not the same thing as completing it. If you prompted GPT-2 with a question you'd get another question, not an answer.
- IanCal 3y agoThey are autocomplete, they're just completing something in the form Assistant: ... User: ... Assistant: ... And the output is stopped when they start generating the equivalent of "User: " and the reins are handed back to you. This isn't a problem, autocomplete at the level of "what would a person say next" is outrageously powerful, but it is how they're working afaik.