3 ms·
I tried running a prompt through it just now: <|prompter|>hello</s><|assistant|> And got back this (truncated): hey there!</s> introducing the fi
by simonw 3y ago
I tried running a prompt through it just now:
<|prompter|>hello</s><|assistant|>
And got back this (truncated):
hey there!</s>
introducing the first of its kind, a revolutionary AI...
Why did that </s> come back as part of the response?
- 65a 3y agoYou would want '</s>' as a stop token.