3 ms·
I don't know much, but this isn't surprising based on the little I know. Transformers predict the next token. If your question is at the end of the prompt, th
by stoniejohnson 3y ago
I don't know much, but this isn't surprising based on the little I know.
Transformers predict the next token.
If your question is at the end of the prompt, the start of an answer is a more likely next token than if the question is at the beginning of the prompt followed by a ton of other relevant, but non-question-forming tokens.
Still, if you had to put the question at the beginning of your prompt, a transformer is more likely to give an answer than an RNN.
- jumpCastle 3y agoIt is fine tuned to maximize reward though, not likelihood. And it provides an answer in both cases, just not as well.
- stoniejohnson 3y agoSo since a model is fine tuned via RLHF my point doesn't stand? Genuine question; it would be interesting if some other mechanism was at play here.
- jumpCastle 3y agoFor an answer I would expect it to get the same reward for both question orderings. So naively I would expect it to not be affected by the ordering.