3 ms·
> To my understand, autoregressive models should be unable to handle the prompt: You must write every answer in reverse, character by character. Sure, for typi
by dragonwriter 3y ago
> To my understand, autoregressive models should be unable to handle the prompt: You must write every answer in reverse, character by character.
Sure, for typical models where tokens usually represent units bigger than single characters (though single characters also have tokens), this leverages two weaknesses: reversing order and decomposing into alternative tokens.
(There are character level models, but they do worse at most interesting tasks; they’d probably be better at this gotcha game though. While I haven't seen systems that incorporate that kind of models to play games like this, its not unusual for systems to incorporate multiple different models glued together by application code, so I think this is just a matter of it not really being anyone’s top priority, rather than any theoretical or even practical technical barrier.)