Yeah, you don't play with the weights in language models, you play with the residual stream by prompting (and occasionally by direct modification if you're bein

Yeah, you don't play with the weights in language models, you play with the residual stream by prompting (and occasionally by direct modification if you're being clever). But that does affect the model's generation! (obviously? otherwise there would be no need for a prompt in the first place, and all the recent residual stream modification research wouldn't work). But I think if we just banned the word "generator" we probably wouldn't disagree on much here. > Good luck with your effort! Thanks =)