4 ms·
I've been surprised that I haven't seen out of band signalling as a major suggestion. There a reason for that?
by taeric 4y ago
I've been surprised that I haven't seen out of band signalling as a major suggestion. There a reason for that?
- User23 4y agoHow exactly do you imagine that working?
- taeric 4y agoAnother thread finally made it click for me. I hadn't looked at the mechanics of why the current method is used. Which seems to be that a ton a synthetic training data is added that allows in band instructions. And this is precisely the catch, as there is no out of band stream to a language model. It is only completing a single channel of text/tokens. So, yeah, I think I get it, now.