5 ms·
Great theory, this makes a lot of sense. It looks like they already RLHF'ed (I keep using this as a verb, but maybe its really just instruction tuning?) this be
by arthurcolle 3y ago
Great theory, this makes a lot of sense. It looks like they already RLHF'ed (I keep using this as a verb, but maybe its really just instruction tuning?) this behavior out of ChatGPT! https://news.ycombinator.com/item?id=38677025 https://news.ycombinator.com/item?id=38677025 Really fast, I wonder how this works. Anyone have any ideas / knowledge on how they deploy little incremental fixes to exploited jailbreaks, etc?)
- azeirah 3y agoNot sure about this scenario precisely but I believe when it comes to filtering certain responses they have a separate model running in a similar manner to what meta recently released. I believe it's called llama purple? https://ai.meta.com/llama/purple-llama/ https://ai.meta.com/llama/purple-llama/
- krisoft 3y ago> Anyone have any ideas / knowledge on how they deploy little incremental fixes to exploited jailbreaks, etc? LoRa[1] would be my guess. For detailed explanation I recommend the paper. But the short explanation is that it is a trick which lets you train a smaller, lower dimensional model which when you add to the original model it gets you the result you want. 1: https://arxiv.org/abs/2106.09685 https://arxiv.org/abs/2106.09685
- arthurcolle 3y agois this another expert? can they hot swap in experts and remove others?