4 ms·
> Now to control this you want a capability to precisely define the allowed and dis allowed behaviour. I don't think regular software controls are flexible eno
by visarga 2y ago
> Now to control this you want a capability to precisely define the allowed and dis allowed behaviour.
I don't think regular software controls are flexible enough but there is research in making AI create its own "RLHF" fine-tuning dataset, like Constitutional AI from Anthropic. You only need to give it a few general guidelines and let it figure out the details. Never heard anyone complain Claude is unsafe or a bad chat experience.