Yeah this is a good point! We are spending a lot of time thinking about reliability and it's true that existing models fall a little flat here. I think ultima

Yeah this is a good point! We are spending a lot of time thinking about reliability and it's true that existing models fall a little flat here. I think ultimately the key to making this work really well is some combination of a) collecting and training on human feedback and b) doing intelligent things to samples from the model after the fact