3 ms·
What is the accuracy of the resulting model? Over what range of inputs?
by lukasb 4y ago
What is the accuracy of the resulting model? Over what range of inputs?
- famouswaffles 4y agohttps://crfm.stanford.edu/helm/latest/?group=core_scenarios https://crfm.stanford.edu/helm/latest/?group=core_scenarios Anthropic-LM v4-s3 (52B) is the model in question. rlaif doesn't seem to be any less effective given the size of the model.
- lukasb 4y agoSo base model+RLLLMF performs as well as base model+RLHF. That could mean a lot of things - it could mean the base model puts a ceiling on the total possible accuracy, so having human-level performance at the RL step doesn't matter as much. And looking at the scores on the individual tests that make up the composite accuracy metric, that looks probable.