By "score", do you mean manually reviewing and rating the outputs from the evaluation set every time the model changes? Because it's hard to imagine an automate

By "score", do you mean manually reviewing and rating the outputs from the evaluation set every time the model changes? Because it's hard to imagine an automated evaluation system that would be sophisticated enough to tell whether the outputs were getting better or worse -- unless, again, it was as smart as GPT-3.