3 ms·

Sorry but I don't follow your logic. Are you claiming that reward models that aren't curated by humans perform as well as ones that are? Then what is a reward

• JoshCole 1y ago
  In reinforcement learning and related fields, a _reward model_ is a function that assigns a scalar value (a reward) to a given state, representing how desirable it is. You're at liberty to have compound states: for an example, a trajectory (often called tau) or a state action pair (typically represented by s and a).
• vidarh 1y ago
  I'm claiming exactly what I wrote: That there is no inherent reason why a human curated one needs to be better.