Hey HN, We are working to apply the ideas of R1 to computer use. The primary struggle is creating reliable neural reward models since hard-verification rewards

Hey HN, We are working to apply the ideas of R1 to computer use. The primary struggle is creating reliable neural reward models since hard-verification rewards are not available at scale in GUI interactions. Our team is currently deep in the weeds of collecting reasoning annotation data for GUI interfaces to train a reliable reward model. We would love all thoughts, feedback, and collaborations!