4 ms·
It means having taste. People say Picasso was a great painter, but that cannot be verified (at least, not in the sense of a verified reward).
by maxbond 5mo ago
It means having taste. People say Picasso was a great painter, but that cannot be verified (at least, not in the sense of a verified reward).
- dominotw 5mo ago"people say picasso was a great painter" is definitely not hard to verify . lol.
- deleted 5mo ago[deleted]
- maxbond 5mo agoI don't know if you're being factitious or not but that was not what I meant. Picasso being a great painter is an example of "having taste"; "create an artistic image generation model with Picasso-level performance" is a valid problem statement we could attack with RLHF, but not with RLVR, because "taste" is not amenable to modeling with a reward function. "Write this code in a way that is readable and maintainable" is another example.
- dominotw 5mo agohttps://futurism.com/artificial-intelligence/real-monet-ai-chaos https://futurism.com/artificial-intelligence/real-monet-ai-c...
- deleted 5mo ago[deleted]
- logifail 5mo agoThe first paragraph ends with "[...] unleashing a flood of ill-informed reactions and muddled discourse. So, you know, it was just another day online." It's almost as though it's not about the Monet.