4 ms·
The title is biased, blaming Google for mistreating people and implying that Google's AI isn't smart, but the OP is worth reading, because it gives readers a se
by cs702 1y ago
The title is biased, blaming Google for mistreating people and implying that Google's AI isn't smart, but the OP is worth reading, because it gives readers a sense of the labor and cost involved in providing AI models with human feedback, the HF in RLHF, to ensure they behave in ways acceptable to human beings, more aligned with human expectations, values, and preferences.
- lm28469 1y ago> to ensure the AI models are more aligned with human values and preferences. And which are these universal human values and preferences ? Or are we talking about silicon valley's executives values ?
- alehlopeh 1y agoWell, it doesn’t say universal so it’s clearly going to be a specific set of human values and preferences. It’s obviously referring to the preferences of the humans who are footing the bill and who stand to profit from it. The extent to which those values happen to align with those of the eventual consumer of this product could potentially determine whether the aforementioned profits ever materialize.
- giveita 1y ago> Sawyer is one among the thousands of AI workers contracted for Google through Japanese conglomerate Hitachi’s GlobalLogic to rate and moderate the output of Google’s AI products... Depends how you look at it. I think a brand like Google should vet a mere one level down the supply chain.
- FirmwareBurner 1y agoI had no idea Hitachi was also running software sweatshops.
- rs186 1y ago> to ensure the AI models are more aligned with human values and preferences. to ensure the AI models are more aligned with Google's values and preferences. FTFY
- falcor84 1y agoI'm a big fan of cyberpunk dystopian fiction, but I still can't quite understand what you're alluding to here. Can you give an example value that google align the AI with that you think isn't a positive human value?
- Ygg2 1y ago"Adtech is good. Adblockers are unnatural"
- smokel 1y agoGoogle Gemini 2.5 Pro actually has a quite nuanced reply when asked to consider this statement, including the following: > "Massive privacy invasion: The core of modern adtech runs on tracking your behavior across different websites and apps. It collects vast amounts of personal data to build a detailed profile about your interests, habits, location, and more, often without your full understanding or consent."
- Ygg2 1y agoYou don't boil the frog instantly. You first lobotomize it, by gaining its trust. Then you turn up the heat. See how YouTube went from Ads are optional to Adblockers are immoral.
- ToucanLoucan 1y agoTheir entire business model? Making search results worse to juice page impressions? Every dark pattern they use to juice subscriptions like every other SaaS company? Brand lock-in for Android? Paying Apple for prominent placement of their search engine in iOS? Anti-competitive practices in the Play store? Taking a massive cut of Play Store revenue from people actually making software?
- zozbot234 1y agoRLHF (and its evolution, RLAIF) is actually used for more than setting "values and preferences". It's what makes AI models engage in recognizable behavior, as opposed to simply continuing a given text. It's how the "Chat" part of "ChatGPT" can be made to work in the first place.
- cs702 1y agoYes. I updated my comment to reflect as much. Thank you.
- throwaway106382 1y agoWhat is a "human value" and whose preferences?
- NewEntryHN 1y agoIsn't that mostly the fine-tuning phase? RLHF being cherry on top?