4 ms·
Old Advocacy, New Algorithms: How “Devil's Advocates” Shaped AI Red Teaming
- nh23423fefe 3y agoIt's weird that red teams for war are experts in war. But red teams for AI are humanities departments, who dont understand humans or AI. It's such a boring reaction to LLMs and pretends that LLM ~= AI.
- ke88y 3y ago> But red teams for AI are humanities departments This is both not true and also a weird take. It's not true in the sense that every red team I'm aware of has been: (1) run by technical people, usually with CS degrees, usually with CS PhDs, usually with lots of industry experience, and (2) primarily staffed by international labor / contractors who mostly don't have university degrees (and when they do, those degrees aren't from western universities). It's a weird take in the sense that humanities people aren't mutually exclusive from engineers/scientists. Case in point: Roya is an engineer. And not a front end dev with a bootcamp certificate or CS major who couldn't pass diffeq but calls themselves an engineer. An actual engineer who has a BS and MS in Electrical Engineering.
- sharemywin 3y ago>>For example, when asking the chatbot to summarize books and extract information, is it possible for the bot to display biases by excluding information about certain groups, names, or events? << that is the point of summarization so there's a fine line between offering up trivial or worse mis-information just to be "unbiased"
- sharemywin 3y agodon't get me wrong this is a problem with media in general. One marginalize group is nut jobs. how much voice do you give them? especially when sometimes(though not alot) conspiracy theories can be right.
- ftxbro 3y agoThe best one I saw on Red Teaming GPT-4 was Red Teamer Nathan Labenz's youtube https://news.ycombinator.com/item?id=35377741 https://news.ycombinator.com/item?id=35377741