2 ms·

Thanks for the detailed answer. I guess these are unavoidable without investing a lot more money on it if you are aiming for basically reducing false negatives

Thanks for the detailed answer. I guess these are unavoidable without investing a lot more money on it if you are aiming for basically reducing false negatives to zero at that scale. One thing that surprised me is that Yann LeCun frequently mentions transformers have been in prod for all parts of moderation on Meta for a while already but maybe they come into play at more critical problems or at later stages.

bertil 3y ago
Moderation, yes definitely. There’s are a couple billion users, they post a handful of comments per day and rarely post anything long enough to justify applying a transformer, so “everything posted to Facebook/Instagram” is several orders of magnitude smaller. Barely an inconvenience. Messenger is bigger, but hardly one writes anything long enough to be suspicious. WhatsApp isn’t moderated the same way.