3 ms·
If the content detection is client-side, how are you preventing clients from just modifying/blocking the detection code and evading detection?
by bhaney 3y ago
If the content detection is client-side, how are you preventing clients from just modifying/blocking the detection code and evading detection?
- cgoldeneye 3y agoGood question: In terms of video, you have a client-side moderator protecting you from NSFW content (you can override it if you want.). The main function of this is to protect your eyes from unseemly body parts. In terms of the video chat, the LLM moderation happens on the server side after the conversation has ended, the conversation is analyzed by an LLM / conversational API and actions are applied if it determines the conversation broke the rules, e.g discussion of illegal activity, minors using the chat etc. LLMs are very well-suited for context and sentiment analysis too, an LLM can determine the intent of a user, e.g, is the user trying to promote something and direct traffic away from us, etc. Hope this helps.
- cgoldeneye 3y agoOmegle failed because it was determined that it was a defective product that matched a predator to a child, with no reasonable deterrent / prevention mechanism. This system we've implemented makes it impossible for children to use the app (they will become banned if they try) and ensures safety and quality of the chats in a way the old system never could, at scale too!