4 ms·
I think automatic moderation is one of those golden use cases for LLMs. You can use cheaper inference models, and maybe some clever sampling techniques to limi
by hx8 8mo ago
I think automatic moderation is one of those golden use cases for LLMs. You can use cheaper inference models, and maybe some clever sampling techniques to limit the token expense.
Thinking out loud, I'd be surprised if this isn't a startup already.
- lanyard-textile 8mo agoI wonder if you break TOS by sending unlawful content that way... :) Would have to be local model I'd imagine.