3 ms·
The problem is, it's really really hard to guarantee that. Yes if they only train say, classifiers, then the only thing that can leak is the classification out
by zmmmmm 2y ago
The problem is, it's really really hard to guarantee that.
Yes if they only train say, classifiers, then the only thing that can leak is the classification outcome. But these things can be super subtle. Even a classifier could leak things if you can hack the context fed into it. They are really playing with fire here.
- whimsicalism 2y agoyes, i certainly agree with you. i think oftentimes these policies are written by non-technical people i'm not entirely convinced that classifiers and LLMs are disjoint to begin with
- BHSPitMonkey 2y agoIf is also hard to guarantee that, in a multi-tenant application, users will never see other users' data due to causes like mistakes AuthZ logic, caching gone awry, or other unpredictable situations that come up in distributed systems—yet even before the AI craze we were all happy to use these SaaS products anyway. Maybe this class of vulnerability is indeed harder to tame than most, but third-party software has never been without risks.