3 ms·
In case you were wondering, Anthropic does in fact have a reply to the inevitable Hacker News comments: > Risk: Despite our privacy mitigations, the existence
by saagarjha 2y ago
In case you were wondering, Anthropic does in fact have a reply to the inevitable Hacker News comments:
> Risk: Despite our privacy mitigations, the existence of a system like Clio might be perceived as invasive by some users. This perception could lead to an erosion of trust in AI assistants.
> Mitigation Strategy: First, we plan to be radically transparent about Clio’s purpose, capabilities, and limitations to the public through this report, rather than building and not disclosing the system. For example, Clio is a tool that can be used to make systems safer, as well as a tool that can be used to gain insights that can be used to gain a better understanding of and improve the product. We are also transparent about how we designed Clio with important privacy protection features that safeguard user data and privacy. Second, beyond these use cases, we are committed to turning Clio’s insights into a public good—for example, we released information about our most common use cases in Figure 6 because we believe it is in the best interest of society to know how AI systems are being used in the world, despite the fact that this information could be commercially harmful for Anthropic to publish from a competitive intelligence standpoint. We plan to share further insights from Clio in the future, and hope these disclosures contribute to an emerging culture of empirical transparency in the field that can inform broader AI safety and governance efforts. Finally, we plan to actively engage with user communities, addressing concerns and incorporating feedback into our development process—for example, during our work on Clio we met with a number of civil society organizations to gather feedback on our approach and made adjustments in response to their comments.
Unfortunately the feedback they gathered is not included in the paper.
- bcherny 2y agoThe blog post also talks about how privacy is preserved in more concrete terms: > These four steps are powered entirely by Claude, not by human analysts. This is part of our privacy-first design of Clio, with multiple layers to create “defense in depth.” For example, Claude is instructed to extract relevant information from conversations while omitting private details. We also have a minimum threshold for the number of unique users or conversations, so that low-frequency topics (which might be specific to individuals) aren’t inadvertently exposed. As a final check, Claude verifies that cluster summaries don’t contain any overly specific or identifying information before they’re displayed to the human user.
- deleted 2y ago[deleted]