3 ms·

Note: Google did not release the hidden dimension for GPT-3.5, and OpenAI has already implemented mitigations against some of this.

• antonvs 3y ago
  > Google did not release the hidden dimension for GPT-3.5 Google?
  • chaxor 3y ago
    They may have meant that deepmind is a good majority of the authors, though ETH Zurich, a few others and even openai is represented as well. Does seem like strange wording if the paper went read though
• wrsh07 3y ago
  Yup - right at the top of the second page they note their disclosure practices. It's still a pretty wild attack. > Responsible disclosure. We shared our attack with all services we are aware of that are vulnerable to this attack. We also shared our attack with several other popular services, even if they were not vulnerable to our specific attack, because variants of our attack may be possible in other settings. We received approval from OpenAl prior to extracting the parameters of the last layers of their models, worked with OpenAl to confirm our approach's efficacy, and then deleted all data associated with the attack. In response to our attack, OpenAl and Google have both modified their APIs to introduce mitigations and defenses (like those that we suggest in Section 8) to make it more difficult for adversaries to perform this attack.