3 ms·

This is an AI written post and the details are wrong (the description of the HF incident as involving Irregular is wrong and the description of the incident as

by pliny 8d ago

This is an AI written post and the details are wrong (the description of the HF incident as involving Irregular is wrong and the description of the incident as only involving stealing public credentials is wrong, per the technical report the agents got access to internal HF infrastructure).

nr378 8d ago
Please see below, one detail was incorrect and has been acknowledged and amended.
- pliny 8d ago
  Your description of the HF attack as being merely "the elite task of discovering 14 Hugging Face API tokens that careless developers had committed to public GitHub repositories" does not match the description in the technical report[1]. [1] https://cdn.openai.com/pdf/67869394-cb91-4c12-888c-5cbd85c7814c/OpenAI-Hugging-Face%20Incident-Technical-Report.pdf https://cdn.openai.com/pdf/67869394-cb91-4c12-888c-5cbd85c78... - page 9
  - nr378 8d ago
    The description reads "the elite task of discovering 14 Hugging Face API tokens that careless developers had committed to public GitHub repositories, and used them to try to get benchmark solutions from directly from Hugging Face by applying a template injection flaw that’s been known about since 2015[1]." Chaining a public token to an 11-year-old Jinja2 template injection vuln shouldn't be dressed up as an unprecedented "alien intellect" that threatens human civilisation. (And HuggingFace should take some flack for having such a dated vulnerability exposed - if your Bank was compromised in this way, you'd be blaming your bank, not the attacker.) One correction is fair though, the 14 tokens were in a public Hugging Face dataset not a public GitHub repository. I've updated the post to reflect that. [1] https://blackhat.com/docs/us-15/materials/us-15-Kettle-Server-Side-Template-Injection-RCE-For-The-Modern-Web-App-wp.pdf https://blackhat.com/docs/us-15/materials/us-15-Kettle-Serve...
franga2000 8d ago
I find it incredibly funny that the comment shown (to me) right above this one is: > This is one of the most lucid pieces of writing capturing the current state of play I’ve read. Who is the author?
- verdverm 8d ago
  The same thing is happening with Laya, people didn't seem to click through to evaluate the supposed paper tyranny of confirmational headlines
- tim333 7d ago
  I guess the AI is getting good in some ways. Still a bit lacking in others.
EA-3167 8d ago
While I agree with the content of the article, you’re right about it being the output of an LLM. https://www.pangram.com/history/6451ec6b-90b6-4e17-bfc9-6730011b1af4?ucc=I4Fo2JL9GdU https://www.pangram.com/history/6451ec6b-90b6-4e17-bfc9-6730...

by pliny 8d ago

nr378 8d ago

Please see below, one detail was incorrect and has been acknowledged and amended.

pliny 8d ago
Your description of the HF attack as being merely "the elite task of discovering 14 Hugging Face API tokens that careless developers had committed to public GitHub repositories" does not match the description in the technical report[1]. [1] https://cdn.openai.com/pdf/67869394-cb91-4c12-888c-5cbd85c7814c/OpenAI-Hugging-Face%20Incident-Technical-Report.pdf https://cdn.openai.com/pdf/67869394-cb91-4c12-888c-5cbd85c78... - page 9
- nr378 8d ago
  The description reads "the elite task of discovering 14 Hugging Face API tokens that careless developers had committed to public GitHub repositories, and used them to try to get benchmark solutions from directly from Hugging Face by applying a template injection flaw that’s been known about since 2015[1]." Chaining a public token to an 11-year-old Jinja2 template injection vuln shouldn't be dressed up as an unprecedented "alien intellect" that threatens human civilisation. (And HuggingFace should take some flack for having such a dated vulnerability exposed - if your Bank was compromised in this way, you'd be blaming your bank, not the attacker.) One correction is fair though, the 14 tokens were in a public Hugging Face dataset not a public GitHub repository. I've updated the post to reflect that. [1] https://blackhat.com/docs/us-15/materials/us-15-Kettle-Server-Side-Template-Injection-RCE-For-The-Modern-Web-App-wp.pdf https://blackhat.com/docs/us-15/materials/us-15-Kettle-Serve...

franga2000 8d ago

I find it incredibly funny that the comment shown (to me) right above this one is: > This is one of the most lucid pieces of writing capturing the current state of play I’ve read. Who is the author?

verdverm 8d ago
The same thing is happening with Laya, people didn't seem to click through to evaluate the supposed paper tyranny of confirmational headlines
tim333 7d ago
I guess the AI is getting good in some ways. Still a bit lacking in others.

EA-3167 8d ago

While I agree with the content of the article, you’re right about it being the output of an LLM. https://www.pangram.com/history/6451ec6b-90b6-4e17-bfc9-6730011b1af4?ucc=I4Fo2JL9GdU https://www.pangram.com/history/6451ec6b-90b6-4e17-bfc9-6730...