4 ms·
I don't understand this. So the hacker has to be part of the org in the first place to be able to do anything like that right ?? What is the probability of anyt
by fsndz 2y ago
I don't understand this. So the hacker has to be part of the org in the first place to be able to do anything like that right ??
What is the probability of anything like what is described there to happen and have any significant impact ? I get that LLMs are not reliable (https://www.lycee.ai/blog/ai-reliability-challenge https://www.lycee.ai/blog/ai-reliability-challenge) and using them come with challenges, but this attack seems not that important to me. What am I missing here ?
- michaelmior 2y agoThey have to be part of the same Slack workspace, but not necessarily the same organization.
- fsndz 2y agoyeah so the same company. and given the type of attack have to have a lot of knowledge about usernames and what they may have potentially shared in some random private slack channel. I can understand why slack is not alarmed with this. would like to see their official response though
- michaelmior 2y agoSame workspace != same company. It's not uncommon to have people from multiple organizations in the same workspace.
- fsndz 2y agoThis makes the described attack seem even less interesting/dangerous. Thanks
- simonw 2y agoThe hacker doesn’t have to be able to post chat messages at all now that Slack AI includes uploaded documents in the search feature: they just need to trick someone in that org into uploading a document that includes malicious instructions in hidden text.
- fsndz 2y agobut the article does not demonstrate that that would work in practice...
- simonw 2y agoThe article says this: “Although we did not test for this functionality explicitly as the testing was conducted prior to August 14th, we believe this attack scenario is highly likely given the functionality observed prior to August 14th.”
- fsndz 2y agoa belief is not the truth
- simonw 2y agoSo they shouldn’t have published what they’ve discovered so far?
- fsndz 2y agoI think it was great that they contacted Slack the way they did. It's also okay for me to publish. I just don't think it deserves much fanfare; in my opinion, this isn't a huge or serious vulnerability, that's all.