3 ms·
"But a former partner poisoned the documents" So basically "protocol breach involving tampering that could be EXTREMELY severe in 99 non-AI ways could be made
by kromem 3y ago
"But a former partner poisoned the documents"
So basically "protocol breach involving tampering that could be EXTREMELY severe in 99 non-AI ways could be made to be potentially problematic in a fictional generative AI scenario which is already suspect as using a product prone to accuracy issues in preparing accuracy critical work without adequate checks is a bad idea to begin with."
I appreciate your effort in coming up with a scenario. Let me try my hand as well:
"China's APT team gets unfettered access to Microsoft's servers and buries deep for three years. Eventually they modify PDFs of client financing agreements - not changing the visible information, but changing invisible instructions to alter how an AI might read credit limits. This results in an AI's unaudited review of credit agreement compliance to deny sales to large customers and allow sales to clients with low credit worthiness. After a year of this flying under the radar, Microsoft has lost business or had unpaid debt totaling over $100 million dollars."
I'm sure Microsoft's CSO reading that paragraph would be most concerned about the PDF reading AI, out of everything listed.
How does this not already have a CVSS of 'severe'?