3 ms·
My company Preamble markets ourselves as an AI Safety company so I’ll opine on what I think is a reasonable middle-ground definition. We interpret near-term AI
by upwardbound 3y ago
My company Preamble markets ourselves as an AI Safety company so I’ll opine on what I think is a reasonable middle-ground definition. We interpret near-term AI safety to mean solving the problems that already exist today but will also exist in AGI.
As a key example, we were the first team to discover Prompt Injection, which we responsibly disclosed to OpenAI leadership in early May of 2022, four months before it was independently rediscovered by Riley Goodside.
(See the citation at the bottom of this page https://github.com/OWASP/www-project-top-10-for-large-language-model-applications/blob/main/1_1_vulns/LLM01_PromptInjection.md https://github.com/OWASP/www-project-top-10-for-large-langua... )
Prompt Injection is a perfect example of what we consider a near-term “AI safety” issue: it’s a real issue that affects current systems, and it will also affect any instruction-based AGI systems if a solution is not found by the time AGI is reached. There is currently no known general solution to Prompt Injection, and it’s #1 on OWASP’s recent list of the top vulns in LLMs. (See link above. This vuln is designated LLM01.)