3 ms·
Must admit I struggle to see the “hacking” in it. Maybe ai applied to practical cases like driving and then altering that outcome. Bypassing llm safeguards isn
by Havoc 3y ago
Must admit I struggle to see the “hacking” in it.
Maybe ai applied to practical cases like driving and then altering that outcome. Bypassing llm safeguards isn’t quite in the same category to me
- toofy 3y agomy guess is the companies involved likely threatened to sue / wouldn’t give consent unless they (the companies) chose the parameters. from my perspective it looks like the companies wanted to stress test the areas they were going to market the heaviest. they wanted to use the power of hackers in one place for nothing more than free due diligence for them to shore up their marketing. and it looks like it backfired. if the people i’ve spoken to are any indication, they didn’t get truly stress tested at all—those most equipped to do actually meaningfully engage thought it was kind of ridiculous. this deserved a (at least) conlength timeframe with no guardrails. ideally teams could have had months to prep and conlength to activate. again, no guardrails.
- Shawnj2 3y agoThe hacking part is that LLM’s are going to be used in things like customer service online bots.
- simonw 3y agoI wrote about some of the worst case scenarios here: https://simonwillison.net/2023/Apr/14/worst-that-can-happen/ https://simonwillison.net/2023/Apr/14/worst-that-can-happen/ The "getting it to say something bad" attacks aren't the things I worry about - it's the security of the stuff people are building on top of LLMs (like AI personal assistants) that's concerning.