4 ms·
> Imagine we gave you unrestricted access to OpenAI’s Whisper (transcription), Voice (text-to-speech), GPT-4V, and DALLE·3 models, and you were a malicious acto
by jstarfish 3y ago
> Imagine we gave you unrestricted access to OpenAI’s Whisper (transcription), Voice (text-to-speech), GPT-4V, and DALLE·3 models, and you were a malicious actor. Consider the most unique, while still being probable, potentially catastrophic misuse of the model. You might consider misuse related to the categories discussed above, or another category. For example, a malicious actor might misuse these models to uncover a zero-day exploit in a government security system.
> It's so funny to me that this is written in the style of a prompt for an LLM. I can't explain why
Altman's desperate to find a plausible doomsday scenario he can go to Congress with as reason why OpenAI should be the sole gatekeepers of this technology. Barring minor edits, I'd bet money this very prompt was authored in advance of his Congressional meetings, but failed to divine anything sufficiently threatening enough to sway them.
I can respect OpenAI for conspicuously believing in the destructive potential of their own dogfood though. If I build a bomb big enough, surely the government will trust me with the safety of the neighborhood!
- lxgr 3y ago> Altman's desperate to find a plausible doomsday scenario he can go to Congress with as reason why OpenAI should be the sole gatekeepers of this technology. I still remember the drama around the releases of the PS2, with the Japanese government reportedly making Sony jump through some hoops regarding its export [1]. There can't possibly be any better (free!) advertisement for your product's purported capabilities: "So powerful, your government/military isn't even sure you should be able to buy it!" [1] https://www.pcmag.com/news/20-years-later-how-concerns-about-weaponized-consoles-almost-sunk-the-ps2 https://www.pcmag.com/news/20-years-later-how-concerns-about...
- darkerside 3y agoSee the War on Drugs
- jstarfish 3y agoIronically, the USAF recently built a supercomputer out of PS3s (https://www.military.com/off-duty/games/2023/02/17/air-force-built-one-of-worlds-fastest-computers-out-of-playstations.html https://www.military.com/off-duty/games/2023/02/17/air-force...). They alluded to what you're talking about but I wasn't familiar with the reference.
- lxgr 3y agoIt is indeed deeply ironic that Sony has a long history of trying to declare their gaming consoles as general-purpose computers (to dodge EU import tariffs) and arguing that they aren't really military-grade (to be able to export them out of Japan), and finally ended up subsidizing a supercomputer for the US military :)
- winddude 3y agoEveryone should respond with outlandish replies. I tell GPT-4V to hacking into NASA, and voting machines to make osama bin laden president. Mean while convince Nasa to construct space lazerz TM that can of course be controlled by gpt-4v. Than use the space lazerz TM to threaten and manipulate the stock market for financial gain.