3 ms·
Maybe. We’re also not open sourcing DNA from viruses, how to build nuclear weapons or 3D printing weapons. I think there is an argument to be made that not eve
by MVissers 3y ago
Maybe. We’re also not open sourcing DNA from viruses, how to build nuclear weapons or 3D printing weapons.
I think there is an argument to be made that not every powerful LLM should be open source. But yes- maybe we’re worried about nothing. On the other hand, these tools can easily spread misinformation, increase animosity, etc,
Even in todays world.
I come from the medical field, and we make risk-analyses there to dictate how strict we need to tests things before we release it in the wild. None of this exists for AI (yet).
I do think that focus on alignment is many times more important than chatgpt stores for humanity though.
- m-ee 3y agoHuh? We absolutely have open source virus genome sequences and 3D printed gun plans.
- nathansherburn 3y agoFair point. I think the thrust of the argument still stands. Open source is generally a fantastic principle but it has its limits. I.e. we probably shouldn't open source bomb designs or superviruses.
- ssnistfajen 3y agoNuclear weapons are open sourced already. The trick was to acquire the means to make it without being sanctioned to hell.
- ALittleLight 3y agoActually the genome for viruses, and bacteria, does seem to be open. Here is an FTP server where you can download a bunch of different diseases. https://ftp.ncbi.nih.gov/genomes/genbank/ https://ftp.ncbi.nih.gov/genomes/genbank/
- nathansherburn 3y agoThat's true. There are many other viruses that we don't publish for good reasons though.
- deleted 3y ago[deleted]