3 ms·
> ...I see how no-guardrails LLMs could be truly disastrous... by all accounts this is what's what because of how... > You can do CRISPR in your kitchen. ..
by testerteert000a 2mo ago
> ...I see how no-guardrails LLMs could be truly disastrous...
by all accounts this is what's what because of how...
> You can do CRISPR in your kitchen.
.. and because of the same dynamic we see occurring in cybersec.
If you're good enough at cybersec, but not good-good at specific skillsets like offensive, then LLMs and a comp sci degree makes you quite capable in the ways that count. This is a fact, full stop.
If you're good enough at biology and have certain ideologies, but not good-good at specific skillsets like genetic engineering in your kitchen, do LLMs get you good enough? Does the impact on cybersec transfer over to this domain? H
Hard to say, but it has enough risk indicators for me to think the pushback against these possibilities is the height of otherwise talented engineers being myopic.
If good enough at biology can include all the PhD programs across all the world, and you pair other known events like cartels and terrorism groups hiring chemistry PhDs from University of Unemployed Chemistry PhDs, then the next logical extension of that theme with this tech is intense.
- red_green_yell 2mo agoIf the accuracy of your biology claim is "hard to say" then why would pushback be self-evidently myopic? You and others are making a claim about LLMs enabling biological dangers. Some people disagree with you, pointing out that the incremental knowledge an LLM provides over say google or a library card may not be that much. What seems myopic to me is un-skeptically accepting "AI dangerous, must regulate" messaging from frontier labs that have trillions of dollars of vested interests in this message.
- 0xDEAFBEAD 2mo ago>frontier labs that have trillions of dollars of vested interests in this message. OP suggests the opposite: "each company—and country—is under intense competitive pressure not to unilaterally slow that acceleration."
- red_green_yell 2mo agoOAI and Anthropic specifically are under intense pressure to compete. One form of competition could be to innovate. Another form would be regulatory capture. The former seems unlikely given how quickly open labs are catching up. The latter is much easier and cheaper. If you can't beat them, ban them.
- 0xDEAFBEAD 2mo ago"We request that the U.S. government support an international effort" (emphasis mine) China is unlikely to sign on to an "international effort" which unfairly privileges US models.
- areoform 2mo agoIf you're good enough at cybersec, but not good-good at specific skillsets like offensive, then LLMs and a comp sci degree makes you quite capable in the ways that count. This is a fact, full stop. Wet work in a lab isn't the same as writing code on a computer. If you screw up with a lethal pathogen in a lab, you die. If you screw up with code on a computer, you go get lunch. They're not the same.
- testerteert000a 2mo agoIf you develop LLM-driven exploits that can work through a water treatment/ purification system, looks an awful lot the same.