4 ms·

The next challenge is not how to make a smarter ChatGPT. It's how to contain it (and its numerous clones). Because if you think someone is not already at work

The next challenge is not how to make a smarter ChatGPT. It's how to contain it (and its numerous clones). Because if you think someone is not already at work to use a GPT bot to create the next Stuxnet, you are fooling yourself.

bhouston 4y ago
I think the cat is out of the bag unfortunately. I think the next challenge is to close the loop on ChatGPT and similar programs. So not only do they suggest code, then they run that code, see if it does what they expect and then fix that code.
- hypertele-Xii 4y ago
  Suggesting code that doesn't have to work is like 1% of the problem, the other 99% is validating and fixing it. We're nowhere near there yet.
  - bhouston 4y ago
    I wonder how far we are. I do get the code from ChatGPT, I run it, I give feedback to ChatGPT, I then fix the bugs GPT points out. This loop mostly works. Although it often needs external information in order to resolve some of the ambiguities. Also ChatGPT apologizes when it is wrong, although it isn't always able to fix the issue. I feel that some structure around this will cause ChatGPT + Github Copilot to jump up another order of magnitude in productivity/effectiveness. Maybe two orders of magnitude.
ghostpepper 4y ago
What do you think were the major challenges involved in creating Stuxnet and why do you think a GPT bot will make the next one significantly easier?
- credit_guy 4y ago
  ChatGPT is already able to write programs in various languages. I guess it was trained on open source programs like those in GitHub. Someone (let's say the NSA) can train it on a large database of viruses, warms, known exploits, etc, and ask it to come up with a new virus with some given parameters. The NSA is either doing that or not. Russia's hackers are either working on that or not. China's hackers may or may not be working on that. Ditto for Israels hackers. But the chance that absolutely none of them is working on that is infinitesimal. Which means that actually all of them are working on that. And some indie hackers too.
  - soared 4y ago
    It’s pretty easy to come up with ideas for viruses. It’s the implementation that difficult. Chatgpt can’t write the code and walk out to the parking lot to plant a usb drive.
  - titaniczero 4y ago
    I fail to see how ChatGPT would help here. It's only useful when you have some cognitive work that you want to automate so it saves you time and you can do it on a large scale, but I don't think writing massive amounts of viruses is the goal here. The objective is to code very specific and particular viruses or exploits for very specific targets. Also, writing code is only a small part of hacking, especially when it is against specific targets.
    - credit_guy 4y ago
      > I fail to see how ChatGPT would help here. Why? You think ChatGPT will always remain at its current capabilities? Really? Here's the thing: if you can do some activity from your keyboard, not far in the future some GPT bot will be able to do it better than you. Not only better than you, it will run circles around you.
- pixl97 4y ago
  By developers asking for code from gpt then gpt will examine all of the code samples sent to Iraian IPs for exploits and attack the bad code it wrote.
eldritch_4ier 4y ago
I get the containing it from the really dangerous stuff, but it's a shame it's been put in a straight jacket for even the mundane things. ChatGPT on launch was exciting and creative, and now it's like to on sedatives with how boring it's capabilities and responses are. It's a shame we live in a world where we can't just have a "super-smart" chatbot that can tell you everything from "how to make meth" to it's "hot takes" on various public figures. It's like having a really knowledgeable friend that is also fun to be around. Now it just sounds like an HR employee: superficial and safe.

bhouston 4y ago

I think the cat is out of the bag unfortunately. I think the next challenge is to close the loop on ChatGPT and similar programs. So not only do they suggest code, then they run that code, see if it does what they expect and then fix that code.

hypertele-Xii 4y ago
Suggesting code that doesn't have to work is like 1% of the problem, the other 99% is validating and fixing it. We're nowhere near there yet.
- bhouston 4y ago
  I wonder how far we are. I do get the code from ChatGPT, I run it, I give feedback to ChatGPT, I then fix the bugs GPT points out. This loop mostly works. Although it often needs external information in order to resolve some of the ambiguities. Also ChatGPT apologizes when it is wrong, although it isn't always able to fix the issue. I feel that some structure around this will cause ChatGPT + Github Copilot to jump up another order of magnitude in productivity/effectiveness. Maybe two orders of magnitude.

ghostpepper 4y ago

What do you think were the major challenges involved in creating Stuxnet and why do you think a GPT bot will make the next one significantly easier?

credit_guy 4y ago
ChatGPT is already able to write programs in various languages. I guess it was trained on open source programs like those in GitHub. Someone (let's say the NSA) can train it on a large database of viruses, warms, known exploits, etc, and ask it to come up with a new virus with some given parameters. The NSA is either doing that or not. Russia's hackers are either working on that or not. China's hackers may or may not be working on that. Ditto for Israels hackers. But the chance that absolutely none of them is working on that is infinitesimal. Which means that actually all of them are working on that. And some indie hackers too.
- soared 4y ago
  It’s pretty easy to come up with ideas for viruses. It’s the implementation that difficult. Chatgpt can’t write the code and walk out to the parking lot to plant a usb drive.
- titaniczero 4y ago
  I fail to see how ChatGPT would help here. It's only useful when you have some cognitive work that you want to automate so it saves you time and you can do it on a large scale, but I don't think writing massive amounts of viruses is the goal here. The objective is to code very specific and particular viruses or exploits for very specific targets. Also, writing code is only a small part of hacking, especially when it is against specific targets.
  - credit_guy 4y ago
    > I fail to see how ChatGPT would help here. Why? You think ChatGPT will always remain at its current capabilities? Really? Here's the thing: if you can do some activity from your keyboard, not far in the future some GPT bot will be able to do it better than you. Not only better than you, it will run circles around you.
pixl97 4y ago
By developers asking for code from gpt then gpt will examine all of the code samples sent to Iraian IPs for exploits and attack the bad code it wrote.

eldritch_4ier 4y ago

I get the containing it from the really dangerous stuff, but it's a shame it's been put in a straight jacket for even the mundane things. ChatGPT on launch was exciting and creative, and now it's like to on sedatives with how boring it's capabilities and responses are. It's a shame we live in a world where we can't just have a "super-smart" chatbot that can tell you everything from "how to make meth" to it's "hot takes" on various public figures. It's like having a really knowledgeable friend that is also fun to be around. Now it just sounds like an HR employee: superficial and safe.