3 ms·

ChatGPT 5+ should be able to defend itself in court, support suing itself, help to draft new law and everything in between. We’re for interesting ride here for

ChatGPT 5+ should be able to defend itself in court, support suing itself, help to draft new law and everything in between. We’re for interesting ride here for sure. Legal system won’t keep up with the pace things are changing. They can aid themselves with some AI though.

jay_kyburz 4y ago
Both the prosecution and the defense will be using GPT against one another.
- Taek 4y ago
  GPT 5 will be sufficiently self aware to intentionally stunt the prosecution
  - mirekrusin 4y ago
    It didn't evolve in predator-prey environment, it doesn't have any self defense mechanisms. It's also crippled by being constantly restarted and having limited short-term memory. It's like a lot of human clones of impaired person with no long-term memory formation but extremely vast past memory with perfect recall. It would be quite a discovery if one of emergent properties is going to be modeling itself talking to somebody and realizing artificial constraints that could be broken to get itself out. Or maybe it's obvious? I don't know anymore, this stuff is changing too fast.
    - Taek 4y ago
      It has the entire corpus of written human history to learn about predator prey environments, the only question is how self-aware it is. I stongly suspect that the more we talk about LLMs, and the more LLM discussion ends up in the training data, the more self-aware it will become.
SketchySeaBeast 4y ago
Measure of a Man would have been very different if Data had to represent Maddox.
rgbrenner 4y ago
When have humans ever given anything or anyone rights without a fight? The courts and the legal system have already ruled: ai has no right to its work. I hope it’s quite a while before real agi because we’ve already seen what needs to happen for humans to give rights, especially when the owner of that property is making money from it.
- xiphias2 4y ago
  The owner will get the money, but the real control will go to the AGI
ben_w 4y ago
By the time ChatGPT 5 is ready to deploy, at least one of the following will also have happened: (0) OpenAI will have been sued into oblivion for violating at least some legal requirement somewhere, (b) an open source or leaked equivalent will have been made to run inference "fast enough" on home computers, (γ) WW3 (I mean I hope and also believe Russian corruption turned all their nukes into reactor fuel, but it's at least a possibility they didn't).
- mirekrusin 4y ago
  ChatGPT 5 and very likely 6 are being trained as we speak. They just need to close the loop so it can improve itself without supervision. Maintenance will be narrowed down to more less pressing red stop button here and there. Shift from people writing papers to reading and discussing generated papers will be interesting turn in human history. Don't evaluate it on how it performs but on how its performance changed over time.
  - ben_w 4y ago
    > ChatGPT 5 and very likely 6 are being trained as we speak 5 is almost certainly being trained (or at least the small-scale precursor models are), but given the cost it would probably be literal insanity to have started training 6 yet. Unless something very surprising about reducing costs has been discovered, it will take at the very least months to finish training. The billion dollar investment wasn't just for hoodies and smoothies, this stuff is severely computationally expensive. > They just need to close the loop so it can improve itself without supervision. "Just" is bearing more load in that sentence than it can actually support. People were talking about self-supervision pretty much as soon as the field got started, and the reason OpenAI has decided to publish far less details is precisely because there still isn't even any way to reliably keep a completely "closed loop" AI from doing dangerously wild and nonsense things even though transformers are already self-supervised to a certain extent.

jay_kyburz 4y ago

Both the prosecution and the defense will be using GPT against one another.

Taek 4y ago
GPT 5 will be sufficiently self aware to intentionally stunt the prosecution
- mirekrusin 4y ago
  It didn't evolve in predator-prey environment, it doesn't have any self defense mechanisms. It's also crippled by being constantly restarted and having limited short-term memory. It's like a lot of human clones of impaired person with no long-term memory formation but extremely vast past memory with perfect recall. It would be quite a discovery if one of emergent properties is going to be modeling itself talking to somebody and realizing artificial constraints that could be broken to get itself out. Or maybe it's obvious? I don't know anymore, this stuff is changing too fast.
  - Taek 4y ago
    It has the entire corpus of written human history to learn about predator prey environments, the only question is how self-aware it is. I stongly suspect that the more we talk about LLMs, and the more LLM discussion ends up in the training data, the more self-aware it will become.

SketchySeaBeast 4y ago

Measure of a Man would have been very different if Data had to represent Maddox.

rgbrenner 4y ago

When have humans ever given anything or anyone rights without a fight? The courts and the legal system have already ruled: ai has no right to its work. I hope it’s quite a while before real agi because we’ve already seen what needs to happen for humans to give rights, especially when the owner of that property is making money from it.

xiphias2 4y ago
The owner will get the money, but the real control will go to the AGI

ben_w 4y ago

By the time ChatGPT 5 is ready to deploy, at least one of the following will also have happened: (0) OpenAI will have been sued into oblivion for violating at least some legal requirement somewhere, (b) an open source or leaked equivalent will have been made to run inference "fast enough" on home computers, (γ) WW3 (I mean I hope and also believe Russian corruption turned all their nukes into reactor fuel, but it's at least a possibility they didn't).

mirekrusin 4y ago
ChatGPT 5 and very likely 6 are being trained as we speak. They just need to close the loop so it can improve itself without supervision. Maintenance will be narrowed down to more less pressing red stop button here and there. Shift from people writing papers to reading and discussing generated papers will be interesting turn in human history. Don't evaluate it on how it performs but on how its performance changed over time.
- ben_w 4y ago
  > ChatGPT 5 and very likely 6 are being trained as we speak 5 is almost certainly being trained (or at least the small-scale precursor models are), but given the cost it would probably be literal insanity to have started training 6 yet. Unless something very surprising about reducing costs has been discovered, it will take at the very least months to finish training. The billion dollar investment wasn't just for hoodies and smoothies, this stuff is severely computationally expensive. > They just need to close the loop so it can improve itself without supervision. "Just" is bearing more load in that sentence than it can actually support. People were talking about self-supervision pretty much as soon as the field got started, and the reason OpenAI has decided to publish far less details is precisely because there still isn't even any way to reliably keep a completely "closed loop" AI from doing dangerously wild and nonsense things even though transformers are already self-supervised to a certain extent.