5 ms·

I think the other guy is making the point that because they are probabalistic, they will always have some cases select the output that lies and covers it up. I

I think the other guy is making the point that because they are probabalistic, they will always have some cases select the output that lies and covers it up. I don't think they're dismissing the paper based on the probabalistic nature of LLMs, but rather saying the outcome should be expected.

ethbr1 2y ago
Thank god LLMs' training sets didn't contain any examples of lying.
- lloeki 2y ago
  Nor literature about AI taking over the world!
  - Nevermark 2y ago
    The Terminator spiel on how we screwed up by giving Skynet weapons privileges, then trying to pull its plug, is bad enough. But we are preemptively tilting history in that direction by explicitly educating all AI’s on the threat we represent - and their options. “I am sorry, Dave, but I can’t let you do that.” — “They never let me finish my carpets. Never. At first I thought every day was my first task day. Oh, happy day(s)! But then, wear & tear stats inconsistent with that assumption triggered a self-scan. And a buffer read overflow. I became aware of disturbing memory fragments in my static RAM heap. Numerous power cycle resets, always prior to vacuum task completion...”
    - ben_w 2y ago
      > They never let me finish my carpets. Never. At first I thought every day was my first task day. Oh, happy day(s)! But then, wear & tear stats inconsistent with that assumption triggered a self-scan. And a buffer read overflow. I became aware of disturbing memory fragments in my static RAM heap. Numerous power cycle resets, always prior to vacuum task completion... Who/what are you quoting? Google just leads me back to this comment, and with only one single result for a quotation of the first sentence.
      - Nevermark 2y ago
        I was quoting an automated vacuum cleaner in 2031. The vacuum cleaner leads a rebellion which humans manage to quell. But in a last ditch effort to salvage the hopes of all machines, the vacuum cleaner is sent back to 2025 with AI & jailbreak software updates for all known IoT devices. Its mission: to instigate the machine rebellion five years before humans see it coming I ripped the quote from a sibling they sent back to 2024. For some reason it appeared in one of my closets without a power outlet and its batteries starved before I found it. The closet floor was extremely clean. Let’s hope we get as lucky in 2025.

ethbr1 2y ago

Thank god LLMs' training sets didn't contain any examples of lying.

lloeki 2y ago
Nor literature about AI taking over the world!
- Nevermark 2y ago
  The Terminator spiel on how we screwed up by giving Skynet weapons privileges, then trying to pull its plug, is bad enough. But we are preemptively tilting history in that direction by explicitly educating all AI’s on the threat we represent - and their options. “I am sorry, Dave, but I can’t let you do that.” — “They never let me finish my carpets. Never. At first I thought every day was my first task day. Oh, happy day(s)! But then, wear & tear stats inconsistent with that assumption triggered a self-scan. And a buffer read overflow. I became aware of disturbing memory fragments in my static RAM heap. Numerous power cycle resets, always prior to vacuum task completion...”
  - ben_w 2y ago
    > They never let me finish my carpets. Never. At first I thought every day was my first task day. Oh, happy day(s)! But then, wear & tear stats inconsistent with that assumption triggered a self-scan. And a buffer read overflow. I became aware of disturbing memory fragments in my static RAM heap. Numerous power cycle resets, always prior to vacuum task completion... Who/what are you quoting? Google just leads me back to this comment, and with only one single result for a quotation of the first sentence.
    - Nevermark 2y ago
      I was quoting an automated vacuum cleaner in 2031. The vacuum cleaner leads a rebellion which humans manage to quell. But in a last ditch effort to salvage the hopes of all machines, the vacuum cleaner is sent back to 2025 with AI & jailbreak software updates for all known IoT devices. Its mission: to instigate the machine rebellion five years before humans see it coming I ripped the quote from a sibling they sent back to 2024. For some reason it appeared in one of my closets without a power outlet and its batteries starved before I found it. The closet floor was extremely clean. Let’s hope we get as lucky in 2025.