3 ms·

Of those four, I think accountability is truly the only moat. The other three are varying amounts of both testable and iterated on via adversarial agents steel-

by Fordec 28d ago

Of those four, I think accountability is truly the only moat. The other three are varying amounts of both testable and iterated on via adversarial agents steel-manning the implementations. Accountability will not come before AIs achieve legal personhood, and that probably will not happen in my lifetime. And if it does in some jurisdictions (which I am not betting money on, this is a full full AGI scenario after multiple more philosophical goalposts move first), I will completely bet it will not be a global recognition.

jurgenburgen 28d ago
Why would the AI need to be accountable? Make the org that sells the tokens accountable.
- a2ff6eeb0 28d ago
  The AI is going to be running the org that sells the tokens.
pydry 28d ago
This is like saying "writing code is solved, all we need now is somebody to blame because it doesnt work"
- a2ff6eeb0 28d ago
  That's really where we're heading, though. We're mostly at the point that, for a lot of code, the humans are there for manual testing and not creating the code.
  - pydry 27d ago
    At some point it will become a strong competitive advantage to zag where others zig. If you understand the codebase deeply and have trust in it can roll out changes quickly without manual testing you can run circles around the people scratching their heads wondering if this vibe coded 2,500 pull request is going to be the one that takes down the system for a day.
    - a2ff6eeb0 27d ago
      Have you ever written significant changes by hand without testing?
      - pydry 27d ago
        Ive written many significant changes without manual testing by leaning heavily on well crafted automated tests, carefully honed type systems and clean architecture. These foundations serve as the bedrock of high quality applications I can move fast on. IME vibe coding isnt just not capable of building these foundations, it actively chips away at them where they already exist. shrug
        a2ff6eeb0 27d ago
        You can ask for tests.
        pydry 27d ago
        sure i can get all sorts of very poor quality tests by asking for them
odo1242 28d ago
AIs achieving legal personhood isn’t going to do much. You can’t just put an AI behind bars
- sunrunner 28d ago
  FreeBSD has had jails for decades now.

by Fordec 28d ago

jurgenburgen 28d ago

Why would the AI need to be accountable? Make the org that sells the tokens accountable.

a2ff6eeb0 28d ago
The AI is going to be running the org that sells the tokens.

pydry 28d ago

This is like saying "writing code is solved, all we need now is somebody to blame because it doesnt work"

a2ff6eeb0 28d ago
That's really where we're heading, though. We're mostly at the point that, for a lot of code, the humans are there for manual testing and not creating the code.
- pydry 27d ago
  At some point it will become a strong competitive advantage to zag where others zig. If you understand the codebase deeply and have trust in it can roll out changes quickly without manual testing you can run circles around the people scratching their heads wondering if this vibe coded 2,500 pull request is going to be the one that takes down the system for a day.
  - a2ff6eeb0 27d ago
    Have you ever written significant changes by hand without testing?
    - pydry 27d ago
      Ive written many significant changes without manual testing by leaning heavily on well crafted automated tests, carefully honed type systems and clean architecture. These foundations serve as the bedrock of high quality applications I can move fast on. IME vibe coding isnt just not capable of building these foundations, it actively chips away at them where they already exist. shrug
      - a2ff6eeb0 27d ago
        You can ask for tests.
        pydry 27d ago
        sure i can get all sorts of very poor quality tests by asking for them

odo1242 28d ago

AIs achieving legal personhood isn’t going to do much. You can’t just put an AI behind bars

sunrunner 28d ago
FreeBSD has had jails for decades now.