3 ms·

But at what scope? The how will always matter. Your AI could design a system that bankrupts you on the first day. To prevent that you need to specify constraint

But at what scope? The how will always matter. Your AI could design a system that bankrupts you on the first day. To prevent that you need to specify constraints and it's turtles all the way down. It would free you from spending time on areas you don't care about, but that's already true with SaaS.

auggierose 4y ago
The how that matters must be part of your spec, of course. It is turtles all the way down, but the point is that apart from the top turtle, all the other turtles will be AIs. That's a big difference. Just the step from "program" => "spec" is already a big one. So big, that it is rarely done today. Test-driven development is an attempt at this, but the problem is that tests cannot truly verify a spec. Proofs can. Of course, you can combine tests and proofs, for example proofs for correctness, tests to make sure other measures like speed and cost are sane. But if you want to be absolutely sure, you will need to replace all tests by proofs.
- Existenceblinks 4y ago
  Is it: https://www.commitstrip.com/en/2016/08/25/a-very-comprehensive-and-precise-spec/ https://www.commitstrip.com/en/2016/08/25/a-very-comprehensi...?
  - auggierose 4y ago
    Hehehe. Well, the important ingredient missing from this comic strip is proof. You can see proof as code, if you like, but the important thing here is that you can trust the proof generated by an AI without having to look yourself at it. Most people don't understand proof, but if you don't understand proof in 10 years, you will be out of a job as a programmer.
    - Existenceblinks 4y ago
      > if you don't understand proof in 10 years, you will be out of a job as a programmer. No, that's not gonna happen. Can you write a proof of an order for you go to go a fresh market to buy ingredient of a menu I want to cook? "Hey, go buy ingredients for my noodle menu whose result is my taste"
      - auggierose 4y ago
        What? You are going to hire a programmer to do that for you?

auggierose 4y ago

The how that matters must be part of your spec, of course. It is turtles all the way down, but the point is that apart from the top turtle, all the other turtles will be AIs. That's a big difference. Just the step from "program" => "spec" is already a big one. So big, that it is rarely done today. Test-driven development is an attempt at this, but the problem is that tests cannot truly verify a spec. Proofs can. Of course, you can combine tests and proofs, for example proofs for correctness, tests to make sure other measures like speed and cost are sane. But if you want to be absolutely sure, you will need to replace all tests by proofs.

Existenceblinks 4y ago
Is it: https://www.commitstrip.com/en/2016/08/25/a-very-comprehensive-and-precise-spec/ https://www.commitstrip.com/en/2016/08/25/a-very-comprehensi...?
- auggierose 4y ago
  Hehehe. Well, the important ingredient missing from this comic strip is proof. You can see proof as code, if you like, but the important thing here is that you can trust the proof generated by an AI without having to look yourself at it. Most people don't understand proof, but if you don't understand proof in 10 years, you will be out of a job as a programmer.
  - Existenceblinks 4y ago
    > if you don't understand proof in 10 years, you will be out of a job as a programmer. No, that's not gonna happen. Can you write a proof of an order for you go to go a fresh market to buy ingredient of a menu I want to cook? "Hey, go buy ingredients for my noodle menu whose result is my taste"
    - auggierose 4y ago
      What? You are going to hire a programmer to do that for you?