4 ms·

Nothing changes in terms of how to make reliable software. You need the same things like unit tests, integration tests, monitoring tools, etc. Basically AI now

by _pdp_ 7mo ago

Nothing changes in terms of how to make reliable software. You need the same things like unit tests, integration tests, monitoring tools, etc. Basically AI now makes every product operate as if it has a vibrant open-source community with hundreds of contributions per day and a small core team with limited capacity.

hrmtst93837 7mo ago
[flagged]
- _pdp_ 7mo ago
  This is no different than receiving PRs from anonymous users on the Internet. Some more successful open source projects are already doing this at scale.
ok123456 7mo ago
Exactly. NO SILVER BULLET.
joshribakoff 7mo ago
While nothing fundamentally changes i have found an increased need for tests and their taxonomies — because the LLM can “hack” the tests. So, having more robust tests with more ways to organize and run the tests. For example instead of 200 tests maybe i have 1,200, along with some lightweight tools to run tests in different parts of the test taxonomies. A more concrete example is maybe you have tests that show you put a highlight on the active item tests that show you don’t put the highlight on the inactive items, but with an llm you might also want to have tests that wait a while and verify the highlight is not flickering on and off overtime (something so absurd you wouldn’t even test for it before AI). The value of these test is in catching areas of the code where things are drifting towards nonsense because humans aren’t reviewing as thoroughly. I don’t think that you can realistically have 100% data coverage and prevent every single bug and not review the code. It’s just that I found that slightly more tests are warranted if you do want to step back.
flykespice 7mo ago
> Nothing changes in terms of how to make reliable software. You need the same things like unit tests, integration tests, monitoring tools, etc. It just changes in terms of doubling the work you have to do in order verify your system rather than you writing the code from scratch, because you have to figure out whatever code your AI agent spitted out before beginning the formal verification process. With you having written the code from scratch, you already know it beforehand and the verification process is more smoother.
2001zhaozhao 7mo ago
> AI now makes every product operate as if it has a vibrant open-source community with hundreds of contributions per day and a small core team with limited capacity. Hmm this is an interesting analogy. It suggests that we could design autonomous AI coding scaffold tools based on the patterns found in open source development communities.

by _pdp_ 7mo ago

hrmtst93837 7mo ago

[flagged]

_pdp_ 7mo ago
This is no different than receiving PRs from anonymous users on the Internet. Some more successful open source projects are already doing this at scale.

ok123456 7mo ago

Exactly. NO SILVER BULLET.

joshribakoff 7mo ago

While nothing fundamentally changes i have found an increased need for tests and their taxonomies — because the LLM can “hack” the tests. So, having more robust tests with more ways to organize and run the tests. For example instead of 200 tests maybe i have 1,200, along with some lightweight tools to run tests in different parts of the test taxonomies. A more concrete example is maybe you have tests that show you put a highlight on the active item tests that show you don’t put the highlight on the inactive items, but with an llm you might also want to have tests that wait a while and verify the highlight is not flickering on and off overtime (something so absurd you wouldn’t even test for it before AI). The value of these test is in catching areas of the code where things are drifting towards nonsense because humans aren’t reviewing as thoroughly. I don’t think that you can realistically have 100% data coverage and prevent every single bug and not review the code. It’s just that I found that slightly more tests are warranted if you do want to step back.

flykespice 7mo ago

> Nothing changes in terms of how to make reliable software. You need the same things like unit tests, integration tests, monitoring tools, etc. It just changes in terms of doubling the work you have to do in order verify your system rather than you writing the code from scratch, because you have to figure out whatever code your AI agent spitted out before beginning the formal verification process. With you having written the code from scratch, you already know it beforehand and the verification process is more smoother.

2001zhaozhao 7mo ago

> AI now makes every product operate as if it has a vibrant open-source community with hundreds of contributions per day and a small core team with limited capacity. Hmm this is an interesting analogy. It suggests that we could design autonomous AI coding scaffold tools based on the patterns found in open source development communities.