3 ms·

Well--given a full copy of the SQLite test suite, I'm pretty sure it'd get there eventually. I agree that most of these show-off projects are just prop pieces,

by 9dev 8mo ago

Well--given a full copy of the SQLite test suite, I'm pretty sure it'd get there eventually. I agree that most of these show-off projects are just prop pieces, but that's kind of the point: Demonstrate it's technically possible to do the thing, not actually doing the thing, because that'd have diminishing returns for the demonstration. Still, the idea of setting a swarm of agents to a task, and, given a suitable test suite, have them build a compliant implementation, is sound in itself.

layer8 8mo ago
If you minimax for passing the SQLite test suite, I’m still not sure you’ll have a viable implementation. You can’t prove soundness of code through a test suite alone.
groundzeros2015 8mo ago
> I'm pretty sure it'd get there eventually. Why? The combinatorics of “just try things until you get it right” makes this impractical.
kevinsync 8mo ago
Sure, but that presumes that you have that test suite written without having a single line of application code written (which, to me, is counterintuitive, unrealistic, and completely insane) SQLite apparently has 2 million tests! If you started only with that and set your agentic swarm against it, and the stars aligned and you ended up with a pristine, clean-room replica that passes everything, other than proof that it could be done, what did you achieve? You stood on the shoulders of giants to build a Bizarro World giant that gets you exactly back to where you began? I'd be more interested in forking SQLite as-is, setting a swarm of agents against it with the looping task to create novel things on top of what already exists, and see what comes out. [0] https://en.wikipedia.org/wiki/SQLite#Development_and_distribution https://en.wikipedia.org/wiki/SQLite#Development_and_distrib...
- mcculley 8mo ago
  You think an implementation of SQLite in another language, with more memory safety, has no value? I agree that this current implementation is not very useful. I would not trust it where I trust SQLite. Regardless, the potential for having agents build clean room implementations of existing systems from existing tests has value.
kyars 8mo ago
agreed!

by 9dev 8mo ago

layer8 8mo ago

If you minimax for passing the SQLite test suite, I’m still not sure you’ll have a viable implementation. You can’t prove soundness of code through a test suite alone.

groundzeros2015 8mo ago

> I'm pretty sure it'd get there eventually. Why? The combinatorics of “just try things until you get it right” makes this impractical.

kevinsync 8mo ago

Sure, but that presumes that you have that test suite written without having a single line of application code written (which, to me, is counterintuitive, unrealistic, and completely insane) SQLite apparently has 2 million tests! If you started only with that and set your agentic swarm against it, and the stars aligned and you ended up with a pristine, clean-room replica that passes everything, other than proof that it could be done, what did you achieve? You stood on the shoulders of giants to build a Bizarro World giant that gets you exactly back to where you began? I'd be more interested in forking SQLite as-is, setting a swarm of agents against it with the looping task to create novel things on top of what already exists, and see what comes out. [0] https://en.wikipedia.org/wiki/SQLite#Development_and_distribution https://en.wikipedia.org/wiki/SQLite#Development_and_distrib...

mcculley 8mo ago
You think an implementation of SQLite in another language, with more memory safety, has no value? I agree that this current implementation is not very useful. I would not trust it where I trust SQLite. Regardless, the potential for having agents build clean room implementations of existing systems from existing tests has value.

kyars 8mo ago

agreed!