4 ms·

Take a look at SQLite’s test coverage. It’s impressive: https://sqlite.org/testing.html https://sqlite.org/testing.html 590x the application code

echelon 8mo ago
The fact that AI agents can even build something that purports to be a working database is also impressive. A small, highly experienced team steering Claude might be able to replicate the architecture and test suite reasonably quickly. 1-shotting something that looks this good means that with a few helping hands, small teams can likely accomplish decades of work in mere months. Small teams of senior engineers can probably begin to replicate entire companies worth of product surface area.
- ncruces 8mo ago
  The other day I asked AI to one-shot an implementation of hyperbolic trig functions for double-double floats. I provided a repo (mine) that already implemented double-double arithmetic, trigonometry, and logarithms/exponentials, with plenty of tests. It produced something that looked this good. It had tests, it followed the style of the existing code base, etc. But it was full of shit and outright lies. After I reviewed it to fix deficiencies, I don't think there was anything left of the original. I had much more success the previous week using an AI to rubber duck the algorithms to implement trig. I am incredibly sceptical that just adding more loops — and less critical thinking/review — to brute force through a solution, is a good idea.
  - kyars 8mo ago
    I push back on loops being insufficient because algorithms such as alpha evolve have already proved very effective.
- gf000 8mo ago
  Apologies for the snark, but are you also impressed by `git clone` downloading a repository that is openly available on the internet? It can even do that in a loss-less way, instead of burning a bunch of tokens to get a bad, barely working half-copy. Don't get me wrong, I'm no AI hater, they are an impressive technology. But both AI-deniers and hypers need a reality check.
  - kyars 8mo ago
    I think we are moving into a regime of really fast software iteration, but there could also be a slowing down of progress. Only time will tell
- mos87 8mo ago
  Will this work be of any use tho?
  - kyars 8mo ago
    not initially, but it's the genisis
- kyars 8mo ago
  I believe so
kyars 8mo ago
this project certainly fails against the official sqlite test suite, so I did not bother testing

echelon 8mo ago

The fact that AI agents can even build something that purports to be a working database is also impressive. A small, highly experienced team steering Claude might be able to replicate the architecture and test suite reasonably quickly. 1-shotting something that looks this good means that with a few helping hands, small teams can likely accomplish decades of work in mere months. Small teams of senior engineers can probably begin to replicate entire companies worth of product surface area.

ncruces 8mo ago
The other day I asked AI to one-shot an implementation of hyperbolic trig functions for double-double floats. I provided a repo (mine) that already implemented double-double arithmetic, trigonometry, and logarithms/exponentials, with plenty of tests. It produced something that looked this good. It had tests, it followed the style of the existing code base, etc. But it was full of shit and outright lies. After I reviewed it to fix deficiencies, I don't think there was anything left of the original. I had much more success the previous week using an AI to rubber duck the algorithms to implement trig. I am incredibly sceptical that just adding more loops — and less critical thinking/review — to brute force through a solution, is a good idea.
- kyars 8mo ago
  I push back on loops being insufficient because algorithms such as alpha evolve have already proved very effective.
gf000 8mo ago
Apologies for the snark, but are you also impressed by `git clone` downloading a repository that is openly available on the internet? It can even do that in a loss-less way, instead of burning a bunch of tokens to get a bad, barely working half-copy. Don't get me wrong, I'm no AI hater, they are an impressive technology. But both AI-deniers and hypers need a reality check.
- kyars 8mo ago
  I think we are moving into a regime of really fast software iteration, but there could also be a slowing down of progress. Only time will tell
mos87 8mo ago
Will this work be of any use tho?
- kyars 8mo ago
  not initially, but it's the genisis
kyars 8mo ago
I believe so

kyars 8mo ago

this project certainly fails against the official sqlite test suite, so I did not bother testing