The obvious answer is that deciding what to build is difficult, but that rather invites asking whether building lots of stuff at random and throwing it at the w

The obvious answer is that deciding what to build is difficult, but that rather invites asking whether building lots of stuff at random and throwing it at the wall would have a better hit rate than building the right things. Interesting angle is testing where successfully tying a "real program" to one of these AI tools would look a lot like a fuzz tester. Possibly a better one than the current state of the art. Philosophically I'm not hugely worried about automating the wisdom of Wikipedia and Reddit for mass application. Seems more likely to rot than improve itself. But we'll see.