The problem is the perverse incentive of the market currents. It doesn't matter how you do it, just make the product work before the competition does (an cheape

The problem is the perverse incentive of the market currents. It doesn't matter how you do it, just make the product work before the competition does (an cheaper). If anything crops up, you'll fix it later. AI promises just that and will act as a negative feedback loop for our understanding of the code. The result is Idiocracy scenario where people are just too dumb to realize that the AI organizing the society is not that intelligent.