Until now computing was running on a completely different model of implied reliability. The base hardware is supposed to be as reliable as possible, software is

Until now computing was running on a completely different model of implied reliability. The base hardware is supposed to be as reliable as possible, software is supposed to mostly work and bugs are tolerated because they're hard to fix. No one is suggesting they're a good thing. LLMs are more like something that looks like a text only web-browser, but you have no idea if it's producing genius or gibberish. "Just ignore the mistakes, if you can be bothered to check if they're there" is quite the marketing pitch. The biggest development in tech has been the change in culture - from utopian libertarian "Give everyone a bicycle for the mind and watch the joy" to the corporate cynicism of "Collect as much personal information as you can get away with, and use it to modify behaviour, beliefs, and especially spending and voting, to maximise corporate profits and extreme wealth." While the technology has developed, the values have run headlong in the opposite direction. It's questionable if a culture with these values is even capable of creating a singularity without destroying itself first.