I think the point he was making is that while its been proven to correctly do what it was built to do, that may not actually be anything like what the user need

I think the point he was making is that while its been proven to correctly do what it was built to do, that may not actually be anything like what the user needs it to do. How many intricately specified software projects have failed because the spec bore no correlation to user needs?