I don't understand why that is a bad thing. If your goal is to make an AI assistant, then you should be optimizing for giving answers that real users find usefu

I don't understand why that is a bad thing. If your goal is to make an AI assistant, then you should be optimizing for giving answers that real users find useful, not trying to impress other AI researchers.