Of course it is bad. It got put there because we are in the middle of a hype cycle where everything must use an LLM, and the 'tech leads' pushing it have the e

Of course it is bad. It got put there because we are in the middle of a hype cycle where everything must use an LLM, and the 'tech leads' pushing it have the ear of the decision makers. Any criticism is parried with a 'Oh, this is fixed in the next version of (whatever LLM). They are adding a step that allows them to reason about their own output!'. It's not that everyone believes it will actually improve the product, but it is what the customer wants to see right now. They've read about this revolution, and if their supplier isn't doing something with LLMs right now, they will get left behind. Doing something with an LLM will allow them to hook it into the innovation budget too. So the zealots have free rein for now.