I thought the big thing with computers is that they are much cheaper than humans. If we are evaluating LLM suitability for tasks typically performed by humans,

I thought the big thing with computers is that they are much cheaper than humans. If we are evaluating LLM suitability for tasks typically performed by humans, we should judge them by the same standards we judge humans. That means it's OK to make mistakes sometimes.