Yeah, if we're comparing with human abilities at all, LLMs are pretty much just pure intuition- they produce a startling rendition of how I wrote essays the nig

Yeah, if we're comparing with human abilities at all, LLMs are pretty much just pure intuition- they produce a startling rendition of how I wrote essays the night before the due date in college. I suspect that the lack the author is detecting here is decisive judgement calls. This could be an issue with the underlying model, but I suspect that it's just a side effect of the task it's actually performing- predicting the next token. It can kind of only wander into any actual "decision" accidentally, so the result is middle-of-the-road. Not sure what kind of loss function you'd need to get more interesting results though.