5 ms·
> It has data, it has information, but it has no intuition. Obviously we’re into inexact analogies here, but I would have said the opposite: it doesn’t have da
by wrs 4y ago
> It has data, it has information, but it has no intuition.
Obviously we’re into inexact analogies here, but I would have said the opposite: it doesn’t have data or information because that’s all been compressed into an approximation. Actually, some form of intuition is all it has.
- ravi-delia 4y agoYeah, if we're comparing with human abilities at all, LLMs are pretty much just pure intuition- they produce a startling rendition of how I wrote essays the night before the due date in college. I suspect that the lack the author is detecting here is decisive judgement calls. This could be an issue with the underlying model, but I suspect that it's just a side effect of the task it's actually performing- predicting the next token. It can kind of only wander into any actual "decision" accidentally, so the result is middle-of-the-road. Not sure what kind of loss function you'd need to get more interesting results though.