4 ms·
Especially since attention -- which the parent commenter says has been diminished by LLMs -- is a key part of cognition.
by timmytokyo 4mo ago
Especially since attention -- which the parent commenter says has been diminished by LLMs -- is a key part of cognition.
- xdavidliu 4mo agoadding to the irony is the fact that the mechanism used by the NN architecture in LLMs is also called attention
- fragmede 4mo agoFor cognition, sure, but that's a fairly weak claim. A dog that chases its tail for 3 hours might be considered conscious, but maybe not highly intelligent. The attention deficit part of ADHD hurts some people, but a high intelligence is able to make up for it in other ways. Attention span is a multiplier for intelligence. Someone with a lower IQ but a longer attention span is able to outperform a higher IQ but shorter attention span, traditionally. What's required though, is the attention span and the memory to really dig deep into a problem, and then go for a run. If AI makes that easier, since it lets you skip the boring parts and get to the meat of the problem, then hey.
- overgard 4mo agoOne thing I'll point out is the attention thing might be more of a lack of motivation on my part. It used to be banging out features quickly gave me a nice dopamine rush and the satisfaction of having built something I'm proud of. With LLMs, I don't really have that feeling because even if I guided it to that endpoint I feel less invested and somewhat less interested.