3 ms·
What are the differences between a person that is smart and an LLM that seems smart but isn't?
by Mistletoe 10mo ago
What are the differences between a person that is smart and an LLM that seems smart but isn't?
- yakbarber 10mo agoit's in the eye of the beholder
- hibern8 10mo agoThe ability to generate novel ideas.
- bgirard 10mo agoWhat's your definition of a novel idea? How do you measure that? I've had a 15 year+ successful career as a SWE so far. I don't think I've had a single idea so novel that today's LLM could not have come up with it.
- lelanthran 10mo agoI've had plenty. Independent discovery is a real thing, especially with juniors.
- nl 10mo agoWell that's not true - see the Terry Tao article using AlphaEvolve to discover new proofs. Additionally, "novel ideas" isn't something that is included in something that smart people do so why would it be a requirement for AI.
- vjvjvjvjghv 10mo agoHow many people generate novel ideas? When I look around at work, most people basically operate like an LLM. They see what’s being done by others and emulate it.
- tom_ 10mo agoThe LLM is not a person.
- yujzgzc 10mo agoIn my experience, discernment and good judgment. The "generating ideas" capabilities is good. The text summarization capabilities are great. However when it comes to making reasoned choices, it seems like it's losing all abilities, and even worse it will sound grossly overconfident or sycophantic or both.