The act of discovery is usually associated with "abductive reasoning", i.e. finding a novel pattern in data. Usually people point out that humans are more samp

The act of discovery is usually associated with "abductive reasoning", i.e. finding a novel pattern in data. Usually people point out that humans are more sample efficient: they might notice a novel pattern in a handful of samples, whereas training NN might require take millions. However a claim that LLMs fundamentally cannot do abductive reasoning at all is not warranted - we don't see a clear cut, it just looks like the way LLMs do it is less efficient.