4 ms·
If GPT is fed all the DNA sequencies, it will confidently continue the AGCCTG sequence, but it won't find the inner principles behind such sequencies, it won't
by akomtu 4y ago
If GPT is fed all the DNA sequencies, it will confidently continue the AGCCTG sequence, but it won't find the inner principles behind such sequencies, it won't tell us any interesting revelations about them. Will it even notice the concept of codons? Maybe there is a hidden message creatively encoded in these sequences, but GPT will never notice it. Maybe these DNAs really represent a stellar map on a 10 dimensonal manifold, or some other crazy thing, but GPT will never see it.
That's because GPT doesn't build a mental model to find structure in the data, and there are infinitely many possible models. Dealing with mental models is what I'd call reasoning, and I believe it's solvable with our tech. The source of such models is the upper abstract mind that deals with ideas, and that's a much harder problem to solve. I'd make a guess that this boundary between rational reasoning mind and the upper abstract mind is the boundary between integer and real numbers.