3 ms·
So what are GPTs missing? I've got: - Falsifiability - am I saying something false? Some products have an output checker, but it's a bolt on at this time for
by csours 3y ago
So what are GPTs missing?
I've got:
- Falsifiability - am I saying something false? Some products have an output checker, but it's a bolt on at this time for unacceptable output, which is not the same thing as falsifying.
- Agency - much ink already spilled
- Context Window size (too small, or need to summarize parts of the context to fit in context window, and know where to go back to for full context)
- Directed Self-Learning (I'm sure there are things like this that people may point out, but some kernel of self-learning isn't there yet)
- chewxy 3y agoThe GPTs are good at interpolative and extrapolative generalization, owing to the manifold of the training data. They can't do abstractive, inductive, abductive generalizations. And those are the more common forms of generalizations that humans can do.