3 ms·
Is there any hope that if chat bots do actually become widespread in usage that eventually we'll be able to aggregate their collective knowledge similar to rein
by flaviuspopan 10y ago
Is there any hope that if chat bots do actually become widespread in usage that eventually we'll be able to aggregate their collective knowledge similar to reinforcement learning for a single system? That seems like the only likely way we'll ever be able to train AI in something as complex as language.
- Practicality 10y agoThe primary issue is that language doesn't have as well of a defined "success" metric. So more data doesn't necessarily make better language. Without a human analyzing the transcripts it's very difficult for the chat bots to know which inputs it's receiving are "good" or "better." Even the idea of good language is subjective. We all know there is such a thing, but nearly everyone has different ideas of what this is.
- dmreedy 10y agoIt depends on what the nature of language is. If it is purely a tool of consciousness, a separate module in mind like basic image recognition seems to be, then the picture you're painting may be possible. It may be that the language signal is strong enough to pick up just by looking at orders of magnitude more examples than we can right now. That we can crack the encryption, so to speak. However, if language is more integral than that. If language is more a facet of intelligence than a building block. If language is the structure of sentience, rather than something sentience leverages, then no, all the chat bots in the world won't help. We need something that can integrate more than just plain text embeddings of incredibly intricate and complex structures. We can't crack this code without a key. My guess is that this latter scenario is the likely case.