4 ms·
There's lots of real knowledge encoded in ChatGPT and it can recombine and regurgitate it in enough ways that I'd be okay saying that it knows stuff. The real p
by speed_spread 4y ago
There's lots of real knowledge encoded in ChatGPT and it can recombine and regurgitate it in enough ways that I'd be okay saying that it knows stuff. The real problem is that it doesn't know its limits and will make shit up instead of saying "I don't know". How to reliably detect and enforce these limits probably requires a completely different approach to AI.
- HarHarVeryFunny 4y agoI think ultimately any truly intelligent entity needs to have agency - to be able to interact with the world and test truth (prediction correctness) for itself. Without this you're really just an expert system - a bunch of canned data/rules. The strength of ChatGPT over a GOFAI expert system like Cyc is how broad it's knowledge base is, but the weaknesses are that is doesn't know whether this "knowledge" (being self-deduced from the training set) is true or not, nor does it have any reliable way to combine facts/sources, since those rules are also self-derived and unverified. I'm sure some of this could be mitigated by more human curation (which seems to be the path OpenAI is going down), but then it seems it is just an expert system (maybe this is all people are looking for anyway).