3 ms·
IT’s lovefest with GPT-3 needs to meet reality now
- PaulHoule 4y agoThis is wrong: ChatGPT has an impressive set of capabilities, but it’s really simply a massive database with an interface that effectively mimics human communications. Think of it as a hyper-powered intranet. It's not a database at all in that it doesn't contain facts, but rather it is a collection of statistics about language that can always make up something to say and sometimes gets things factually right. There is a lot of research on systems that use similar technology that also use ideas from information retrieval. For instance, instead of making up answers off the cuff, it could go look up some sources in a search engine, match them against the query, then summarize them. See https://sbert.net/ https://sbert.net/
- dragonwriter 4y ago> It's not a database at all in that it doesn't contain facts, but rather it is a collection of statistics about language that can always make up something to say and sometimes gets things factually right. Statistics about language are both facts themselves and, to the extent the usage of language in the training data contains text describing facts, also representations of those underlying facts. It is a very different way of storing an accessing data than, say, an RDBMS, but it definitely is a thing which stores and provides access to a body of data.