I think that would require a huge leap in the abilities of these models. Right now they can't know because afaik they're not working on a corpus of facts they'r

I think that would require a huge leap in the abilities of these models. Right now they can't know because afaik they're not working on a corpus of facts they're just coming up with what the response should look like regardless of the actual facts. Maybe you could make a companion module that pre or post processes the GPT-* outputs to slot in facts using a less AI-y but more accurate knowledge graph system? There are things at google or something like Wolfram Alpha that could provide those inserts perhaps. That's definitely been my big hang up about the usefulness of Bing Chat or ChatGPT for answering questions. If you actually care about the truth of what you're asking you have to go do a lot of the same searching you would have to do to look up the answer in the first place. At best it could provide an idea of what to search when you don't know the language to use to find something, which is often a roadblock for when I'm learning a new system or service.