That's the rub though, isn't it? It just exposes the fact that these LLM/generative AI models don't actually know context. ChatGPT doesn't "know" that it's "g

That's the rub though, isn't it? It just exposes the fact that these LLM/generative AI models don't actually know context. ChatGPT doesn't "know" that it's "generat[ing] factual citations" so it doesn't "know" to caution the user. It just knows that when the user prompts like "X", it should respond like "Y". The more information that comes out about how these things respond, the more it seems like ChatGPT shares a lot of traits with Clever Hans.