Theoretically some people think RAG sounds more feasible to make factually accurate. After all, if you've trained an LLM on a masses of unchecked data you've s

Theoretically some people think RAG sounds more feasible to make factually accurate. After all, if you've trained an LLM on a masses of unchecked data you've scraped from the internet, your training data probably includes "Joe Biden is the president" and "Donald Trump is the president" and "Barrack Obama is the president" and "Emmanuel Macron est le président" and so on. It would be understandable if an LLM was confused about who the president was. These people think handing an LLM the contents of https://en.wikipedia.org/wiki/President_of_the_United_States https://en.wikipedia.org/wiki/President_of_the_United_States then asking who the president is sounds a lot more feasible. Personally I'm not so sure - I've never seen a RAG implementation that impressed me.