Oddly, I think the problem in general is with the LLM itself. We are still in the hype stage but we need to get to a better stage where the LLM is smart enough

Oddly, I think the problem in general is with the LLM itself. We are still in the hype stage but we need to get to a better stage where the LLM is smart enough to understand and switch context, search and retrieve from the right place. Ultimately what we're trying to do right now is help the LLM do something it should already be capable of. Ironically I think google already has the right idea. Remember when we use to have to use "+" in our searches and "and or"? It's gotten "smarter" over the years and the user literally just writes a conversational query and google just returns results. That's where we need to go. Side note, I think this is one of the reasons they'll be a heavy hitter in the ML/AI space. because they're already doing this. It was just a business decision to not release their own GPT.