I think a lot of people (like OP) seize on the problems with using LLMs for search while ignoring the many things that it can already do more or less flawlessly

I think a lot of people (like OP) seize on the problems with using LLMs for search while ignoring the many things that it can already do more or less flawlessly. - Summarize text: If you paste in a large amount of text, it can almost perfectly deliver a good summary. Imperfections are virtually never hallucinations; they're grammatically oddities. - Create content: As long as you're supplying the underlying facts, LLMs are great at writing blog posts/emails/etc. Intercom just released a feature that allows you to type a response and use AI to change the tone, expand it out, shorten it up, etc. LLMs are fantastic at this. - Search/information retrieval in some categories: Look, we get it, LLMs hallucinate. And of course, as many people point out, you can easily get them to hallucinate by asking specifically odd questions. But the reality is they're still really good at finding a lot of things - recipes are a great example. I've yet to see ChatGPT throw in a bizarre ingredient or omit something critical. I think too much criticism of LLMs inaccurately assume a single use case and throw out the whole concept because they're imperfect for that use case.