Yea, I think CoPilot style tools that generate the prompts for you and pipeline the models are going to see wider adoption in the long run. I think this raw cha

Yea, I think CoPilot style tools that generate the prompts for you and pipeline the models are going to see wider adoption in the long run. I think this raw chat UX where you are directly interacting with the model is more of a demo of where we are at with the tech and RLHF rather than something that will have wide applications in the long run. There’s lots of papers on hybrid information retrieval with LLMs that is probably the right strategy for Google rather than a chat bot (which they tried with Google Assistant which was fairly accurate but not very useful). The main issue with these models right now is they are horrible at recalling facts from their training set but incredible at pulling facts from their prompt. Google has the best IR and LLM researchers in the world, they just need a bolder strategy rather than this FOMO strategy.