You can use an LLM as an interface only. Works very well when using a vector db and apis as you can easily send context/rbac stuff to it. I mentioned it befor

You can use an LLM as an interface only. Works very well when using a vector db and apis as you can easily send context/rbac stuff to it. I mentioned it before but I'm not impressed that much from LLM as a form of knowledge database but much more as an interface. The term os was used here a few days back and I like that too. I actually used chatgpt just an hour ago and interesting enough it converted my query into a bing search and responded coherent with the right information. This worked tremendously well, I'm not even sure why it did this. I asked specifically about an open source project and prev it just knew the API spec and docs.