5 ms·
Combine GPTs with private knowledge for actually useful AIs
- noleary 3y agoCongrats, guys! Love the demos.
- nottorp 3y agoThey could have asked their private GPT to write a text description :)
- manicennui 3y agoI would not allow any company's AI product near my company's private info.
- ForkMeOnTinder 3y agoWhat if it was fully opensource and self-hostable?
- consp 3y agoWouldn't that simply be probitivly expensive?
- blooalien 3y agoOne example that says "no" to your question. -> https://ollama.ai/ https://ollama.ai/ There are surely more. It can be used with something like "LangChain" or "LlamaIndex" to give the locally hosted LLM access to local data, and a bit of Python "glue code" to tie it all together.
- consp 3y agoThat's why it was a question. All I hear is data farms and massive datacenters and those you cannot do at home/small business.
- Casteil 3y agoFor GPT4? Sure.. For small LLMs like Llama2 7B/13B and its derivatives? They can be run quite gracefully on Apple Silicon Macs & similarly capable PC hardware.
- vinni2 3y agoSmaller or even larger Llama models are vastly inferior to GPTs.
- Casteil 3y agoThat's not a big problem with the training/fine-tuning you would do when creating specialized 'local' LLM agents.
- henjodottech 3y agoImagine all the kinds of documentation that could be automated with this
- xcv123 3y agoBut it only works if you have already written all of the documentation manually, and kept that up to date. It's basically a chat bot that knows all of your documentation.
- andrei_says_ 3y agoHow is it better than a good search? Better enough to warrant the potential of hallucinated answers presented as truth?
- fassssst 3y agoGood search requires language models. GPT is a really good language model.
- xcv123 3y agoThe scenario is a customer opens a chat box on your website and asks some questions for the LLM. You wouldn't expect your customers to search your internal Confluence pages. The LLM would be trained on all of your internal documentation which is not exposed publicly. Hallucination is mostly a problem with insufficient training with the current generation of LLMs. Edit: Maybe not "all" of your internal docs should be exposed via LLM. But the idea is this is an interactive support agent for customers.
- semi 3y agothat sounds like a dangerous scenario. If your docs are intentionally internal and not public, why would you let a publicly accessible LLMs answer questions with info from them? An LLM trained on public docs for the public could be a better interface for projects with lots of public documentation. An LLM trained on internal docs only accessible to internal users might be similarly useful Even a private LLM on public docs for your support agents to use could increase their efficiency. But I would never expose an LLM to the public that has been trained on data I don't want public
- j4yav 3y agoAnything currently private that these companies can't access and train their models on is the one valuable competitive advantage you have going for you, giving them access to it for a bit of convenience seems short sighted.
- dreadlordbone 3y agoTheir product is open source and self hosted.
- yjk 3y agoI assumed GP was referring to OpenAI, not danswer (given that they mentioned that those companies were training models). And you're still using OpenAI's API, so neither open source and self hosting affect data collection.
- Weves 3y agoYou can plugin any model of your choice! Self-hosted, open source models are a great choice if you're very concerned about keeping your data safe and secure
- ekianjo 3y ago> Note: On the initial visit, Danswer will prompt for an OpenAI API key. Without this Danswer will be able to provide search functionalities but not direct Question Answering.
- Tostino 3y agoThere are open ai compatible chat/completion endpoints for local LLMs. You point the url to your self hosted version, and use the API key you started it with...
- ekianjo 3y agoI did not know OpenAI made anything open source.
- vinni2 3y agoTo use custom GPTs you need ChatGPT plus subscription. So your customers need to have ChatGPT plus subscription to get support? As far as I know there is no API to integrate custom GPTs into.
- awestroke 3y agoThis is a product that uses the OpenAI API's. You configure it with your OpenAI API key.
- textcortex 3y agoYou can do this without paying to oai: textcortex.com
- antman 3y agoIt does notvsay is the difference between it and a RAG. So how does itvretriwve the "most useful" vs the "most relevant" documents?