3 ms·
I would not allow any company's AI product near my company's private info.
by manicennui 3y ago
I would not allow any company's AI product near my company's private info.
- ForkMeOnTinder 3y agoWhat if it was fully opensource and self-hostable?
- consp 3y agoWouldn't that simply be probitivly expensive?
- blooalien 3y agoOne example that says "no" to your question. -> https://ollama.ai/ https://ollama.ai/ There are surely more. It can be used with something like "LangChain" or "LlamaIndex" to give the locally hosted LLM access to local data, and a bit of Python "glue code" to tie it all together.
- consp 3y agoThat's why it was a question. All I hear is data farms and massive datacenters and those you cannot do at home/small business.
- Casteil 3y agoFor GPT4? Sure.. For small LLMs like Llama2 7B/13B and its derivatives? They can be run quite gracefully on Apple Silicon Macs & similarly capable PC hardware.
- vinni2 3y agoSmaller or even larger Llama models are vastly inferior to GPTs.
- Casteil 3y agoThat's not a big problem with the training/fine-tuning you would do when creating specialized 'local' LLM agents.