3 ms·
I m hoping chatbots will end up small enough they can run locally, everywhere. This is a lot of private data. It may be doable - a chatbot with a lot of plugin
by seydor 4y ago
I m hoping chatbots will end up small enough they can run locally, everywhere. This is a lot of private data.
It may be doable - a chatbot with a lot of plugins does not need to know a lot of facts, just to have a good grasp of language. It can fetch its factual answers from the wikipedia plugin
- wahnfrieden 4y agoopenai wants to gatekeep access and use of their AI. so why would they ever release a local LLM? i think that would come from their enemies
- seydor 4y agothey wouldn't ; i hope there will be an open source alternative. Firefox and chrome are open source
- thanzex 4y agoI mean, GPT3 requires some 800GB of memory to run, do we all have gazillion dollars supercomputers at home? I think, unless there's some real breaktrough in the field or in the hw acceleration, this kind of model is going to stay locked behind a pricy API for quite some time.
- int_19h 4y agoGPT-3.5 requires less. And neither model is considered size-optimal. It's just that with Microsoft's money, it's easier for OpenAI to move fast by throwing said money at more hardware rather than trying to optimize for size. And yeah, I wouldn't expect them to share any model that is competitive with their current offering. But it can leak, and the copyright situation around that is very unclear at the moment.