3 ms·
I'm working on an open source startup to allow companies to self host OSS AI/LLM models on their own infrastructure, whether through AWS/GCP/Azure/DigitalOcean/
by satvikpendem 4y ago
I'm working on an open source startup to allow companies to self host OSS AI/LLM models on their own infrastructure, whether through AWS/GCP/Azure/DigitalOcean/etc or on their physical servers. I'm fine tuning models with prompts and then I'll build out the API so that users and other developers can query them. This way, you send nothing back to a proprietary service.
Is anyone else interested in something like this?
- jacooper 4y agoAnywhere where we can follow updates on this?
- satvikpendem 4y agoIf you could just email me (in my profile) that'd be great, then I could keep track of people.
- deleted 4y ago[deleted]
- cyrialize 4y agoAbsolutely. I'm just an IC though, so I have no sway. That being said, this is something I've been talking about for a while now with co-workers. Being able to run an LLM on your codebase and query it just for your code would be fantastic!
- satvikpendem 4y agoYep, there are some efforts like this already, I recently posted this: https://news.ycombinator.com/item?id=35226097 https://news.ycombinator.com/item?id=35226097 Albeit, it is using proprietary GPT instead.