4 ms·

Any thoughts on an individual "Here you go, but you're on your own" license? Something like this would be massively beneficial to small IT teams who have the sa

Any thoughts on an individual "Here you go, but you're on your own" license? Something like this would be massively beneficial to small IT teams who have the same inability to send code to OpenAI, but could use the benefit of a smart auto-complete style system like Copilot. They wouldn't necessarily need the custom integration - even small benefits would be seen from an initial core model. Additional integrations could be sold as piecemeal consulting engagements after the fact if need be. Just a thought - there's a vast market out there for organizations with dev teams in the 1-10 person range.

taptaptoe 4y ago
Definitely want to offer this in the future but not currently our ICP. Like rileyphone mentioned, the cost of hosting a model is substantial. Could you please elaborate on why the small IT teams can't send code to OpenAI? We'd love to think more about this!
rileyphone 4y ago
The infra costs are probably minimum $1000/month so it doesn't make sense to target small teams with that overhead yet. I'd expect something open source to appear hear in the next few months, though it might be based on legally iffy LLaMa weights.