4 ms·

So if Microsoft/Github ever offers an on-prem version, what will be the advantage of using your product?

sebzim4500 4y ago
Sounds like they'll finetune the model on your existing codebase. Even if Microsoft/Github offers this functionality, it's the kind of thing where it may be worth paying a premium to have good customer support telling you exactly how to make use of this. It's like how there are plenty of people paying for DB software which is 'worse' than mainstream free ones, but they really like the fact they can call experts who will tell them what they are doing wrong with query optimization, etc.
- taptaptoe 4y ago
  Yes! Thanks for elaborating for us! :)
- DeathArrow 4y ago
  >It's like how there are plenty of people paying for DB software which is 'worse' than mainstream free ones, but they really like the fact they can call experts who will tell them what they are doing wrong with query optimization, etc. And for us, poor peasants, there's always going to be stackoverflow.
taptaptoe 4y ago
Another thing is that since Microsoft/Github are working with OpenAI's closed source Codex model, we think it's unlikely they'll offer something on-prem anytime soon since they would have to reveal the model weights, and thus risk a leak (ex. Meta's LLaMA model weights got leaked within a week)
- carlosdp 4y ago
  That is a... very big assumption that I wouldn't put money on. It's become pretty clear that models aren't a moat. If everyone has Codex-class capability (which is already happening), there's no real risk to them deploying on-prem, because the model itself is a commodity.
- nprateem 4y ago
  Models can be watermarked. A sufficiently tight licence and most decent companies won't risk disclosing them.
jacobsenscott 4y ago
At that point you would need to compete on service and price. They'll also get the first mover lock in advantage. Once a large company deploys your product to 5000 devs you are pretty much in for life. /me waves to jira.

Sounds like they'll finetune the model on your existing codebase. Even if Microsoft/Github offers this functionality, it's the kind of thing where it may be worth paying a premium to have good customer support telling you exactly how to make use of this. It's like how there are plenty of people paying for DB software which is 'worse' than mainstream free ones, but they really like the fact they can call experts who will tell them what they are doing wrong with query optimization, etc.

taptaptoe 4y ago
Yes! Thanks for elaborating for us! :)
DeathArrow 4y ago
>It's like how there are plenty of people paying for DB software which is 'worse' than mainstream free ones, but they really like the fact they can call experts who will tell them what they are doing wrong with query optimization, etc. And for us, poor peasants, there's always going to be stackoverflow.

taptaptoe 4y ago

Another thing is that since Microsoft/Github are working with OpenAI's closed source Codex model, we think it's unlikely they'll offer something on-prem anytime soon since they would have to reveal the model weights, and thus risk a leak (ex. Meta's LLaMA model weights got leaked within a week)

carlosdp 4y ago
That is a... very big assumption that I wouldn't put money on. It's become pretty clear that models aren't a moat. If everyone has Codex-class capability (which is already happening), there's no real risk to them deploying on-prem, because the model itself is a commodity.
nprateem 4y ago
Models can be watermarked. A sufficiently tight licence and most decent companies won't risk disclosing them.

jacobsenscott 4y ago

At that point you would need to compete on service and price. They'll also get the first mover lock in advantage. Once a large company deploys your product to 5000 devs you are pretty much in for life. /me waves to jira.