3 ms·
1. We can and do disallow sharing of client and company data with third party LLMs by policy and, yes, we can ‘force’ them to use our product capabilities. 2.
by garciasn 3y ago
1. We can and do disallow sharing of client and company data with third party LLMs by policy and, yes, we can ‘force’ them to use our product capabilities.
2. We tested 13 and 30b parameter pretrained LLMs and found them “good enough” within the confines of the original scope.
That said, we are expanding the use cases and with that comes the need for increasing levels of quality. This is where the self-training comes in.
We’re fairly confident it’ll meet our needs for now.
- weinzierl 3y agoThanks for your answer. I think I have to research this further. I disagree with your point about forcing your employees. Everyone has GPT as a comparison, if the internal solution is a little bit worse it might fly. If it is too bad people will not put up with it and if you force them they will either ignore the internal solution or leave. EDIT: Or in the worst case ignore the policy and get fired.
- garciasn 3y agoGetting fired could be the least of their concerns depending on the nature of the data shared with third parties.
- weinzierl 3y agoI think a good example is Microsoft Source Safe. Microsoft had the strongest incentive to use their own product internally and yet even a company this size could not resist the pressure in the long run to use a marginally better product. We will see how this turns out with LLMs and while I wish companies were more concerned about what data they share with third parties my experience is that apart from military/intelligence related data everything can and will be outsourced.