5 ms·
How do you think about running on-prem versus in the cloud? I can see some users preferring the ease and simplicity of using MutableAI in the cloud, but I can s
by rbmattis 5y ago
How do you think about running on-prem versus in the cloud? I can see some users preferring the ease and simplicity of using MutableAI in the cloud, but I can see larger corporations preferring to keep all code in-house. Have you thought about that?
- oshams 5y agoYes, in many cases companies do not feel comfortable with their code leaving their network. This presents an interesting technical challenge as most of the large scale transformer models require large amounts of resources not only to train but even to serve. We DO offer an on-prem version of the product that while requiring a decent GPU, does not exactly require people to go out and buy a fleet of TPUs. I personally think there will be a lot of developments in the efficiency of these models (e.g. DeepMind's RETRO) as well as the usual compute efficiencies always improving. However, I also believe there will always be an incentive to make the models as big as resources allow, because "more is different" as PW Anderson said in his famous essay and I give kudos to the OpenAI team for pushing the limit on these models.
- p1esk 5y agoI'd be interested in on-prem product, otherwise I can't use it with any of the code I develop at work (which is the vast majority of my code). And I work at a small startup, so the price should be reasonable.
- oshams 5y agoWe're in touch. For others interested in on-prem you can email me at omar@mutable.ai. Thanks.