3 ms·
What are your thoughts on longetivity, i.e. depending on your service over time? Do you have any public commitments in that regard? Being able to run your app
by jlundberg 1y ago
What are your thoughts on longetivity, i.e. depending on your service over time?
Do you have any public commitments in that regard?
Being able to run your application forever is one of the strong benefits I see with local models, besides being able to feed it with sensitive data.
- gsandahl 1y agoWe have been thinking a bit about this, and one option would be to have some form of locally hosted runner. You can optimize the task in the cloud and deploy it locally. Something like that. It is possible to plug in custom models so technically feasible.