4 ms·
It is very nice to see the possibility of self deployment. Does anyone have experience with self deployment of such a large model in a company setting?
by pama 3y ago
It is very nice to see the possibility of self deployment. Does anyone have experience with self deployment of such a large model in a company setting?
- thenaturalist 3y agoNo reference to self-deployable Docker images for large as of now. Only 7B and mixtrail exist. https://docs.mistral.ai/self-deployment/vllm/ https://docs.mistral.ai/self-deployment/vllm/