3 ms·
What are you using to run the Mixtral inference?
by maxlamb 3y ago
What are you using to run the Mixtral inference?
- rexec 3y agoUsing Anyscale Endpoints, cheap and seems stable: https://www.anyscale.com/endpoints https://www.anyscale.com/endpoints