I have used both Mistral’s commercial APIs and also AnyScale’s commercial APIs for mixtral-8-7b- both providers are easy to use. I also run a 3 bit quantizatio

I have used both Mistral’s commercial APIs and also AnyScale’s commercial APIs for mixtral-8-7b- both providers are easy to use. I also run a 3 bit quantization of mixtral-8-7b on my M2 Pro 32G memory system and it is fairly quick. It is great having multiple options.