What would be the best way to deploy this if you're maximizing for GPU utilization in a multi-user (API) scenario? Structured output support would be a big plus

What would be the best way to deploy this if you're maximizing for GPU utilization in a multi-user (API) scenario? Structured output support would be a big plus. We're working with a GPU-poor organization with very strict data residency requirements, and these models might be exactly what we need. I would normally say VLLM, but the blog post notably does not mention VLLM support.