3 ms·

Thanks! vLLM for quick set up, TRT-LLM for best performance. Both available on https://baseten.co/ https://baseten.co/.