3 ms·
We have successfully tested the model with vLLM and plan to release it across multiple inference server frameworks, including vLLM and OLAMA.
by vlmrunadmin007 2y ago
We have successfully tested the model with vLLM and plan to release it across multiple inference server frameworks, including vLLM and OLAMA.