3 ms·Orca: A Distributed Serving System for Transformer-Based Generative Models3 points by veryluckyxyz 2y agoumangkeshri 2y agoIs there any comparison of this with VLLm ?