4 ms·
Can you elaborate, are those workflows in queue or can they serve multiple users in parallel ? I think it’s super interesting to know real life workflows and p
by alfonsodev 2y ago
Can you elaborate, are those workflows in queue or can they serve multiple users in parallel ?
I think it’s super interesting to know real life workflows and performance of different LLMs and hardware, in case you can direct me to other resources.
Thanks !
- garciasn 2y agoOur use case is atypical, based on what others seem to require. While we serve multiple requests in parallel, our workloads are not 'chat'.