3 ms·
Do you have any resources to read on how to host LLMs in general? I am looking for scaleable ways to host our own models. Thanks.
by objektif 3y ago
Do you have any resources to read on how to host LLMs in general? I am looking for scaleable ways to host our own models. Thanks.
- speedgoose 3y agoSorry I haven’t followed the latest developments to run at scale since the summer. I don’t have concurrent users so llama.cpp or diffusers are good enough for me.