3 ms·
We have vLLM for running text LLMs in production. What is the equivalent for this model?
by xfalcox 10mo ago
We have vLLM for running text LLMs in production. What is the equivalent for this model?
- mh- 10mo agoI would say there's isn't an equivalent. Some people will probably tell you ComfyUI - you can expose workflows via API endpoints and parameterize them. This is how e.g. Krita AI Diffusion uses a ComfyUI backend. For various reasons, I doubt there are any large scale SaaS-style providers operating this in production today.
- salty_frog 10mo agoI'm intrigued by the various reasons why you think there are not any large scale SAAS operating this in production?
- threeebo 10mo agoi dont believe there is a viable use case for large scale AI-generated images as there is for text... except for porn, but many orgs with SAAS capabilities wouldn't touch that
- mh- 10mo agoI was referring to attributes of the ComfyUI software/project, not the idea of serving an image generation API to be clear. There are several of those providers.