3 ms·
For developers, TensorRT support also exists for the diffusers library via community pipelines. [1] It's limited, but if you're only supporting a subset of feat
by hunkins 3y ago
For developers, TensorRT support also exists for the diffusers library via community pipelines. [1] It's limited, but if you're only supporting a subset of features, it can help.
In general, these insane speed boosts come at the cost of bleeding edge features.
[1] https://github.com/huggingface/diffusers/blob/28e8d1f6ec82a60a9b69554d83f02d385b79d1cc/examples/community/stable_diffusion_tensorrt_txt2img.py#L590 https://github.com/huggingface/diffusers/blob/28e8d1f6ec82a6...
- falsedang 3y ago[flagged]