4 ms·
You should check out the AITemplate SD demo. I don't think its even SOTA, but its the fastest I've tried (and you can use a LORA by baking it into a diffusers m
by brucethemoose2 3y ago
You should check out the AITemplate SD demo. I don't think its even SOTA, but its the fastest I've tried (and you can use a LORA by baking it into a diffusers model), though its still using the relatively inefficient diffusers implementation.
There are some Vulkan implementations too, like SHARK, and MLC's Apache TVM demo.