3 ms·
> . I think even more commercial, for better or for worse, is making a LORA based off alt.sex.stories. Oh, that was being done even before LLaMA. And the opti
by brucethemoose2 3y ago
> . I think even more commercial, for better or for worse, is making a LORA based off alt.sex.stories.
Oh, that was being done even before LLaMA.
And the optimized frameworks are already there, the dots just havent been connected yet.
- fnordpiglet 3y agoYeah I know they’re there - but I think they’re just the beginning of the optimizations. Just working through the stable diffusion code it looked like there were eye watering improvements to make.
- brucethemoose2 3y agoYou should check out the AITemplate SD demo. I don't think its even SOTA, but its the fastest I've tried (and you can use a LORA by baking it into a diffusers model), though its still using the relatively inefficient diffusers implementation. There are some Vulkan implementations too, like SHARK, and MLC's Apache TVM demo.