3 ms·
Its not that simple, as A1111 uses the old stability AI implementation while pretty much everything else uses HF diffusers code. I worked trying to add torch.c
by brucethemoose2 3y ago
Its not that simple, as A1111 uses the old stability AI implementation while pretty much everything else uses HF diffusers code.
I worked trying to add torch.compile support to A1111 for a bit, fixing some graph breaks locally, but... It was too much. Some other things, like ML compilation backends, are also basically impossible.
- Filligree 3y agoDo you know what it would take to support longer prompts with HF? The 77-token limit is what's so far stopped me from making the jump.
- brucethemoose2 3y agoIts super easy, in fact I think they specifically have a long prompt pipeline. Look at the implementation in pretty much any diffusers UI (like VoltaML or Invoke) Facebook's AITemplate backend even supports long prompts now.
- emikulic 3y agoWhat benefits does the Huggingface diffusers(?) implementation have over A1111?
- brucethemoose2 3y ago- Compatibility with stuff from research papers and ML compilers since it is the "de facto" SD implementation. - The codebase is cleaner more hackable, and (compared to base SAI code) more performant. - HF continues to put lots of work into optimization and cleanup. For instance, they ensure there are no graph breaks for torch.compile, and work with other hardware vendors for thier own SD implementations.