3 ms·
Huh. I thought those got projected into the (512) shared CLIP space before getting passed to the conditional blocks.
by kmeisthax 4y ago
Huh. I thought those got projected into the (512) shared CLIP space before getting passed to the conditional blocks.
- minimaxir 4y agoOnly the text portion is included, otherwise that would be big. Also, I am slightly wrong in that the first dimension will many not always be 77, since apparently there is no padding in the tokenizer. Test notebook here: https://colab.research.google.com/drive/192PDIbc2XiI1HgJQSdNpbOlbZh49xygU?usp=sharing https://colab.research.google.com/drive/192PDIbc2XiI1HgJQSdN...
- HammadB 4y agoNope, this is why you cannot use images as prompts without some workarounds! SD doesn’t use the shared CLIP space but the text encoded before projection