Love that there is more accurate pre-trained CLIP model as it is a foundation for Stable Diffusion and many other very important open source models. But, I wou

Love that there is more accurate pre-trained CLIP model as it is a foundation for Stable Diffusion and many other very important open source models. But, I would say that the main issue with CLIP is not performance, but that textual input is limited to 77 characters. This is a severe limitations, if Meta or other company collected the dataset that allowed model with 1024 characters instead it would enrich the word of open source models much more than +2% accuracy. My hope is that next person or company who works on that will invest into longer context size for text input :fingers_crossed: