the RTX 2080ti 11GB model is a little more than 2 times slower than the flagship RTX (12.5it/s vs 28it/s) for torch/diffusion. extrapolate that from what you wi

the RTX 2080ti 11GB model is a little more than 2 times slower than the flagship RTX (12.5it/s vs 28it/s) for torch/diffusion. extrapolate that from what you will. however, CLIP/BLIP and boxes should be much faster than 4 seconds, even on a 2080. I had a python CLIP CSV tag script running in a directory with thousands of images and it was taking <=2 seconds per image on a Geforce GTX 1070 TI, with 8GB of memory - an old card without any tensors. CLIP is much slower than some other mechanisms, for instance a deepbooru classifier is about 4x faster than CLIP/BLIP on my RTX 3060 12GB. CLIP of a random image around your dimensions takes ~4-5 seconds, and deepbooru takes about 1.5 seconds. edit: the additional time is the overhead of the webUI, i am guessing What will probably have to happen is some sort of auto-crop that only forces the model to view a very tiny section of the image. You mentioned you already had a model, was it trained from scratch, or using an existing model?