4 ms·
The examples look very promising but the queue time of the huggingface demo is a bit long I actually got a timeout error :(
by isaacfung 3y ago
The examples look very promising but the queue time of the huggingface demo is a bit long I actually got a timeout error :(
- F_AnZzz 3y agoYou can try another demo link besides the huggingface one. It is technically more faster since the frontend is deployed in the same region as backend, which greatly reduce the network communication time.
- isaacfung 3y agoWow, the other link is so much faster. Almost the same speed as the much weaker llava demo on huggingface.