4 ms·
lower end GPUs like T4 Alright, nothing to see here. I could really use some kind of filter for stuff that does work with a beefy consumer GPU and stuff that
by DrSiemer 3y ago
lower end GPUs like T4
Alright, nothing to see here.
I could really use some kind of filter for stuff that does work with a beefy consumer GPU and stuff that does not.
- mattnewton 3y agoHmm? A T4 is less powerful than a “beefy consumer gpu” like a 3080.
- sp332 3y agoWe have tested this code on a 16GB Nvidia T4 GPU. The entire inference process uses less than 4GB GPU memory. You don't need 16GB of VRAM for this, it's just what they had available for testing.