3 ms·I'm getting sub 2 second inference on V100 for Flan-UL2(20B)by villgax 3y agoI'm getting sub 2 second inference on V100 for Flan-UL2(20B)