4 ms·In the textgeneration web ui on NVidia gpuby eurekin 3y agoIn the textgeneration web ui on NVidia gpu