2 ms·Nope a 4090 can do the 30b-4bit model at 20 tokens/sby jokethrowaway 4y agoNope a 4090 can do the 30b-4bit model at 20 tokens/s