3 ms·I tried it on my 6GB GPU and got 0.67 tokens per second. Need more than 6GB to run it well.by Dwedit 16d agoI tried it on my 6GB GPU and got 0.67 tokens per second. Need more than 6GB to run it well.