3 ms·What do you run it on?by MacsHeadroom 3y agoWhat do you run it on?brucethemoose2 3y agoA single 3090. I can fit 40K-77K context depending on the severity of the quantization.