> The same goes for using T5-XXL Is this still true in 2023? Sure, back in the dark ages it seemed like a 860M model is just about the limit for a regular cons

> The same goes for using T5-XXL Is this still true in 2023? Sure, back in the dark ages it seemed like a 860M model is just about the limit for a regular consumer, but I don't see why we wouldn't be able to use quantized encoders; and even 30B LLMs run okay on Macbooks now.