> ... we could be running models than handily beat GPT-4 on consumer hardware, The implication there is that consumer hardware will have more and faster RAM th

> ... we could be running models than handily beat GPT-4 on consumer hardware, The implication there is that consumer hardware will have more and faster RAM than the current defaults. AI features are going to probably require more than the 8gb minimum that macbook airs have. Sure mistral 7b can fit, but I think generally useful models start at 32B, and mixtral 8x7B still is short of GPT-4. Mixtral requires about 28GB 4bit quantised. It will be interesting to see if llama etc drive a step up in consumer hardware defaults, but always connected to cloud and paying a subscription for cloud services is the trend with commercial offerings.