I agree. I also think we have only hit the surface of model efficiencies. Apple's M3 Ultra with RAM up to 512GB shared directly across CPU/GPU/NPUs is a great

I agree. I also think we have only hit the surface of model efficiencies. Apple's M3 Ultra with RAM up to 512GB shared directly across CPU/GPU/NPUs is a great example of an architecture already optimized for local models. I expect Apple will start offering larger RAM sizes for other form factors too. And prices for RAM will drop eventually, because of the extreme demand for RAM with higher densities.