Agreed with the overall point (small models will prove powerful) but I disagree with: > But having more fine-tuned control over model parameters is a pattern t

Agreed with the overall point (small models will prove powerful) but I disagree with: > But having more fine-tuned control over model parameters is a pattern that will emerge This assumes parameters do something interpretable. IMO, it’s more that parameters themselves are meaningless/dumb and patterns evolve via interaction of many such units (like in ants)