I disagree, transfer learning and generalization are hugely powerful and specialized models won't be as good because their limited scope limits their ability to

I disagree, transfer learning and generalization are hugely powerful and specialized models won't be as good because their limited scope limits their ability to generalize and transfer knowledge from one domain to another. I think people who emphasis specialized models are operating under a false assumption that by focusing the model it'll be able to go deeper in that domain. However, the opposite seems to be true. Granted, specialized models like AlphaFold are superior in their domain but I think that'll be less true as models become more capable at general learning.