I mean, just looking at OpenAI and Deepmind, they have relatively recently released break-through models for which building upon and extending can be done in re

I mean, just looking at OpenAI and Deepmind, they have relatively recently released break-through models for which building upon and extending can be done in relatively straightforward ways (DALLE 2, GPT-3, AlphaFold, OpenAI Codex, ...etc), so I don't think DL will "decline" any time soon ...