Definitely. There are techniques that purport to replace traditional PDE solvers (FNOs, LNOs, all sorts of PINNs, ...), but I have yet to see something that can

Definitely. There are techniques that purport to replace traditional PDE solvers (FNOs, LNOs, all sorts of PINNs, ...), but I have yet to see something that can give reasonable predictions of even a second-year grad student level fluid dynamics problem without extensive fine-tuning on an extremely similar problem.