Transformers are not CNNs. Neural nets were the second best model for anything since their inception and it is proven mathematically that they can approximate a

Transformers are not CNNs. Neural nets were the second best model for anything since their inception and it is proven mathematically that they can approximate any conceivable function so as long as it’s continuous. The issue at hand is that we have not a foggiest clue as to what it is we’re trying to approximate, so we’re now hoping that we get lucky again, and something will “emerge” somehow. Hope, however, is not a strategy. There’s no guarantee. If Demis believes what he says, he should put up a bet with a nontrivial amount. He won’t do that - he’s not stupid.