You’re likely to get a few different answers, one of which is some variation on ‘they’re universal function approximations, so of course’. The real answer is:

You’re likely to get a few different answers, one of which is some variation on ‘they’re universal function approximations, so of course’. The real answer is: no one could possibly know at this point. My impression is that very few experts believe that transformers alone will lead to AGI (which surely requires ‘reliable reasoning’), even amongst those who believe we’ll all be intellectually replaceable within a decade.