I think they left out “fly back” from the “transformer” bit. So no turns ratio. It’s basically an “inductor”. Which might as well be the name for the next itera

I think they left out “fly back” from the “transformer” bit. So no turns ratio. It’s basically an “inductor”. Which might as well be the name for the next iteration for self attention networks.