The "tensor cores" are just like the previous "cuda cores" in that they exist inside each SM along with all the other required machinery like register files, sc

The "tensor cores" are just like the previous "cuda cores" in that they exist inside each SM along with all the other required machinery like register files, schedulers, etc. Volta was the first microarchitecture to have the SM include purpose built tensor cores. Before that, they only contained more general CUDA cores.