The ALUs are capable of half precision regardless of the tensor cores and aren’t restricted. For “tensor ops” in GeForce cards FP16 with FP32 accumulate is don

The ALUs are capable of half precision regardless of the tensor cores and aren’t restricted. For “tensor ops” in GeForce cards FP16 with FP32 accumulate is done at half rate so you don’t get double the performance which you do get in Quadro and Titan cards using the same die.