A question for those who've used TensorFlow on NVIDIA GPUs: What range of GPU performance do you see? As in, if the card does 10 TFLOPS peak, does TensorFlow

A question for those who've used TensorFlow on NVIDIA GPUs: What range of GPU performance do you see? As in, if the card does 10 TFLOPS peak, does TensorFlow manage to reach that peak, or is it at 5% or 20% or some other percent of peak typically? And are there expectations for Googles new generation TPU? What range of peak performance do people expect to get?