From the Troubleshooting section on the website linked by the parent: “CPU performance is faster than GPU on your network. Find out if your workload is suffici

From the Troubleshooting section on the website linked by the parent: “CPU performance is faster than GPU on your network. Find out if your workload is sufficient to take advantage of the GPU. On small networks running with small batch sizes, the CPU may perform faster overall due to the overhead related to dispatching computations to the GPU. This will get amortized when the batch or model sizes grow, since the GPU can then take better advantage of the parallelism in performing the computations.”