The Jetson TX2 can run GoogLeNet in real-time with the onboard camera, so it's definitely possible on mainstream GPUs too. https://github.com/dusty-nv/jetson-i

The Jetson TX2 can run GoogLeNet in real-time with the onboard camera, so it's definitely possible on mainstream GPUs too. https://github.com/dusty-nv/jetson-inference https://github.com/dusty-nv/jetson-inference Inspecting layer activations in real-time is trickier, but presumably possible.