Very much this. Anyone who does machine learning will notice their CPU sitting at 100% of one core a significant fraction of the time. Doesn't matter how fast

Very much this. Anyone who does machine learning will notice their CPU sitting at 100% of one core a significant fraction of the time. Doesn't matter how fast a GPU you have; Python and the GIL is the bottleneck.