“Builds a training framework which works out of the box”. This is the hard part. Nvidia has built thousands of optimizations into cudnn/cuda. They contribute t

“Builds a training framework which works out of the box”. This is the hard part. Nvidia has built thousands of optimizations into cudnn/cuda. They contribute to all of the major frameworks and perform substantial research internally. It’s very difficult to replicate an ecosystem of hundreds to thousands of individual contributors working across 10+ years. In theory you could use google/AMD offerings for DL, but for unmysterious reasons no one does.