It’s a Catch 22. New algorithms stink because conventional hardware stinks at running them and vice versa. Before AlexNet and GPU-optimized kernels, deep learn

It’s a Catch 22. New algorithms stink because conventional hardware stinks at running them and vice versa. Before AlexNet and GPU-optimized kernels, deep learning took too long to train large models, so large models were not used, and other ML methods seemed more promising. I agree a killer product is what you want, but I think the incentives are wrong for a startup to get both algorithms/hardware right before funding runs out. Just getting a working compiler is out of reach of many of these startups.