AWS has its own line of AI accelerators called Inferentia that offers reduced cost versus Nvidia, but it's often a pain to make stuff work because everything is

AWS has its own line of AI accelerators called Inferentia that offers reduced cost versus Nvidia, but it's often a pain to make stuff work because everything is written for CUDA. Inferentia team spends a lot of time porting OS models to their hardware for customers to use (e.g. through SageMaker).