Expensive in general but combine some decent tooling and spot instances and it can be insanely cheap. The latest Nvidia L4 GPUs (24GB) instances are currently

Expensive in general but combine some decent tooling and spot instances and it can be insanely cheap. The latest Nvidia L4 GPUs (24GB) instances are currently less than 15c p/h spot. T4s are around 20c per hour spot, though they are smaller and slower. I've been provisioning hundreds of these at a time to do large batch jobs at a fraction of the price of commercial solutions (i.e. 10-100x cheaper). Any problem that fits in a smaller GPU and can be expressed as a batch job using spot instances can be done very cheaply on AWS.