4 ms·
The cost has gone way down in the last couple months. With a super-cheap T4 GPU (free in Google Colab), PyTorch 2.0, and the latest diffusers package, you can
by minimaxir 4y ago
The cost has gone way down in the last couple months.
With a super-cheap T4 GPU (free in Google Colab), PyTorch 2.0, and the latest diffusers package, you can now generate batches of 9-10 images in about the same time it took to 4 images when Stable Diffusion was first released. This drastically speeds up the cherry-picking and iteration processes: https://pytorch.org/blog/accelerated-diffusers-pt-20/ https://pytorch.org/blog/accelerated-diffusers-pt-20/
Google Cloud Platform also now has preview access to L4 GPUs, which are 1.5x the cost of a T4 GPU but 3x throughput for Stable diffusion workflows (maybe more given the PyTorch 2.0 improvements for newer architectures), although I haven't tested it: https://cloud.google.com/blog/products/compute/introducing-g2-vms-with-nvidia-l4-gpus https://cloud.google.com/blog/products/compute/introducing-g...
- tough 4y agoWe're minmaxing those costs thanks for the data