2 ms·
GPUs and TPUs are readily available in the cloud. Big institutions have always had massive mainframes or compute clusters, but cloud services have democratised
by jdietrich 8y ago
GPUs and TPUs are readily available in the cloud. Big institutions have always had massive mainframes or compute clusters, but cloud services have democratised access to those resources.
Of course a single Titan RTX can't match the performance of a huge compute cluster, but I can rent a 512 TPU pod with 11.5petaFLOPS of compute and 4TB of HBM for $6.40 per minute. Members of the TensorFlow Research Cloud programme can access TPU pods free of charge.