7 ms·
Wow! How much did this cost you in GPU credits? And did you consider using your MacBook?
by noahbp 2y ago
Wow! How much did this cost you in GPU credits? And did you consider using your MacBook?
- minimaxir 2y agoIt took 1:17 to encode all ~32k cards using a preemptible L4 GPU on Google Cloud Platform (g2-standard-4) at ~$0.28/hour, costing < $0.01 overall: https://github.com/minimaxir/mtg-embeddings/blob/main/mtg_embeddings_gen.ipynb https://github.com/minimaxir/mtg-embeddings/blob/main/mtg_em... The base ModernBERT uses CUDA tricks not available in MPS, so I suspect it would take much longer. For the 2D UMAP, it took 3:33 because I wanted to do 1 million epochs to be thorough: https://github.com/minimaxir/mtg-embeddings/blob/main/mtg_embeddings_umap_to_2D.ipynb https://github.com/minimaxir/mtg-embeddings/blob/main/mtg_em...