3 ms·

You can get a used A100 for that cost and have better software support for training. 4090s are too small for training and you'll have to write your own subopti

You can get a used A100 for that cost and have better software support for training. 4090s are too small for training and you'll have to write your own suboptimal batching. Unless you value the learning, it'd be better to rent GPUs in the cloud for training.

sabareesh 2y ago
Yup my initial reason behind is to learn all the quirks
- echelon 2y ago
  Consumer cards are a very different ecosystem, and you'll hit different use cases and challenges. This might pull you down a path towards distilling and quantizing models, for instance.