Bought a second hand GTX 1060 a while ago to play around a bit more serious with neural networks. It's a good balance between being cheap, 6GB of memory but sti

Bought a second hand GTX 1060 a while ago to play around a bit more serious with neural networks. It's a good balance between being cheap, 6GB of memory but still being serious enough to get some work done. If you are a professional researcher or do multiple kaggle's per month, then yes, get the best card. But I suspect a lot of people are one category "below", where a 1060 is sufficient most of the time, and you go to cloud for the actual big workloads. This strategy can keep you going for a couple of years. With models becoming as big as they are, I doubt how much SOTA an RTX 3070 is going to do in 2-3 years. (actually none of these cards come close to GPT-3). By that time you can pick up a second hand RTX 30x and still get the latest offerings in the cloud. Buying second hand GPU comes with a bit of a risk by the way, someone suggested only buying if the price is less than half of the original price (can't remember the link).