3 ms·
Being in the ML space myself I can tell you that memory is pretty important. With my current workload (vision tasks) it is my largest constraint. That said, ru
by godelski 6y ago
Being in the ML space myself I can tell you that memory is pretty important. With my current workload (vision tasks) it is my largest constraint.
That said, rumor has it that they will announce a 20Gb 3080 later.
- abledon 6y agoand its a 20gb with the ability to do FP16 right? So theoritcally lots of the models can actually be 40gb?
- atty 6y agoWell, they can be 40 GB fp32 models technically, but translating a model trained in fp32 to fp16 is not trivial (trust me, we’re working on this right now for a model). But remember that training the model requires a lot more memory than just the model parameters, because you need to store the gradients as well.