3 ms·
why is this? I would have thought that more memory would help up to some point (wherever the entire model can fit in RAM) and then no gains after that. I'd also
by eachro 3y ago
why is this? I would have thought that more memory would help up to some point (wherever the entire model can fit in RAM) and then no gains after that. I'd also have thought that things like accuracy wouldnt be affected.
- brucethemoose2 3y agoEvery model and ecosystem has different compromises, and obviously small models hit diminishing returns quick. But the big models that are in fashion now... GPUs are basically always memory capacity limited to some extent.