3 ms·

Even worse, I have the MBP with the 750M GPU (which I believe is the fastest CUDA card in any MBP) and the models and batch sizes that do fit in memory are not

Even worse, I have the MBP with the 750M GPU (which I believe is the fastest CUDA card in any MBP) and the models and batch sizes that do fit in memory are not particularly faster than on the CPU, because they can't fully exploit the huge parallelism. 2 GB memory sounds like a lot until you realize that a large part of it is already being used for, you know, graphics. It's possible to get the full 700 GFLOPS out of the gpu (versus ~300 for the cpu), but with most of my models (many layers etc) I get about 200 GFLOPS. Even so, it can be handy to offload the cpu for other tasks while it's running.

ansible 10y ago
On some Windows & Linux machines that have an Intel mobile CPU and a discrete graphics chip, it is possible to switch the display to the Intel GPU. Is something like that possible on a MBP?
cr0sh 10y ago
> 2 GB memory sounds like a lot until you realize that a large part of it is already being used for, you know, graphics. That's strange? Got a screenshot or something showing that? I have a GTX 750 ti SC (which I think is close to the 750M?) with 2 GB - I use it on my Ubuntu 14.04 LTS box. nvidia-smi reports that only about 200 MB of the 2 GB is used for for the graphics sub-system (I have a dual-head setup, too). Maybe the MBP uses more of the memory? I dunno (my MBP here has Intel unfortunately)... I know that training models on it is much faster than using the quad-core AMD chip (can't remember which one it is - but nothing recent); still, I have hit up against the memory limits, and at that point batching or other methods are needed to get larger stuff thru it, at a penalty of speed. I really need to drop something better in there...