3 ms·

GPU's have limited amount of memory.

• proverbialbunny 7y ago
  But they can prefetch data. This makes writing code for them a bit more complex, but outside of that the ram limitations are mostly moot. This fails when data needs to be read and written randomly. However, even if the entire dataset was on vram random reads and writes would still be slow, because of the way a stream processor works. All reads and writes need to be laid out in memory in an order for a gpu to do it's best work.