3 ms·
this was a fun read, thanks for sharing. FYI, the transfers from pageable memory almost certainly do not go to the storage device in your system, unless you ha
by rrss 5y ago
this was a fun read, thanks for sharing.
FYI, the transfers from pageable memory almost certainly do not go to the storage device in your system, unless you have high memory pressure. "pageable" (as a cuda-ism) does mean that the buffer may be paged out to storage, but as a result it means that (more importantly) even if the buffer is in RAM, the GPU cannot access it directly.
so for pageable copies the flow is probably not:
storage → buffer in RAM → device,
but rather:
original buffer in RAM (inaccessible to the device) → intermediate buffer in RAM (accessible to the device) → device.
also, in several places you use the term 'stack' where I think it should just be 'RAM' / main memory.
- brendanrayw 5y agoThanks for reading! I appreciate the feedback and the info, I'll keep that in mind.