3 ms·
As far as I know you can preload the data in the GPU before processing it. What is the difference/advantage of what you are proposing?
by jorgemf 3y ago
As far as I know you can preload the data in the GPU before processing it. What is the difference/advantage of what you are proposing?
- Filligree 3y agoYou wouldn't need the hardware to support arbitrary load/stores. In particular, you could get rid of (some of) the address lines... I'm unsure if this would be much of a win.
- jorgemf 3y agowell, the data is way smaller than the model (at least the current trend), and you probably still need random access for the weights of the model. I am not sure if it a gain worth to pursue.