3 ms·
Where can I buy put options to this company? 20x speedup compared to a CPU looks worse than just using a stock GPU, and we haven't talked about the AI inferenc
by xiphias2 7y ago
Where can I buy put options to this company?
20x speedup compared to a CPU looks worse than just using a stock GPU, and we haven't talked about the AI inference chips that are optimized for NN inferencing.
- petra 7y agoGPU's have limited amount of memory.
- proverbialbunny 7y agoBut they can prefetch data. This makes writing code for them a bit more complex, but outside of that the ram limitations are mostly moot. This fails when data needs to be read and written randomly. However, even if the entire dataset was on vram random reads and writes would still be slow, because of the way a stream processor works. All reads and writes need to be laid out in memory in an order for a gpu to do it's best work.