3 ms·
In very simple words: it is one way to reduce the white squares in the picture from @danielhanchen[1]. In more complex words: imagine a processor which is able
by qrios 2y ago
In very simple words: it is one way to reduce the white squares in the picture from @danielhanchen[1].
In more complex words: imagine a processor which is able to process every instruction in 10 clock cycles. But also the processor is able to get new input for this instruction on every clock cycle and starts to process this new input in a pipeline. After the first input you have to wait ten clock cycles. But if you feed the input line every time you will get the output also permanently.
In the case of GPUs, it is now not only a topic of a single pipeline, but multiple in parallel. Depends on your data and algorithm it can be thousands in parallel.
[1] https://x.com/danielhanchen/status/1894937006352031832 https://x.com/danielhanchen/status/1894937006352031832