4 ms·

Sorry for us utter simpletons can someone explain what it do?

• fasterergpes 2y ago
  It makes it so that having more GPUs makes inference run faster. Worst case has been you can only use memory from them and gain no speed at all
  • 456yetdh6r 2y ago
    [flagged]
• qrios 2y ago
  In very simple words: it is one way to reduce the white squares in the picture from @danielhanchen[1]. In more complex words: imagine a processor which is able to process every instruction in 10 clock cycles. But also the processor is able to get new input for this instruction on every clock cycle and starts to process this new input in a pipeline. After the first input you have to wait ten clock cycles. But if you feed the input line every time you will get the output also permanently. In the case of GPUs, it is now not only a topic of a single pipeline, but multiple in parallel. Depends on your data and algorithm it can be thousands in parallel. [1] https://x.com/danielhanchen/status/1894937006352031832 https://x.com/danielhanchen/status/1894937006352031832