4 ms·

These should keep you busy for months: https://www.gpumode.com/ https://www.gpumode.com/ resources and discord community Book: Programming massively parallel p

These should keep you busy for months: https://www.gpumode.com/ https://www.gpumode.com/ resources and discord community Book: Programming massively parallel processors nvidia cuda docs are very comprehensive too https://github.com/srush/GPU-Puzzles https://github.com/srush/GPU-Puzzles

amelius 1y ago
This follows a "winner takes all" scenario. I see the differences between the submissions are not so large, often smaller than 1%. Kind of pointless to work on this, if you ask me.
- imjonse 1y ago
  the main site is confusing indeed with all those leaderboards, but follow the discord and resources links for the actual learning material.
  - amelius 1y ago
    Thanks, looks interesting indeed.
mdaniel 1y ago
Wowzers, the line noise https://github.com/HazyResearch/ThunderKittens#:~:text=here%E2%80%99s%20an%20example%20of%20what%20a%20simple%20flashattention-2%20kernel%20for%20an%20rtx%204090%20looks%20like%20written%20in%20thunderkittens https://github.com/HazyResearch/ThunderKittens#:~:text=here%...