5 ms·
Well here is a comment on 4090 https://github.com/karpathy/llm.c/discussions/481#discussioncomment-9585564 https://github.com/karpathy/llm.c/discussions/481#dis
by sabareesh 2y ago
Well here is a comment on 4090 https://github.com/karpathy/llm.c/discussions/481#discussioncomment-9585564 https://github.com/karpathy/llm.c/discussions/481#discussion...
- huac 2y ago25% MFU :( maybe because of the P2P nerf?
- anthonix1 2y agoMaybe get a 7900 XTX. 122 TFLOPS of BF16/FP16 for less than $1k and I'm getting 55.4% MFU
- sabareesh 2y agoThese are not apples to apple comparison, as this is running across GPU and much bigger model
- sabareesh 2y agoThis much bigger model (500M), P2P is enabled via Mailbox. It is expected because of memory to compute ratio
- huac 2y agocan you elaborate?