4 ms·
Often the limiting factor is memory bandwidth instead of raw FLOPS, so dealing with 4 times larger data types (FP64 vs FP16) is a disadvantage.
by johndough 4y ago
Often the limiting factor is memory bandwidth instead of raw FLOPS, so dealing with 4 times larger data types (FP64 vs FP16) is a disadvantage.
- brrrrrm 4y agoto clarify: I am comparing FP16 performance, which both the GPU and AMX have native support for. FP64 is also supported by AMX, making it quite an impressive region of silicon.