4 ms·
Traditional low end GPUs used regular DDR3 or DDR2 for cheapness. The low end GPU market has become non-existent today. At a minimum, every GPU, even the cheap
by dragontamer 3y ago
Traditional low end GPUs used regular DDR3 or DDR2 for cheapness.
The low end GPU market has become non-existent today. At a minimum, every GPU, even the cheapest, has large amounts of specialized high bandwidth RAM.
- rbanffy 3y agoOTOH, there might be a niche for a GPU that has a lower bandwidth access to a larger pool of memory, because inference might consume a lot of data and not that much number crunching.
- dragontamer 3y agoThat's called a CPU with AVX512. Modern EPYCs can give 2TFlops or more while physically connected to 2TB of RAM.
- rbanffy 3y agoWould be if we could have many hundreds of cores doing AVX512. We can, on the very high end.
- deleted 3y ago[deleted]