3 ms·
How is overall throughput on GPU systems? It looks a lot faster than the last time I looked at GPU bus interfaces; how well does this pull in data from externa
by kwillets 9y ago
How is overall throughput on GPU systems? It looks a lot faster than the last time I looked at GPU bus interfaces; how well does this pull in data from external sources?
Viva Peru!
- felipe_aramburu 9y agoDepends on what you mean by throughput. In terms of ram bandwidth on GPU this is very high. PCIE is a different matter. That is still the big limiter on many boxes. Ensuring you have enough cpu pcie lanes to drive all of the graphics cards you want to connect is important. If you are on open power you can use nvlink which is much faster. As far as pulling from external sources we do so using the parquet file format directly or you can ingest csv, json, and xml into our own native file format.
- ben-schaaf 9y agoAMD's EPYC offering (or Ryzen) could help fix some of the PCIE bottlenecking. If I remember correctly the EPYC can have 128 lanes, while XEON is limited to 32.
- felipe_aramburu 9y agoGood Point. I tried to convince someone very recently to go this route so I could piggy back and test on it as well :).