3 ms·

Cpus often have 2 ram channels, you need 2 sticks to get the full memory bandwidth out of the processor. Inference is very memory intensive, so it makes sense

Cpus often have 2 ram channels, you need 2 sticks to get the full memory bandwidth out of the processor. Inference is very memory intensive, so it makes sense that the perf doubled.

aitchnyu 3y ago
What happens to performance if I have an 8 gb (soldered to laptop mainboard) and 32 gb dimm?
- scrlk 3y ago
  It will run in flex mode: 8 GB soldered + 8 GB on the DIMM in dual channel, 16 GB on the DIMM will run in single channel. This is slower than dual channel.
  - aitchnyu 3y ago
    You mean 24 instead of 16 right?
    - scrlk 3y ago
      Whoops - yeah, it's 24 GB in single channel mode.