4 ms·

How much RAM was it taking during inference?

• walthamstow 1y ago
  15.4GB during inference according to Activity Monitor
  • alkh 1y ago
    Oh, nice, that's actually not bad at all. Thanks, will give it a try on my 36Gb Mac