3 ms·
Notable this isn't even close to realtime. M4 Max.
by refulgentis 9mo ago
Notable this isn't even close to realtime. M4 Max.
- adefa 9mo agoTrue :) After some performance improvements, it is realtime on my DGX Spark with an RTF of .416 -- now getting ~19.5 tokens per second. Check it out, see if it's better for you.