4 ms·Depends on TTFT and tokens per second you want.by p1esk 5mo agoDepends on TTFT and tokens per second you want.