4 ms·depends on which model you choose to run. The 7B model can reasonably run with consumer hardware.by swalsh 4y agodepends on which model you choose to run. The 7B model can reasonably run with consumer hardware.