4 ms·It runs up to 13b models nicely on a 16g orange pi 5 fyi.by atcalan 3y agoIt runs up to 13b models nicely on a 16g orange pi 5 fyi.