3 ms·Most people running llama locally are doing CPU inference, period.by whimsicalism 4y agoMost people running llama locally are doing CPU inference, period.