4 ms·
Just tried it right now and it seemed kind of like a human to me. Also ran Guanaco 13B locally on my M1 Pro today and it ran pretty smooth. I’m planning to us
by r_singh 3y ago
Just tried it right now and it seemed kind of like a human to me.
Also ran Guanaco 13B locally on my M1 Pro today and it ran pretty smooth.
I’m planning to use it for text extraction on a large amount of data. Let’s see how versatile LLMs can get and whether they can replace some of the NLP tech I was using before.
- rootusrootus 3y agoThe recent update to llama.cpp to support Apple Silicon (at least for Q4_0 models) is really great. I can run pretty big models on my macbook now with decent performance, and smaller 13B models just fly. The ability to get a lot of GPU-accessible RAM is perfect.