3 ms·
Yeah. LLaMA-7B can already run on a phone, and mobile RAM/AI compute is scaling pretty well. I dunno if it will be "common," as most companies will keep their
by brucethemoose2 4y ago
Yeah. LLaMA-7B can already run on a phone, and mobile RAM/AI compute is scaling pretty well.
I dunno if it will be "common," as most companies will keep their models and tuning in the cloud. There needs to be a concerted community effort to run stuff locally.