3 ms·
As a positive precedent, OpenAI's Whisper speech recognition is open-source and can be run locally with zero data exposure, https://www.newyorker.com/tech/annal
by walterbell 4y ago
As a positive precedent, OpenAI's Whisper speech recognition is open-source and can be run locally with zero data exposure, https://www.newyorker.com/tech/annals-of-technology/whispers-of-ais-modular-future https://www.newyorker.com/tech/annals-of-technology/whispers...
Some progress with local LLMs: https://arstechnica.com/information-technology/2023/03/you-can-now-run-a-gpt-3-level-ai-model-on-your-laptop-phone-and-raspberry-pi/ https://arstechnica.com/information-technology/2023/03/you-c...
> Things are moving at lightning speed in AI Land. On Friday, a software developer named Georgi Gerganov created a tool called "llama.cpp" that can run Meta's new GPT-3-class AI large language model, LLaMA, locally on a Mac laptop. Soon thereafter, people worked out how to run LLaMA on Windows as well. Then someone showed it running on a Pixel 6 phone, and next came a Raspberry Pi (albeit running very slowly).