3 ms·
These aren't the "small" models I'm thinking of. I want an LLM, STT, or TTS model to run efficiently on a Raspberry Pi with no GPU and no network. There is hu
by echelon 2y ago
These aren't the "small" models I'm thinking of.
I want an LLM, STT, or TTS model to run efficiently on a Raspberry Pi with no GPU and no network.
There is huge opportunity for LLM-based toys, tools, sensors, and the like. But they need to work sans internet.
- thebiss 2y agoYou may be interested in this tread regarding whisper.cpp on an Rpi4: https://github.com/ggerganov/whisper.cpp/discussions/166 https://github.com/ggerganov/whisper.cpp/discussions/166