3 ms·
I've been using small local LLMs for translation recently (<=7GB total vram usage) and they, even the small ones, definitely beat Google Translate in my experie
by gpm 1y ago
I've been using small local LLMs for translation recently (<=7GB total vram usage) and they, even the small ones, definitely beat Google Translate in my experience. And they don't require sharing whatever I'm reading with Google, which is nice.
- yubblegum 1y agoWhat are you using? whisper?
- gpm 1y agoEdit: Huh, didn't know whisper could translate. Just whatever small LLM I have installed as the default for the `llm` command line tool at the time. Currently that's gemma3:4b-it-q8_0 though it's generally been some version of llama in the past. And then this fish shell function (basically a bash alias) function trans llm "Translate \"$argv\" from French to English please" end
- codethief 1y ago> Uh, translation, not transcription Whisper can translate to English (and maybe other languages these days?), too.