3 ms·
I tried to run llama-2 (13B) locally for translations. Comparing to gpt-3.5-turbo and gpt-4-0613, which I use a lot, and I tried with several languages that I k
by jwr 3y ago
I tried to run llama-2 (13B) locally for translations. Comparing to gpt-3.5-turbo and gpt-4-0613, which I use a lot, and I tried with several languages that I know.
It is nowhere near usable.
Perhaps the 70B model performs better, but 13B produces translations that are garbage.
- bigcloud1299 3y agoI am doing STT using whisper on my local laptop and recording all the meetings. I am then asking llama and chstgpt to summarize them. ChatGPT does 10x better job. It’s been good to be able to get the main points out of otherwise fuxking boring a. garbage meetings that are at least 30-45 mins long.
- cypress66 3y agoWhat language? 70B English - Spanish is pretty strong. But that's almost surely the best case scenario. And 70B will no doubt be much better.