4 ms·
+1 for Llamafile. They just released a new release and it supports Deepseek R1 models. I have a blank Llamafile and load models into it using a .bat file that I
by archerx 2y ago
+1 for Llamafile. They just released a new release and it supports Deepseek R1 models. I have a blank Llamafile and load models into it using a .bat file that I edit as needed. I have a custom webui that I made that lets me save and organize my sessions.
Whisperfile is also amazing. I used it to transcribe a podcast I hosted 20 years ago and it was fast and the errors it made were acceptable.