5 ms·
llamafile has amd gpu support. on windows, it only depends on the graphics driver, thanks to our tinyBLAS library. https://github.com/Mozilla-Ocho/llamafile/re
by jart 3y ago
llamafile has amd gpu support. on windows, it only depends on the graphics driver, thanks to our tinyBLAS library.
https://github.com/Mozilla-Ocho/llamafile/releases/tag/0.6.2 https://github.com/Mozilla-Ocho/llamafile/releases/tag/0.6.2
By default it opens a browser tab with a chat gui. You can run it as a cli chatbot like ollama as follows:
https://justine.lol/oneliners/#chat https://justine.lol/oneliners/#chat