4 ms·
This model runs in FreeChat for macOS [0] because it's supported by llama.cpp :) You'll just need to download a nice GGUF here: https://huggingface.co/TheBloke
by rgbrgb 3y ago
This model runs in FreeChat for macOS [0] because it's supported by llama.cpp :)
You'll just need to download a nice GGUF here: https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF
[0]: https://github.com/psugihara/FreeChat https://github.com/psugihara/FreeChat
- local_crmdgeon 3y agoThe video recording on the Readme is broken for me on FF/MacOS
- rgbrgb 3y agoThanks for letting me know! I think it broke when I made the repo public this morning. Should be fixed now.
- Patrick_Devine 3y agoalso works w/ `ollama run mistral`.
- stavros 3y agoThanks for that, I didn't see it in the list and thought it wouldn't be available to just run.
- deleted 3y ago[deleted]
- local_crmdgeon 3y agoThis is really nifty, but have you thought about using Electron instead? This will only ever work on Mac, and there's definitely a cross-platform demand for this kind of thing
- rgbrgb 3y agoI did consider Electron but I was interested in learning SwiftUI and trying to figure out how to make it as lightweight as possible. I've done a bunch of react-native in the past and we always hit snags with memory pressure / performance so I wanted to try full native dev. Working in swift/native also leaves open the possibility of using llama.cpp directly rather than via server.cpp as I have it set up now. Might take a crack at an electron version if this one takes off for mac users though. Thanks for taking a look! Here's a solid cross-platform one to check out if you're on windows or linux: https://gpt4all.io/index.html https://gpt4all.io/index.html