3 ms·
Do you run the model locally on your computer or how do you use it as an alternative to ChatGPT?
by bcye 3y ago
Do you run the model locally on your computer or how do you use it as an alternative to ChatGPT?
- Tommstein 3y agochat.lmsys.org has a zillion models you can use.
- lsb 3y agoI can run Mistral 7B, in 3-bit quantization, on my phone, and I get helpful answers for (just today) seeing environment variables in Python.
- AlexAndScripts 3y agoWhat do you use to run it on your phone?
- lsb 3y agoThe iOS app “MLCChat”
- dontupvoteme 3y agoI have a linux box which i run it locally for batch processing, otherwise i just run it through poe (serves as a good comparative website endpoint for differently models i find.)
- bcye 3y agoCan you elaborate what poe is?
- thorum 3y agohttps://huggingface.co/chat https://huggingface.co/chat
- SamPatt 3y agoCheck out LMStudio if you want to try. Open source and quite easy to use, doesn't need a beefy machine.
- bcye 3y agoThank you, it looks really good