3 ms·
openai is expensive (ie, ~$25/mo for a gpt3 davinci IRC bot in a realtively small channel that only gets used heavily a few hours a day) and censored. And I'm n
by superkuh 4y ago
openai is expensive (ie, ~$25/mo for a gpt3 davinci IRC bot in a realtively small channel that only gets used heavily a few hours a day) and censored. And I'm not just talking won't respond to controversial things. Even innocuous topics are blocked. If you try to use gpt3.5-turbo for 10x less cost it is so bad with censoring itself that it can't even pass a turing test. Plus there's the whole data collection and privacy issue.
I just wish these weren't all articles about how to run it on proprietary mac setups. I'm still waiting for the guides on how to run it on a real PC.
- behnamoh 4y ago> I'm still waiting for the guides on how to run it on a real PC. Mac __is__ a real PC.
- deleted 4y ago[deleted]
- lolinder 4y agoThe actual repo's instructions work perfectly without modification under Linux and WSL2: https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp
- superkuh 4y agoThanks! I managed to get this running on CPU/system RAM on Debian 11 pretty easily.
- zirgs 4y agohttps://github.com/oobabooga/text-generation-webui/wiki/LLaMA-model https://github.com/oobabooga/text-generation-webui/wiki/LLaM... Here you go. You'll need a Nvidia GPU with at least 8 GB VRAM though.
- mark_l_watson 4y agoThanks! I have a Linux laptop with 16G ram and a 10G NVidai 1070, so I might be good to go.
- goldenCeasar 4y agoAny examples on running on multiple GPUs?
- miloignis 4y agoThe exact steps that work on a Mac should work on x64 Linux, since the addition of AVX2 support! (Source - I did it last night)