2 ms·
I'm trying the 13B one, it's decent, I'd say on par with GPT 3, definitely not 3.5 or 4 yet however. I just ordered 64 GB of RAM sticks to try the 65B model whe
by satvikpendem 4y ago
I'm trying the 13B one, it's decent, I'd say on par with GPT 3, definitely not 3.5 or 4 yet however. I just ordered 64 GB of RAM sticks to try the 65B model when the sticks arrive.
- dvt 4y agoHow well does it work on DRAM? I thought everyone running heavier models are doing it on GPUs.
- satvikpendem 4y agoAlpaca works entirely off CPU so the models should work fine. I'll try tomorrow and report back.
- BoorishBears 4y agoRecent advances in ML have finally redeemed my decision to building a gaming PC with 64GB of RAM and a 3090 when my most played game was Dolphin Emulator.
- bdsa 4y agoI forgot briefly that Dolphin refers to GameCube/Wii and was very curious about what a "dolphin emulator" would be (and how it would differ from a dolphin simulator)
- lbltavares 4y agoLOL same here
- Magicianx69 4y agoman i only play Minecraft an i didn't bother setting it up to use gpu it friggin runs in cpu. so my gpu is not even woken up from slumber yet
- unshavedyak 4y agoHow are you trying it? Alpaca? Or just straight llama.cpp?
- satvikpendem 4y agoThere's a project called Dalai with a web frontend so you can call npx dalai llama (heh) to get it running. But of course they're all running LLaMA underneath.