3 ms·
To be fair, you are talking to a quantized version of the 7b model, while the one that Facebook claims was competitive with / better than GPT-3 is the 13b model
by saurik 4y ago
To be fair, you are talking to a quantized version of the 7b model, while the one that Facebook claims was competitive with / better than GPT-3 is the 13b model (and AFAIK ChatGPT is GPT-3.5, so maybe you should want to focus on 30b+).
- satvikpendem 4y agoI'm trying the 13B one, it's decent, I'd say on par with GPT 3, definitely not 3.5 or 4 yet however. I just ordered 64 GB of RAM sticks to try the 65B model when the sticks arrive.
- dvt 4y agoHow well does it work on DRAM? I thought everyone running heavier models are doing it on GPUs.
- satvikpendem 4y agoAlpaca works entirely off CPU so the models should work fine. I'll try tomorrow and report back.
- BoorishBears 4y agoRecent advances in ML have finally redeemed my decision to building a gaming PC with 64GB of RAM and a 3090 when my most played game was Dolphin Emulator.
- bdsa 4y agoI forgot briefly that Dolphin refers to GameCube/Wii and was very curious about what a "dolphin emulator" would be (and how it would differ from a dolphin simulator)
- lbltavares 4y agoLOL same here
- Magicianx69 4y agoman i only play Minecraft an i didn't bother setting it up to use gpu it friggin runs in cpu. so my gpu is not even woken up from slumber yet
- unshavedyak 4y agoHow are you trying it? Alpaca? Or just straight llama.cpp?
- satvikpendem 4y agoThere's a project called Dalai with a web frontend so you can call npx dalai llama (heh) to get it running. But of course they're all running LLaMA underneath.