I do. But my old laptop 2060 and (sometimes) my 3090 are running on the AI Horde instead: https://lite.koboldai.net/# https://lite.koboldai.net/# I don't real

I do. But my old laptop 2060 and (sometimes) my 3090 are running on the AI Horde instead: https://lite.koboldai.net/# https://lite.koboldai.net/# I don't really see the point in hosting a tiny fraction of raw Falcon 180B or whatever when I can fully host a small finetune, of my choosing, that will perform better for what users actually want (which is mostly RP/Chat at the moment). And I can serve dozens of users on a single 2060 with a Mistral finetune. Now, if it was a finetuning cluster, I would throw my 3090 at it without even blinking, but my understanding is that Petals doesn't finetune yet.