5 ms·

Hopefully the 5m wait is due to hitting HN front page! Does this thing scale? How do you donate compute? How do you skip the queue?

avereveard 3y ago
Given the name chances are they are using consumer GPU volunteered to this clustering system https://stablehorde.net/ https://stablehorde.net/
- davely 3y ago
  Yup! It's since been renamed to the AI Horde, but same backend service. https://aihorde.net/ https://aihorde.net/
ThinkBeat 3y ago
I think if you want to skip the queue you use a different service, where that is part of the setup.
- brucethemoose2 3y ago
  Or donate your own GPU time for kudos, which lets you skip the queue! This is what I do. I sometimes run llm inference on my 3090/2060 for the horde, and use the kudos to impulsively generate images on mobile when I need them.
Aeolun 3y ago
Yeah, that’s a long time to wait. I recently started paying for a generation service, and even the +/- 10 second wait for any generation there almost feels like too much.
- brucethemoose2 3y ago
  You can build up Kudos with a Horde worker (aka a cloud or local GPU instance) and build up all the generation time you could ever need very quickly. I love this scheme. It feels like I'm cutting out the middle man, and just paying for the pure inference cost (as well as enjoying the fruits of the pipeline maintainers for free). I also like the idea of "donating" GPU time for those without a inference capable machine.
- davely 3y ago
  I believe that simply registering for an API key on the AI Horde website and ensuring you use that jumps you up past a ton of the queue work. ArtBot visitors generate about 1,100 images an hour and it has only accounted for about 10% of the total traffic the AI Horde is using at any given time (I believe most people are interacting with the AI Horde through Discord chat bots or Telegram).
outofpaper 3y ago
As a long time participant in thr hoard you have three options of you want to jump ahead: get some kudos by rating images, help the hoard by running a server in the cluster, or donate $ and get some kudos as a thank you.
- theturtle32 3y ago
  Source: https://github.com/Haidra-Org/AI-Horde-Worker#ai-horde-worker https://github.com/Haidra-Org/AI-Horde-Worker#ai-horde-worke...
- brucethemoose2 3y ago
  You can also run koboldcpp on a Mac (or pretty much any PC with a small dGPU) to generate kudos running LLMs. The diffusion/llm kudos is interchangeable. Its literally a 1 click download + GUI on Windows, and a nearly zero dependency compile on OSX/Linux, and it takes the same Horde key artbot takes that you can register here: https://aihorde.net/register https://aihorde.net/register
brucethemoose2 3y ago
Certain types of requests (like loras or less common models) can make the queue much longer.

avereveard 3y ago

Given the name chances are they are using consumer GPU volunteered to this clustering system https://stablehorde.net/ https://stablehorde.net/

davely 3y ago
Yup! It's since been renamed to the AI Horde, but same backend service. https://aihorde.net/ https://aihorde.net/

ThinkBeat 3y ago

I think if you want to skip the queue you use a different service, where that is part of the setup.

brucethemoose2 3y ago
Or donate your own GPU time for kudos, which lets you skip the queue! This is what I do. I sometimes run llm inference on my 3090/2060 for the horde, and use the kudos to impulsively generate images on mobile when I need them.

Aeolun 3y ago

Yeah, that’s a long time to wait. I recently started paying for a generation service, and even the +/- 10 second wait for any generation there almost feels like too much.

brucethemoose2 3y ago
You can build up Kudos with a Horde worker (aka a cloud or local GPU instance) and build up all the generation time you could ever need very quickly. I love this scheme. It feels like I'm cutting out the middle man, and just paying for the pure inference cost (as well as enjoying the fruits of the pipeline maintainers for free). I also like the idea of "donating" GPU time for those without a inference capable machine.
davely 3y ago
I believe that simply registering for an API key on the AI Horde website and ensuring you use that jumps you up past a ton of the queue work. ArtBot visitors generate about 1,100 images an hour and it has only accounted for about 10% of the total traffic the AI Horde is using at any given time (I believe most people are interacting with the AI Horde through Discord chat bots or Telegram).

outofpaper 3y ago

As a long time participant in thr hoard you have three options of you want to jump ahead: get some kudos by rating images, help the hoard by running a server in the cluster, or donate $ and get some kudos as a thank you.

theturtle32 3y ago
Source: https://github.com/Haidra-Org/AI-Horde-Worker#ai-horde-worker https://github.com/Haidra-Org/AI-Horde-Worker#ai-horde-worke...
brucethemoose2 3y ago
You can also run koboldcpp on a Mac (or pretty much any PC with a small dGPU) to generate kudos running LLMs. The diffusion/llm kudos is interchangeable. Its literally a 1 click download + GUI on Windows, and a nearly zero dependency compile on OSX/Linux, and it takes the same Horde key artbot takes that you can register here: https://aihorde.net/register https://aihorde.net/register

brucethemoose2 3y ago

Certain types of requests (like loras or less common models) can make the queue much longer.