4 ms·
Reminds me of this, from a couple months ago. https://news.ycombinator.com/item?id=41203475 https://news.ycombinator.com/item?id=41203475
by saurik 2y ago
Reminds me of this, from a couple months ago.
https://news.ycombinator.com/item?id=41203475 https://news.ycombinator.com/item?id=41203475
- friedtofu 2y agoWas going to post a reference to the same thing! Not sure about you but I tested it, and I'm not sure if it was just being hugged to death when I used it or not, but the network performance was incredibly poor. Having something that you can self-host, as a user I find this really neat but what I really want is something more like https://github.com/city96/ComfyUI_NetDist https://github.com/city96/ComfyUI_NetDist + OP's project mashed together. Say I'm almost able to execute a workflow that would normally require ~16Gb VRAM. I have a nvidia 3060 12Gb running headless with prime/executing the workflow via the CLI. Right now, I'd probably just have to run the workflow in a paperspace(or any other cloud compute) container, or borrow the power of a local apple M1 when using the second repository I mentioned. I wish I had something that could lend me extra resources and temporarily act as either the host GPU or a secondary depending on the memory needed, only when I needed it(if that makes sense)