3 ms·
3090 TIs should be able to handle it without much in the way of tricks for a "reasonable" (for the HN crowd) price.
by CuriouslyC 2y ago
3090 TIs should be able to handle it without much in the way of tricks for a "reasonable" (for the HN crowd) price.
- fl0id 2y agohigher ram apple silicon should be able to run it too. if they don't use some ancient pytorch version or something.
- phkahler 2y agoWhy not on a CPU with 32 or 64 GB of RAM?
- CuriouslyC 2y agoPerformance, mostly. It'll work but image generation is shitty to do slowly compared to text inference.
- holoduke 2y agoMuch slower memory and limited parallelism. Gpu ÷- 8k pr more cuda cores vs +-16 on regular cpu. Less mem swapping between operations. Gpu much much faster.