4 ms·
How long does it take to generate a single image? Is it in the 30 min type range or a few mins? It's hypothetically "possible" to run e.g. OPT175B on a consumer
by amilios 4y ago
How long does it take to generate a single image? Is it in the 30 min type range or a few mins? It's hypothetically "possible" to run e.g. OPT175B on a consumer GPU via Huggingface Accelerate, but in practice it takes like 30 mins to generate a single token.
- lostmsu 4y agoI was able to run YaLM 100B in about 5min per iteration, NVMe being the bottleneck.
- LanternLight83 4y agoRuns on my 2070S at 12s/image (no batch optimization) and on my GTX1050 4GB at 90s/image
- holoduke 4y agoOn my late 2019 intel macbook pro with 32gb and a AMD 5550m it takes about 7-10 minutes to generate an image.
- Gigachad 4y agoI'm using a 2021 Macbook Pro with the base tier M1 Pro and it generates images in about 1 minutes per image.
- Birch-san 4y agoAbout 10 secs per image on M1 Max with the right noise schedule and sampler. https://twitter.com/Birchlabs/status/1565029734865584143?s=20&t=TnE7e1OhBG-GF1HYZ3GNrQ https://twitter.com/Birchlabs/status/1565029734865584143?s=2...