5 ms·
Access is limited by the hardware you have access to. Forget about training, just running these models takes a lot of memory.
by postalrat 4y ago
Access is limited by the hardware you have access to. Forget about training, just running these models takes a lot of memory.
- mcbuilder 4y agoAI compute is increasing at a rate faster than Moore's law. Right now if DALL-E 2 takes an 8xA100 box to run inferences, how long before it's on the workstation? 4-5 years?
- deleted 4y ago[deleted]
- selfhoster11 4y agoIt's to be expected. Almost nobody really cared about accelerating AI computations, so I expect that AI chips will be catching up.