3 ms·

Not a complete answer to your question but you may find this discussion interesting: https://github.com/lucidrains/DALLE2-pytorch/discussions/10 https://github

by axg11 4y ago

Not a complete answer to your question but you may find this discussion interesting: https://github.com/lucidrains/DALLE2-pytorch/discussions/10 https://github.com/lucidrains/DALLE2-pytorch/discussions/10 Inference cost and scale seems to be much more favourable than large language models (for now).

Sebb767 4y ago
In case anyone else is put off by the link referencing an answer that then links to something else with most likely higher hardware requirements that are not stated, the end of the rabbit hole seems to be here: https://github.com/openai/dalle-2-preview/issues/6#issuecomment-1100494083 https://github.com/openai/dalle-2-preview/issues/6#issuecomm... TL;DR: A single NVidia A100 is most likely sufficient; with a lot of optimization and stepwise execution a single 3090 Ti might also be within the realm of possibility.