4 ms·
What’s the cost to use this on a larger scale?
by moneywoes 4y ago
What’s the cost to use this on a larger scale?
- txtai 4y agoEverything in the notebook is open-source. It mainly uses the following projects: https://github.com/neuml/txtai https://github.com/neuml/txtai https://github.com/kuprel/min-dalle https://github.com/kuprel/min-dalle txtai workflows can be containerized and run as a cloud serverless function - https://neuml.github.io/txtai/cloud/ https://neuml.github.io/txtai/cloud/
- wutbrodo 4y agoI assume he meant the computational cost.
- txtai 4y agoOK, I misunderstood there. Running the code, which generates 15 images, on a standard GPU Colab environment takes about 2 minutes. It may be possible to submit a single batch of text summaries to the DALL-E mini model, which would improve performance a good deal.
- fswd 4y agoWe looked into it. At current TPU/GPU prices it's about $.60 to $.30 an image.
- txtai 4y agoWas this a cost just for the DALL-E piece or the full text extraction, summarization and image generation workflow?
- fswd 4y agoJust DALL-E
- txtai 4y agoThanks, good to know.
- KaoruAoiShiho 4y agoDALL-E mini not DALL-E, just making sure everyone has the right expectations.