3 ms·
I like the use of a tiny device to generate the images. I was wondering whether the energy consumption per image would be lower, but I did the simple maths and
by speedgoose 3y ago
I like the use of a tiny device to generate the images. I was wondering whether the energy consumption per image would be lower, but I did the simple maths and it's not the case.
A raspberry pi zero 2W seems to use about 6W under load (source: https://www.cnx-software.com/2021/12/09/raspberry-pi-zero-2-w-power-consumption/ https://www.cnx-software.com/2021/12/09/raspberry-pi-zero-2-... )
So if it takes 3 hours to generate one picture, that's about 18Wh per image.
A Nvidia Tesla or RTX GPU can generate a similar picture very quickly. Assuming one second per image and 350W under load for the whole system it's in the magnitude of 0.1Wh per image.
Of course we could consider that a raspberry pi zero uses a lot less ressources and energy to be manufactured and transported.
- hadlock 3y agoFor on prem use, the up front cost is a lot lower. The A100 that most serious outfits are using runs in the thousands to tens of thousands of dollars per unit with very limited availability. The pi is typically under $75 usd for any variant.
- speedgoose 3y agoA RTX 4090 has a much better value for stable diffusion but yes if you start to think about cost the pi wins. If you think about availability, I’m not sure.
- hadlock 3y agoThe big immediate plus here, is if you live somewhere with limited access to the internet, you can still generate imagery offline on a low end laptop, like a protest group in far eastern europe or other areas. My personal travel laptop only has 8GB memory so it's exciting to be able to try out an idea even if I don't have high end hardware.
- PeterStuer 3y agoAn RTX 3090 hits the current sweetspot of price/performance for me. Half the throughput of the 4090, but at 1/3rd the cost. (I needed the 24GB VRAM for other LLM projects).
- arvinsim 3y agoIs this brand new or used?
- adventured 3y agoUsed is the only way to get a 3090 for ~$650-$750 (they're not hard to find on eBay in that general price area).
- PeterStuer 3y agoUsed from ebay in my case.
- xtagon 3y agoWould an accelerator such as the Intel Neural Compute Stick 2 work with this? It can be plugged into a Pi, however I'm not clear on how VRAM works on the compute stick or if it's shared with the host?