3 ms·

Does anyone know what hardware inference can run on or memory requirements?

• Mathnerd314 3y ago
  In the repo the model weights file is 9.37GB, whereas sdxl turbo is 13.9GB, and I don't see any mention of huge context windows, so probably it just needs a decent graphics card.
• kouteiheika 3y ago
  It crashes with an out-of-memory error on my 24GB 4090, so at least when it comes to their sample script the answer is "a lot". Maybe it's just an inefficient implementation though.
  • dragonwriter 3y ago
    Pretty much every initial Stability release has been inefficient and has resources drop a lot when optimized for real consumer hardware community engines appeared for running the model. OTOH, with their shift to a less open licensing structure, community tooling probably won’t emerge with the same level of energy.