3 ms·

Apparently each query requires hundreds of GBs of GPU RAM on several expensive accelerator cards. Is the H100 deployed at Azure? I wonder how much more efficie

by ilaksh 4y ago

Apparently each query requires hundreds of GBs of GPU RAM on several expensive accelerator cards. Is the H100 deployed at Azure? I wonder how much more efficient that would be over A100s.

jejeyyy77 4y ago
Which seems insane considering stable diffusion can run on a M1 MacBook.
- ilaksh 4y ago
  Sure but they are totally different algorithms doing different things.
  - jejeyyy77 4y ago
    We’ll yeah