Shared vram is everything of you're running local inference. My 3 x 3090s can't fit the 180b falcon even at 2 bits into vram. But people with a 128gb studio can

Shared vram is everything of you're running local inference. My 3 x 3090s can't fit the 180b falcon even at 2 bits into vram. But people with a 128gb studio can, and it's cheaper