2 ms·You need enough VRAM to hold the whole thing plus context. So probably a bunch of H100s, or MI300s.by snovv_crash 2y agoYou need enough VRAM to hold the whole thing plus context. So probably a bunch of H100s, or MI300s.