Is that more for training or inference use? I realize this isn't always entirely decoupled in certain online learning approaches. I don't work in ML, am certai

Is that more for training or inference use? I realize this isn't always entirely decoupled in certain online learning approaches. I don't work in ML, am certainly not an expert, and am genuinely curious where this space is at now in terms of hardware requirements for SOTA methodologies these days, especially inference phase HW requirements for just running stuff that's out there.