Given that the largest model configurations are only on the order of ~1-2B parameters, I think you could probably run inference on a 3090. Training might be pos

Given that the largest model configurations are only on the order of ~1-2B parameters, I think you could probably run inference on a 3090. Training might be possible too (it's something I plan to try) but will be very slow on most consumer hardware.