4 ms·

What infrastructure does it require to test?

• mkaic 3y ago
  Given that the largest model configurations are only on the order of ~1-2B parameters, I think you could probably run inference on a 3090. Training might be possible too (it's something I plan to try) but will be very slow on most consumer hardware.