3 ms·

How Fast Does the Jetson Nano Run Large Language Models?

• georgeck 2y ago
  > We’re only testing models up to 4b, as larger ones don’t run well on this Jetson. According to spec, this model has 4GB 64-bit LPDDR4 (25.6GB/s) memory