4 ms·

Thanks for sharing that. What kind of hardware are you running this on?

• fortyseven 6mo ago
  4090, 128gb of ram (long before you'd have to take out a loan). I'm fairly sure it would run just as fine on a 3090. Thanks to the settings suggestions in the article, I was able to squeeze in the 31b model. Still testing, but it's real tight in 24gb of vram. A bit slower, too, but usable. Not sure I'm seeing much of a quality boost yet, but I'm still testing.
  • hnrodey 6mo ago
    Probably a silly/obvious suggestion but are you using onboard GPU for display out?