Maybe a little played-out, but I've been having a blast with the rust-bert library this weekend: https://github.com/guillaume-be/rust-bert https://github.com/gu

Maybe a little played-out, but I've been having a blast with the rust-bert library this weekend: https://github.com/guillaume-be/rust-bert https://github.com/guillaume-be/rust-bert With a little fanagling, you can get the GPT-Neo-1.3b model running on those free Oracle ARM VMs. I'm impressed, especially with the performance of the smallest model that uses less than a gig of memory.