3 ms·

femtoGPT is a pure Rust implementation of a minimal Generative Pretrained Transformer. Everything is implemented from scratch, including the tensor processing

femtoGPT is a pure Rust implementation of a minimal Generative Pretrained Transformer. Everything is implemented from scratch, including the tensor processing logic along with training/inference code of a minimal GPT architecture.

allisdust 3y ago
Thanks for making this. Was searching for a pure rust GPT implementation just the other day!