Training a GPT-2 model from scratch on my desktop to learn more about how LLMs work under the hood. Next step is modifying it to be multimodal, and then trying

Training a GPT-2 model from scratch on my desktop to learn more about how LLMs work under the hood. Next step is modifying it to be multimodal, and then trying out diffusion models. Pretty fun project!