3 ms·
This is really cool! Do you have any of the pipeline code available that you used for training? I am curious about how you created the reward model. I love litt
by kamranjon 1y ago
This is really cool! Do you have any of the pipeline code available that you used for training? I am curious about how you created the reward model. I love little projects like this, thanks for sharing. I've been fine-tuning on my mac and an interested in getting into GRPO, which I haven't tried yet.
- deepsquirrelnet 1y agoI put my scripts up in github. It’s a bit scrapped together at the moment — but fine as a reference. https://github.com/dleemiller/PennyLM https://github.com/dleemiller/PennyLM