2 ms·
There's no training code because the author is using an external service for that https://docs.primeintellect.ai/hosted-training/getting-started https://docs.pr
by yorwba 5mo ago
There's no training code because the author is using an external service for that https://docs.primeintellect.ai/hosted-training/getting-started https://docs.primeintellect.ai/hosted-training/getting-start... The reward function is https://github.com/HarleyCoops/Math-To-Manim/blob/d1c412d22a676c9413cf7d7d2e012f6c70ad37d6/environments/math_to_manim/m2m2_visual_repair/scoring.py#L73 https://github.com/HarleyCoops/Math-To-Manim/blob/d1c412d22a... The environment is iterative LLM prompting.
The idea is apparently that a model that is bad at fixing its own mistakes might become better if you train it on this task using reinforcement learning.