4 ms·
Really impressive for a 13 year old, and refreshingly honest writeup. The failed self-correction section is the best part: six methods tried, six negative resul
by preetham_rangu 3mo ago
Really impressive for a 13 year old, and refreshingly honest writeup. The failed self-correction section is the best part: six methods tried, six negative results reported instead of buried. That's rarer than the architecture itself. Curious whether the shared+LoRA bidirectionality idea holds up once you run it past 2000 steps.
- farisallafi 3mo agothanks a lot for the support!! yeah for the next training run im planning on testing that out extensively before putting into training