2 ms·
Show HN: Llm.f90 fast, hackable transformer implementation in Fortran
I submitted an earlier version of this a few months ago (as llama2.f90). At that time it had a lot of steps to run and was just a toy, now it's easy to run and is a competitive option for llm inference. See the motivation section for discussion and the `Performance` issue for an ongoing discussion about performance.
- tnecniv 3y agoDoes Fortran have decent auto diff tools? You now got me wondering if I should switch from using Python for my numerical work to Fortran for my own enjoyment
- andy99 3y agoShort answer is no. I found a couple threads on it: https://fortran-lang.discourse.group/t/automatic-differentiation-of-fortran-code-opinions/369 https://fortran-lang.discourse.group/t/automatic-differentia... https://fortran-lang.discourse.group/t/automatic-differentiation-built-into-lfortran/3198/3 https://fortran-lang.discourse.group/t/automatic-differentia... This is actually something I'm very interested in. What kind of a use case do you have? Is it general model training or something else?