Liger-Kernel support has already been merged to axolotl [0] along with an example config that makes use of it [1], if anyone would like to quickly try it out.

Liger-Kernel support has already been merged to axolotl [0] along with an example config that makes use of it [1], if anyone would like to quickly try it out. [0] https://github.com/axolotl-ai-cloud/axolotl/pull/1861 https://github.com/axolotl-ai-cloud/axolotl/pull/1861 [1] https://github.com/axolotl-ai-cloud/axolotl/blob/main/examples/llama-3/fft-8b-liger-fsdp.yaml https://github.com/axolotl-ai-cloud/axolotl/blob/main/exampl...