That's a fair implementation of custom loss. Hugging Face's Trainer with transformers suggests a similar implementation, although their's has less boilerplate.

That's a fair implementation of custom loss. Hugging Face's Trainer with transformers suggests a similar implementation, although their's has less boilerplate. https://huggingface.co/docs/transformers/main/en/trainer#customize-the-trainer https://huggingface.co/docs/transformers/main/en/trainer#cus...