3 ms·
I like the inclusion of both positive and negative examples! Do you have advice for how to measure the quality of the finetuning beyond seeing the loss drop?
by espadrine 3y ago
I like the inclusion of both positive and negative examples!
Do you have advice for how to measure the quality of the finetuning beyond seeing the loss drop?
- raphaelty 3y agoIn the documentation there is an evaluation module with detailed informations. The idea is to gather relevant pairs of queries and documents that are not part of the training set. Then the idea is to measure, using various metrics, how your model can retrieve accurate documents.