3 ms·
What structure do you use if you wanted to check the accuracy of an older prompt with an updated or extended data set?
by okoma 4y ago
What structure do you use if you wanted to check the accuracy of an older prompt with an updated or extended data set?
- verdverm 4y agoThis question is slightly different because you have to track a testing set and the metrics. I would look to the many ML workflow tools
- okoma 4y agoThanks for pointing towards the right direction. I'll edit the original question. To rephrase, I am looking for a tool to do model lifecycle management https://github.com/kelvins/awesome-mlops#model-lifecycle https://github.com/kelvins/awesome-mlops#model-lifecycle and wonder if there is any one in particular that you'd think is better suited for prompts, i.e. an array of objects with templated text