3 ms·
Git
by verdverm 4y ago
Git
- okoma 4y agoWhat structure do you use if you wanted to check the accuracy of an older prompt with an updated or extended data set?
- verdverm 4y agoThis question is slightly different because you have to track a testing set and the metrics. I would look to the many ML workflow tools
- okoma 4y agoThanks for pointing towards the right direction. I'll edit the original question. To rephrase, I am looking for a tool to do model lifecycle management https://github.com/kelvins/awesome-mlops#model-lifecycle https://github.com/kelvins/awesome-mlops#model-lifecycle and wonder if there is any one in particular that you'd think is better suited for prompts, i.e. an array of objects with templated text