5 ms·
Did these podcasts have transcripts? You might be inadvertently evaluating it on data that it was trained on, which is basically cheating. Even if not, it might
by ma2rten 4y ago
Did these podcasts have transcripts? You might be inadvertently evaluating it on data that it was trained on, which is basically cheating. Even if not, it might be trained on similar podcasts. Judging how good these kinds of models are is really hard.
- WiSaGaN 4y agoTrue. The test should only be done on the material released after the model.
- petercooper 4y agoNo transcripts, no. And recent episodes, within the past couple of weeks, so probably not part of the training either.