3 ms·
Per the paper, in regards to fixing the data set imbalance: > In order to balance our data, we randomly sampled 12,000 non-hits from the Spotify data and creat
by minimaxir 7y ago
Per the paper, in regards to fixing the data set imbalance:
> In order to balance our data, we randomly sampled 12,000 non-hits from the Spotify data and created a new dataset.
This dataset contained approximately 12k non-hits and 12k hits (∼24k tracks total).
Won't a indiscriminate random sampling of the non-hits introduce a temporal sampling bias, as a) music trends change over time and b) music output is not equal across years?
- triggercut 7y agoI was thinking along the same lines but in general. How do you account for the linearity of humans judging against and liking things that we've heard before, excluding the things we haven't heard from the future? Do we trust that SVM/NN account for it somehow? Is there a way to limit corpora or have a point in time training set i.e. only against inputs that precede it. Of course this could just be a fine tuning knob against the other temporal style/fashion trends you would expect in the data-set.