Yeah, this has been a well known problem in the field for a while now, and not just with DNN approaches https://en.wikipedia.org/wiki/Recommender_system#Reprodu

Yeah, this has been a well known problem in the field for a while now, and not just with DNN approaches https://en.wikipedia.org/wiki/Recommender_system#Reproducibility_crisis https://en.wikipedia.org/wiki/Recommender_system#Reproducibi... These systems almost never work in production. The publications are usually very deceptive.