You answered yourself in the last sentence. Google's algorithm is designed to maximize their add return not to immediately return what you are searching for. I

You answered yourself in the last sentence. Google's algorithm is designed to maximize their add return not to immediately return what you are searching for. Imagine this use case. User searches for a video that costs Youtube royalty fees and is not monetized. Do you prioritize that in your return results or some other video that makes your business money instead of costing it? Same thing with the Spotify Company playlists and recommendations versus user generated ones. Spotify's seems to include lesser quality, lower royalty songs now even though that is not what I want and it knows it. But unlike Google, I only go to Spotify BECAUSE of the quality of the songs it recommends me. Now that it's priority is first lower royalty songs over songs it things I would like the most I have no incentive to stay.