Wow, I am saddened that I've only now found this post, I wish I had seen it sooner! This article perfectly describes my motivations for building [1] - exactly w

Wow, I am saddened that I've only now found this post, I wish I had seen it sooner! This article perfectly describes my motivations for building [1] - exactly what is described here, although as a smaller toy example [1] https://toldby.ai https://toldby.ai I launched this weekend project in August, but it looks like Gwern's post preceded it in June. There's unfortunately a delicate balance between caching, ranking, and novelty. Caching absolutely helps keeps costs low - no need to regenerate new text for every user. Ranking also helps bring the popular branches to the top. But with naive ranking, the site quickly becomes stale and the same branches always show up. My girlfriend complained that she's bored of the same branches that always appear on the home-page. There needs to be some sort of novelty factor to keep the site fresh. But implementing this would increase costs! Something like per-user ranking is needed to avoid showing the same branches to the same users over and over, but this is currently beyond my level of time commitment :)