3 ms·

This was a great read. It looks like the objective function (which seems to be some measure of "did we increase value" vs did the user tap the notification ) is

• agbell 6y ago
  Thanks! My understanding is they are looking at page management activity and whether it increases above what they would expect if they didn't notify. Some of the details are covered in the paper [1] >The Markov Decision Process (MDP) is based on a sequence of notification candidates for a particular person. The actions here are sending and dropping the notification, and the state describes a set of features about the person and the notification candidate. There are rewards for interactions and activity on Facebook, with a penalty for sending the notification to control the volume of notifications sent. The policy optimizes for the long term value and is able to capture incremental effects of sending the notification by comparing the Q-values of the send and drop action > The training data spans multiple weeks to enable the RL model to capture page admins’ responses and interactions to the notifications with their managed pages over a long term horizon. The accumulated discounted rewards collected in the training allow the model to identify page admins with longterm intent to stay active with the help of being notified. [1] https://arxiv.org/pdf/1811.00260.pdf https://arxiv.org/pdf/1811.00260.pdf