One thing to expand upon: This is just the classic formulation of the Multi-Armed Bandit Problem. There are countless variations to the formula which have sligh

One thing to expand upon: This is just the classic formulation of the Multi-Armed Bandit Problem. There are countless variations to the formula which have slightly different underlying assumptions.