$$ can be done in a bandit setting, but the key challenge is that your feedback is highly delayed (maybe weeks or months). As the parent poster says, its best

$$ can be done in a bandit setting, but the key challenge is that your feedback is highly delayed (maybe weeks or months). As the parent poster says, its best to focus on individual funnel steps that provide fast feedback, at least initially. Once the whole funnel is optimized (does this ever happen?), you could start feeding in end-to-end $$ metrics.