Apple's first published ML paper[1] described how they trained a neural network to estimate eye gaze. To augment the limited data set of labeled eye photos, the

Apple's first published ML paper[1] described how they trained a neural network to estimate eye gaze. To augment the limited data set of labeled eye photos, they rendered synthetic eyes and then used adversarial training to make them match the real-life data set. This paper came out several months before the iPhone X introduced Face ID with eye gaze tracking, so it can be seen as a hint of things that were to come. What's intriguing to me is that the paper also talks about doing the same with synthetic depth maps of hands, adding details such as occlusion and imperfectly-captured edges. With Apple investing heavily in ARKit, and rumors of an AR headset, it seems like hand tracking is inevitable. 1: https://arxiv.org/abs/1612.07828 https://arxiv.org/abs/1612.07828