You've been out of the loop, just look at FaceNet, your face in any orientation for a human to recognise is enough for the software to do so as well. Is already

You've been out of the loop, just look at FaceNet, your face in any orientation for a human to recognise is enough for the software to do so as well. Is already open source & doesn't need any manual tuning after it has been trained, also scales excellently.