note: Xlnet (successor of BERT) has a pull request allowing FP16 use. And yes it's sad that Google don't prioritize this. More generally, researchers works i

note: Xlnet (successor of BERT) has a pull request allowing FP16 use. And yes it's sad that Google don't prioritize this. More generally, researchers works in isolation, they don't integrate other researchers synergetic ideas...