Yeah, Bert's great, but it has the Google Paper problem in that nobody else can reproduce the results because nobody else has the compute to train the dang thin

Yeah, Bert's great, but it has the Google Paper problem in that nobody else can reproduce the results because nobody else has the compute to train the dang thing. It also doesn't solve the fundamental issues - it scores a few percent higher on some standardized sets, but it gets wrong answers that are just as explainable as any other system - shrug-emoji. ‍️‍️