2 ms·
That's how BERT is trained, masked language modeling
by anuramat 1y ago
That's how BERT is trained, masked language modeling
- dsign 1y agoI've used BERT to do that sort of thing. It was a prototype and I was using Pytorch, also, I'm not an expert on Pytorch performance. I also tried with models that succeeded BERT for masked token. My issue with it is that it was slow :-( . My second issue with it is that it wasn't integrated in my favorite word editor. But definitively useful.
- anuramat 1y agoDid you try any diffusion models? They should be quick enough