3 ms·
As someone who was able to generate a model for production based on BERT that outperformed all our previous attempts, I have to say transformers really are a ga
by ivalm 7y ago
As someone who was able to generate a model for production based on BERT that outperformed all our previous attempts, I have to say transformers really are a game changer. They are not the end all be all, but they are really, really good as being the basis of many different classification tasks.
- hnaccy 7y agoAny tips in terms of taking BERT style model to production?
- ivalm 7y agoTo be honest it was straight forward. We used BERT-base (although maybe albert would be better choice now). We fine tuned on our corpus (took ~1 month on a V100, if you do it in cloud with multiple GPUs would be faster, but we were just playing around/dumped it on one or our ml dev servers). Finally we do inference using a containerized BERT serving https://pypi.org/project/bert-serving-server/ https://pypi.org/project/bert-serving-server/ this output is consumed by some other elements of ml pipeline.