4 ms·
Super fast BERT tokenizer. It will save you 100x time in preprocessing text.
by chuah 7y ago
Super fast BERT tokenizer. It will save you 100x time in preprocessing text.
- sergeio76 7y agoMainly it will help improve latency at inference time. For preprocessing training one can always add more threads, but not at inference time.