3 ms·
DKSplit – Fast Word Segmentation for Python
- rzk 3mo agoSee also: Instant Segment: fast English word segmentation in Rust –https://github.com/djc/instant-segment https://github.com/djc/instant-segment
- ABTdomain 3mo agoAuthor here. Thanks for the submission. DKSplit tags character boundaries with a BiLSTM-CRF and returns top-k candidates instead of forcing a single split — built for domain names: coinages, transliterations, multilingual strings, not just dictionary words. 9MB int8 ONNX, Python and Go, benchmark data and script in the repo.