4 ms·
It does use SIMD (when enabled). But also, the encoding_rs crate is doing more. It isn't just checking for validity. It's also doing transcoding and error detec
by burntsushi 6y ago
It does use SIMD (when enabled). But also, the encoding_rs crate is doing more. It isn't just checking for validity. It's also doing transcoding and error detection.
- kryps 6y agoAs far as I can see it does not use SIMD for UTF8 validation, only likely/unlikely instrinsics, see https://github.com/hsivonen/encoding_rs/blob/e98a2096ab09c9262b2928fa22f7fcec9c7a2a00/src/utf_8.rs https://github.com/hsivonen/encoding_rs/blob/e98a2096ab09c92...
- jfk13 6y agoThat's not the only use of SIMD in the crate (e.g. see https://github.com/hsivonen/encoding_rs/blob/e98a2096ab09c9262b2928fa22f7fcec9c7a2a00/src/simd_funcs.rs https://github.com/hsivonen/encoding_rs/blob/e98a2096ab09c92...), but I haven't looked into exactly where/how it's used further.