3 ms·I'd imagine for simplicity - just skip the tokenizer and feed bytes.by vanviegen 1y agoI'd imagine for simplicity - just skip the tokenizer and feed bytes.