4 ms·
How well do we understand the tokenization for Claude? I'd posit that the exact human-representation of this markup is likely irrelevant if it's all being conve
by RandomBK 7mo ago
How well do we understand the tokenization for Claude? I'd posit that the exact human-representation of this markup is likely irrelevant if it's all being converted into a single token.
- PeterStuer 7mo ago"<" ">" and "/>" are indeed single tokens.