4 ms·

Could it be that Anthropic is using the Chinese characters trick to consume less tokens behind the scenes?

• noddybear 4mo ago
  Aren’t Unicode characters generally treated as 2 tokens to avoid a huge vocabulary?
• winrid 4mo ago
  It used a chinese character instead of the word "true"