7 ms·
Isn't the only reason we can do that because we have access to the tokenizer? Do we have the Claude and Gemini tokens? I mean if they didn't publish that, would
by lyu07282 1y ago
Isn't the only reason we can do that because we have access to the tokenizer? Do we have the Claude and Gemini tokens? I mean if they didn't publish that, would it defeat this attack?
- sebzim4500 1y agoI don't think we do, but maybe we could reverse engineer them by using the API to count the tokens in a bunch of strings. I think you can do that for free through both APIs.