3 ms·
> Special shout out to Google who to this date seem to not support tool call streaming which is extremely Google. Google doesn't even provide a tokenizer to co
by msp26 8mo ago
> Special shout out to Google who to this date seem to not support tool call streaming which is extremely Google.
Google doesn't even provide a tokenizer to count tokens locally. The results of this stupidity can be seen directly in AI studio which makes an API call to count_tokens every time you type in the prompt box.
- localhost 8mo agotbf neither does anthropic
- haxel 8mo agoAI studio also has a bug that continuously counts the tokens, typing or not, with 100% CPU usage. Sometimes I wonder who is drawing more power, my laptop or the TPU cluster on the other side.
- Havoc 8mo agoSame for clause code. It’s constantly sending token counting requests