4 ms·
Interesting to see special tokens for tool calling: "Function calling and special tokens This tokenizer includes more special tokens, related to function calli
by theolivenbaum 2y ago
Interesting to see special tokens for tool calling:
"Function calling and special tokens
This tokenizer includes more special tokens, related to function calling :
[TOOL_CALLS]
[AVAILABLE_TOOLS]
[/AVAILABLE_TOOLS]
[TOOL_RESULT]
[/TOOL_RESULTS]"
Is this something new on this model or has it been done already for a while?