2 ms·
> Unfortunately there's a mismatch between the model generated by the delta patcher and the tokenizer (32001 vs 32000 tokens). There's a tool to fix this at lla
by superkuh 4y ago
> Unfortunately there's a mismatch between the model generated by the delta patcher and the tokenizer (32001 vs 32000 tokens). There's a tool to fix this at llama-tools (https://github.com/Ronsor/llama-tools https://github.com/Ronsor/llama-tools). Add 1 token like (C controltoken), and then run the conversion script.