3 ms·
I use the default prompt template which is defined in the tokenizer.config https://huggingface.co/deepseek-ai/deepseek-coder-33b-instruct/blob/main/tokenizer_co
by skp1995 3y ago
I use the default prompt template which is defined in the tokenizer.config https://huggingface.co/deepseek-ai/deepseek-coder-33b-instruct/blob/main/tokenizer_config.json#L34 https://huggingface.co/deepseek-ai/deepseek-coder-33b-instru...
No special flags or anything, just the standard format. Do take care of the spaces and end of lines. sharing a gist of the function I use for formatting it: https://gist.github.com/theskcd/a3948d4062ed8d3e697121cabd65ea42 https://gist.github.com/theskcd/a3948d4062ed8d3e697121cabd65... (hope this helps!)