Not sure why you picked // as your special sequence, but ^ might be better. // appears with some regularity in any corpus with programming in it, and is 1 token

Not sure why you picked // as your special sequence, but ^ might be better. // appears with some regularity in any corpus with programming in it, and is 1 token in tiktoken. ^ is much more rare, and is 1 token in itself as a result. This will likely help recall, but it’ll also give you more characters in your instruction text.