12 ms·

Chat-tuned ones do, but the base models don't. For example, Llama doesn't, but Alpaca has "### Instruction:", "### Input:", and "### Response:".

• int_19h 3y ago
  Base LLaMA still has dedicated tokens for beginning/end of string. What you're describing is the instruction format, which is separate.
  • sp332 3y ago
    Oh, I had misunderstood something.