2 ms·

There's currently no standard because there's no one objective best way of handling prompt syntax. There's some libraries which use the OpenAI API syntax as a

There's currently no standard because there's no one objective best way of handling prompt syntax. There's some libraries which use the OpenAI API syntax as a higher-level abstraction, but for the lower-level precompiled binaries used in in this post that's too much.

Tostino 3y ago
Yes there is...HF chat templates is something that is being standardized on, slowly. It's just a jinja template embedded in the tokenizer that the model creator can include.