4 ms·
Could you please add the prompt format to the model card, or at least here?
by redox99 3y ago
Could you please add the prompt format to the model card, or at least here?
- rushingcreek 3y agoThe model card is intended to help reproduce the HumanEval results, which we've achieved with no prompt. However, the model is instruction-tuned to follow completions (not chats). Simply tell it what you want and it should work.
- redox99 3y agoYeah but I assume it has a prompt format, for example CodeLlama34B Instruct the prompt format is [INST] Write a function in Python that prints HelloWorld [/INST]
- rushingcreek 3y agoNope, just ask your question. It's not chat-tuned the same way as CodeLlama34B Instruct.
- redox99 3y agoInteresting. That seems a pretty odd choice. Without a prompt format (like almost all instruction finetunes have) the model might continue your instruction instead of answering the instruction, since it does not have a delimiter for where the instruction ends and the response begins.
- rushingcreek 3y agoThis is an early experiment that we did in just a few hours. We'll have much better models in just a few days, stay tuned :)