3 ms·
It is better than llama 2 7b and 13b. I tried the OpenOrca fine tune and it is very good, even when 4-bit quantized
by tarruda 3y ago
It is better than llama 2 7b and 13b. I tried the OpenOrca fine tune and it is very good, even when 4-bit quantized
- faizshah 3y agoWhat does OpenOrca do? It’s just instruction tuning it?
- tarruda 3y agoYes, it is a instruction tune dataset: https://huggingface.co/datasets/Open-Orca/OpenOrca https://huggingface.co/datasets/Open-Orca/OpenOrca It felt different from the official Mistral7B-Instruct. One of the highlights with the OpenOrca version is that you can steer the model with a system prompt (eg "You are a 5 year old")