You can. Simply use the base models. You can do anything once you ditch the RLHF and the instruction tuning. Then, even those 7b versions are mindblowingly good

You can. Simply use the base models. You can do anything once you ditch the RLHF and the instruction tuning. Then, even those 7b versions are mindblowingly good. But you’ll need to either change your prompting style or do your own fine-tuning to get the behavior you want.