4 ms·

are their good synthetic data sets generated from DeepFabric publicly available?

• decodebytes 1y ago
  sure, just starting to get some up on HF. A good example might be GSM8K as this shows the structured output where every result is strictly formatted - I am using this right now to train models and managaing to get a small qwen model up in the 60% range, which wildly is higher then llama2 and xAI Grok 1 GSM8K: https://huggingface.co/datasets/lukehinds/deepfabric-GSM8K-cot-reasoning https://huggingface.co/datasets/lukehinds/deepfabric-GSM8K-c... also some others infra failures reasoning / CoT: https://huggingface.co/datasets/lukehinds/deepfabric-devops-reasoning-traces https://huggingface.co/datasets/lukehinds/deepfabric-devops-... Medical (multi-turn): https://huggingface.co/datasets/lukehinds/deepfabric-7k-medical https://huggingface.co/datasets/lukehinds/deepfabric-7k-medi... Programming challenges: https://huggingface.co/datasets/lukehinds/programming-challenges-one https://huggingface.co/datasets/lukehinds/programming-challe... If there is anything in particular you need, drop me a message or feel free to open an issue and I can create something for you.
  • dcreater 1y ago
    Thanks, what LLMs were used to create these?
    • decodebytes 1y ago
      I think it was gpt4-mini, but local models do surprisingly well too.