3 ms·

You can’t trust the output to be accurate yet, the resulting model would be worse than the original for artefacts.

• visarga 3y ago
  In smaller LLMs it has been demonstrated that purely synthetic datasets can make a model 5x more efficient. So a 1.5B model can score like a 7B model. The model is Phi-1.5 from Microsoft. But you can also empower the LLM, it can use more tokens, chain of thought, multiple rounds of LLM inference, use other specialized models, use tools, execute code, use search, and have a human in the loop. Does that remind you of anything? Yes, "OpenAI GPTs", they are the empowered LLM environments that can create data superior to LLM alone. The general recipe is LLM+something extra = smarter than LLM. That something extra is usually a simulation or code execution or some real world interaction. This generates LLM error examples and feedback to learn to fix them in the next iteration. It is targeted training data.