4 ms·

Classifier Free Guidance works on LLMs with a significant boost in performance

• brucethemoose2 3y ago
  More granular prompting like this is a huge deal... If they ever release the code for it. Even if its cherry picked, the effect on that "Dragon flying over France" prompt example is huge. Also, I noticed Stability and Coreweave provided funding for the compute. That actually makes me kinda suspicious, like they are going to keep the implementation to themself.
  • raidicy 3y ago
    Since many of the advancements in the diffusion Community (lora etc) are applicable to the text generation community, I don't see how this won't hit the local llama scene within the next month or so.
    • pizza 3y ago
      It appears to be a one-line (or, if you prefer readability, one-function) change - my guess is 80% chance by EOD and 95% chance by end of week :^)
      • ronsor 3y ago
        Correct me if I'm wrong, but the change seems to be: return_logits = generated_logits + cfg_scale * prompt_logits
        • Llamamoe 3y ago
          Pardon my ignorance, but what exactly does "Classifier Free Guidance" mean, and what are logits?
    • Der_Einzige 3y ago
      NLP folks are so slow to implement EVERYTHING Where the hell are negative prompts? Where are word weights? Where is ANYTHING that I can do in Automatic1111? There are no technical reasons why they can't be implemented.
  • a2128 3y ago
    The author of the paper has already shared their implementation and are willing to contribute it to hf-transformers: https://github.com/huggingface/transformers/issues/24536 https://github.com/huggingface/transformers/issues/24536
• riwsky 3y ago
  This is basically a balanced audio cable, but in a bajillion dimensions