3 ms·

For anyone dumb like me: this is NOT a routine announcement, definitely read it through. The improvements they show off are honestly stunning. Also, they’ve (r

by bbor 3y ago

For anyone dumb like me: this is NOT a routine announcement, definitely read it through. The improvements they show off are honestly stunning. Also, they’ve (re-) established a universal law of AI: fuck it, just ensemble it

isoprophlex 3y ago
Apparently that's what GPT4 is too: eight GPT3.5's ensembled together. Not sure if true, sounds plausible tho.
EGreg 3y ago
How does ensembling work? What
- minimaxir 3y ago
  Combining the results of multiple models and then adding another layer onto the combined output tends to increase accuracy / reduce error rates. (not new to AI: it's been done for over a decade)
  - EGreg 3y ago
    But how to combine the results?
    - bbor 3y ago
      In this case, the first model generates a general image, and the second model handles finer details
    - minimaxir 3y ago
      Usually just by concatenating the final hidden states (before any classifier/regression/image output head)
- liuliu 3y ago
  Many ways, for one: https://magicfusion.github.io/ https://magicfusion.github.io/