3 ms·
It's a pretty funny assertion. The whole point of ML models is to take training data and learn something general from it, the common threads, such that it can i
by idle_zealot 4y ago
It's a pretty funny assertion. The whole point of ML models is to take training data and learn something general from it, the common threads, such that it can identify/generate more things like the training examples. If the model were, as they assert, just compressing and reproducing/collaging training images then that would just indicate that the engineers of the model failed to prevent overfitting.
So basically they're calling StabilityAI's engineers bad at their job.
- realusername 4y agoAs a side discussion, is there any research model which tries to do what they describe? Like overfitting to the maximum possible to create a way to compress data. It might be useful in different ways.
- visarga 4y agoYes, look at NeRF (neural radiance fields) and SIREN (Implicit Neural Representations with Periodic Activation Functions)
- realusername 4y agoThe papers I'm finding on those look truly amazing! Thanks a lot for the insights