3 ms·
That's not really how memorization in neutral networks works. For classifiers, memorization is more like learning a hash function and a lookup table; no need to
by sdenton4 4y ago
That's not really how memorization in neutral networks works. For classifiers, memorization is more like learning a hash function and a lookup table; no need to store the full image at all. Even for very large models, the weights are a tiny fraction of the size of the original data.
It's probably helpful to think of embeddings for generative models in a similar way; it's a very specific embedding function, like a locality sensitive hash, which doesn't require actually storing the data.
- schemescape 4y agoThanks. Yes, I shouldn't have asked about "verbatim" copies -- I should have asked about something more like "close enough to cause legal trouble". Obviously copying verbatim is a violation of copyright, but there must be some threshold of "close enough" that is still problematic. E.g. compressed MP3s of copyrighted songs aren't a verbatim reproduction, but as far as I'm aware they're still covered by copyright. Trademarks are even broader.
- makapuf 4y agoA band playing publicly a reinterpretation of a famous band will get sued even if its not verbatim.
- schemescape 4y agoThat’s an even better example.