2 ms·
> Would the model be smaller in size than the size of all 1000 together? This is a good question, because you're butting up against the fundamental limits of i
by talldayo 2y ago
> Would the model be smaller in size than the size of all 1000 together?
This is a good question, because you're butting up against the fundamental limits of information theory that make this field interesting.
For starters, I think we have to set some rules. A "lossless" representation of these 1000 movies would mean that simply prompting the system with the name of a film could generate the movie perfectly. If the model fails to reproduce that film on it's first try, or cannot exactly recreate the training file, it is a lossy compression.
So with that being said, I think we can start painting a picture of how efficient ML can be. You are processing tens of thousands of frames of visual data while attempting to lose as little of the source material as possible. Getting a single movie to render properly on the first time inherently relies on luck; retrying over multiple attempts is infeasible due to how long you have to wait and how much energy you pay for. You'd be bruteforcing a video-generator against a checksum that it may-or-may not hit.
I would argue that the efficiency of ML for storing this data relies on your tolerance for error. If you require an output equally as pristine as your input, ML is not a suitable compression medium for your data.
- LoveMortuus 2y agoI guess since most people aren’t bothered by the quality of video on streaming services (Netflix, etc…) it probably wouldn’t need to be lossless, just good enough that the majority of people won’t notice the difference. I was thinking that there might be a chance it’s better, because the way it “stores” data, is very different from how movies are stored and thus perhaps the ML could notice patterns across many movies, which would then allow it to store the movies more efficiently.