The "knowledge set" would be a small matrix - the one that allows to decode whatever encoder has put into compressed data. I guess it will be in volume range of

The "knowledge set" would be a small matrix - the one that allows to decode whatever encoder has put into compressed data. I guess it will be in volume range of 8x8 16-bit floats or so. Maybe three to six such matrices per channel.