4 ms·
> Essentially, by compressing the raw RGB data coming off the sensor (where each pixel only has R, or G, or B) you avoid the data explosion of interpolating col
by amelius 4y ago
> Essentially, by compressing the raw RGB data coming off the sensor (where each pixel only has R, or G, or B) you avoid the data explosion of interpolating color values at each pixel. It's a technique for compressing raw files, and Red was early to the game.
So the novelty is that they separate R,G and B planes before compression?
There are other compression algorithms that work with other colorspaces, giving even better compression. E.g. splitting luminance and chromatic components. I think these algorithms might also be older.
- chongli 4y agoDigital camera image sensors only have one image plane. Each pixel is recorded as a grayscale value where the light has passed through a red, green, or blue filter. To get a complete pixel (with values for all 3 colours) requires software to interpolate a pixel with its neighbours.
- ryandamm 4y agoWell... yeah, that's the crux of it. But the patented part is treating each channel separately; the actual compression algorithm isn't at issue (which, in Red's case, is JPEG2000). That said, as soon as you get into colorspace conversions or color sampling conversions (like YUV, etc), you're baking in choices and dealing with quantization and roundoff errors. If you want the most pristine image possible for dealing with it in post, you want the raw photosite information. And if you want that, without deBayering (which introduces those same errors!), you get to pay Red a royalty check. I don't make the rules, I'm just pointing out what the stakes are here. Yeah, it's pretty fundamental and obvious now, but at the time no one was selling a professional video camera with a single chip for that price. It was a different world.
- car_analogy 4y ago> So the novelty is that they separate R,G and B planes before compression? > Yeah, it's pretty fundamental and obvious now, but at the time no one was selling a professional video camera with a single chip for that price. It was a different world. I don't see how no such cameras being on the market makes the software any less obvious, unless we are totally abdicating the meaning of "obvious" to reduce it to "non-novel". But if that were the law's intent, it wouldn't require non-obviousness and novelty - just one or the other would suffice.
- Zak 4y agoThe obviousness test seems to vary by jurisdiction, but typically requires that someone with ordinary skill in the field would not likely come upon that solution[0]. It must also be novel[1]. [0]https://en.wikipedia.org/wiki/Inventive_step_and_non-obviousness https://en.wikipedia.org/wiki/Inventive_step_and_non-obvious... [1] https://en.wikipedia.org/wiki/Novelty_(patent) https://en.wikipedia.org/wiki/Novelty_(patent)
- DiogenesKynikos 4y ago> someone with ordinary skill in the field would not likely come upon that solution This requirement often appears to be effectively ignored, as in this case. Compressing the raw data (i.e., before transformations like de-bayering) is a pretty obvious thing to try out. This sort of run-of-the-mill development does not deserve a 20-year monopoly.
- Zak 4y agoAmazon's one-click patent is probably the most famous example of this. Anyone with any database programming experience can figure out "store the customer's payment details and shipping address and use them later to complete purchases". That was also true in 1999. The patent office seems to evaluate the requirements in a manner very favorable to patent applicants/holders. I think that's a bad thing; the criteria for what counts as an invention should be stricter.
- andreareina 4y agoIt was obvious then too. Way back when I was taking the raw grayscale data before debayering and I immediately saw I'd need to treat each color's pixels separately. No background in compression or signal processing or anything, just a tinker's mindset and some experience faffing around in Photoshop/GIMP
- sharken 4y agoOn top of that the patent requires the Jpeg2000 compression algorithm to be useful. If the choice is between the current state of affairs and no software patents, then no software patents is the way to go.
- rocqua 4y ago> So the novelty is that they separate R,G and B planes before compression? No. The novelty is that they compress before de-mosaicing (aka debayering). In other words, rather rebuilding the image from the signals and compressing that image, it compresses the signals themselves (not even seperated I think).
- gernb 4y agoI'm just guessing it makes more sense to separate them. In my naive no knowledge version. if it was RGRGRGRG GBGBGBGB RGRGRGRG GBGBGBGB Then, if I compress losslessly just grayscale I know at the other end I just interpret the first pixel as Red, next as green, red, green, etc., Then on the next row I interpret the first pixels as green, next as blue, next as green etc... BUT, if I compress lossily then the unrelated colors next to each other are going to bleed into each other while compressing. VS if I separate them out so RGRGRGRG GBGBGBGB RGRGRGRG GBGBGBGB becomes RRRR BBBB RRRR BBBB GGGG GGGG GGGG GGGG The compression would make more sense and less bleeding of the signals from each color into other colors. It would also seem to compress better. Imagine you're filming something pure green. Exaggerating but you'd get this 01010101 10101010 01010101 10101010 Which after separation is 0000 0000 0000 0000 1111 1111 1111 1111 That's just a guess though.
- rocqua 4y agoA different comment suggested they compress the green channel, and then compress the red and blue channel as differences against the green channel. This makes a lot of sense to me, since green is sort of 'luminance'. It is like a poor-mans LAB color space that exists before demosaicing.
- ryandamm 4y agoThis is a very good guess, and I believe it's precisely how it's done. Doing anything diff-ing the color channels still requires a lossy transformation step, so it's not quite as "raw." And you're right, that treating it as a single monochrome image makes it less compressible, because you get lots of high frequency information between adjacent pixels with different color. Which is sort of the opposite of what you want. Note also that, despite calling it "raw," Red's implementation is lossily compressed. You can even tune the compression ratio of their "raw" codec, and back in the very early days, there was certain subject matter that just looked terrible coming out of the camera, even as raw -- I remember one particular tree that an early user would film to test new firmware updates; in the earliest firmware builds, it actually crashed the camera (!). The images it did produce showed tons of wavelet compression artifacts.