4 ms·

NTSC and PAL are very fun. Using quadrature amplitude modulation to add color to the monochrome signal in a backward compatible way was so ingenious. PAL added

by anyfoo 4y ago

NTSC and PAL are very fun. Using quadrature amplitude modulation to add color to the monochrome signal in a backward compatible way was so ingenious. PAL added things to make it better after some learnt lessons with NTSC, foremost the 180° phase shift with each lines, which cancels out phase errors. (Fun facts: Because of that, countries with PAL instead of NTSC never knew what a "tint control" on the TV was, and the nostalgic 80s VHS look is also missing that blueish/purple color shift there.) I wrote both an NTSC+PAL decoder in Matlab, and a PAL encoder in an FPGA (also fixed point), which I use in an actual project as composite video output. Decoders are harder and less straightforward than encoders, with lots of optimizing potential, because you need to filter the color signal out (I look forward to seeing what this code did). If you really, truly understand how NTSC and PAL work in their mathematical details, you may get your mind blown away by reading about this decoder, which is likely the best PAL decoder that ever existed: http://www.jim-easterbrook.me.uk/pal/ http://www.jim-easterbrook.me.uk/pal/ Writing my own encoder and decoder was super enlightening, and there are tons of details to nerd out on, e.g. when you get into data that's encoded into the sync gap for Videotext, closed captions, and other stuff.

phone8675309 4y ago
Explains the PAL region epithet for NTSC - Never Twice the Same Color
- anyfoo 4y ago
  Yep, that's the reason! The ingenious idea of using quantum amplitude modulation unfortunately also meant that slight phase shifts--which happen easily in broadcast TV--appear as color errors. PAL fixed it by flipping the phase around every line. By subtracting the current line from the previous line, the phase error would cancel out (but is also more expensive since you need to remember the last line, in a delay line or memory[1]). So, always the same color. (But not ATSC, that's something else entirely...) [1] Well, there wer supposedly "PAL simple" receivers in the very beginning, where no processing of the phase flip was done and your eye was supposed to average the difference out. Probably looked terrible unless you were sitting really far away...
  - namibj 4y ago
    Old PAL typically used a quartz prism that served as a folded bulk acoustic wave delay line, using an ultrasonic transducer and exciting the low syndic range of a composite signal to get by with cheap transducer electronics.
    - anyfoo 4y ago
      Intrigued now, where can I find more about that?
      - nyanpasu64 4y ago
        https://en.wikipedia.org/wiki/Analog_delay_line https://en.wikipedia.org/wiki/Analog_delay_line, https://commons.wikimedia.org/wiki/File:Us_delay_line.jpg https://commons.wikimedia.org/wiki/File:Us_delay_line.jpg
    - greesil 4y ago
      Good god, the things people used to do because transistors weren't available, or too expensive.
      - zokier 4y ago
        There is not really good way of accomplishing with transistors what delay lines are used for in PAL, unless you go full digital.
        anyfoo 4y ago
        I guess you could take a massive amount of them, and some capacitors, and use them for sample and hold. But you already covered insanity like that by saying that there is no good way...
        frabert 4y ago
        That's called a Bucket-brigade device btw
- msla 4y ago
  That was a problem early on, maybe, but probably by the 1980s and certainly by the 1990s, it was a dead issue in terms of consumer TVs that weren't antiques or damaged somehow.
- iso1631 4y ago
  I believe when they fixed it with digital, the standard was renamed to "Always Twice the Same Colour"
  - LocalH 4y ago
    I find it hilarious (in a mildly sad way) that NTSC (or any other analog system) is a far better system for final delivery when conditions aren't effectively perfect. Guarantee you that a digital broadcast will break down far before any analog broadcast will. If only digital could be used for 99% of distribution, with OTA still being at least some sort of hybrid system for better resilience. Digital broadcasting has very low resilience to interference. Speaking from a US perspective here, where we got saddled with 8VSB (from my understanding, COFDM is much more resilient).
    - iso1631 4y ago
      That's not right. Digital transmission systems will cope with the errors and regenerate a perfect signal upto a point called the digital cliff. With that amount of noise in an analog signal will be a very snowy, staticy, picture. In an analog signal, a bright picture will be 700mV, a less bright picture will be 500mV, a dark one at 200mV and a very dark one at 50mV. Imagine that you get a 300mV error, that loses a lot of data - the dark one will be sort of bright, or vice versa, or the sort-of bright will be really-bright, etc. Now lets say you have a 1 represented by an amplitude of 700mV, and a 0 represented by 50mV. A 300mV error wlll have it at 400mV and 350mV. Your system will go "hey this is 350mV, it's a zero", and reclock it to 50mV, and vice versa. The recovered signal will be identical upto the point that the errors flip the bits - the digital cliff. (In reality of course the signal isn't just high/low but uses various techniques to encode the ones and zeros to prevent DC voltages accruing - Manchester Encoding for example. Push an analog video signal down a cable and it will degrade the longer the cable is. The same will happen in the digital domain -- you can see this on a waveform monitor by looking at the digital eye, but as long as the eye is open enough the signal can be retrieved to it's original state. With an analog signal, the signal is lost, and can't be retrieved.
      - 4y ago
greenbit 4y ago
I know what NTSC is, and what Matlab is, what would be interesting to hear about now is how you got an NTSC signal turned into Matlab data. Was there some kind of video input hardware to digitise composite video for you, or were you just working from example data? Sounds like fun either way.
- anyfoo 4y ago
  It's a good question! I simply sampled the composite output of my Blu-ray player using my oscilloscope, and exported it as CSV. The bandwidth for NTSC or PAL is 6MHz at best, so even the most crummy digital oscilloscope should do (provided it has enough memory to hold at least a full frame's worth of data). The only Blu-ray I had lying around was Back to the Future II, so that's what I used. Here is one of the very first pictures from my decoder, you can see dot crawl artifacts all over the place from my shoddy filtering (if I filtered at all at that stage): https://i.imgur.com/k2ZiCrH.png https://i.imgur.com/k2ZiCrH.png You can also see the insanely overkill sample rate I used (whatever my oscilloscope was set to, it could do 300MHz) by the numbers on the bottom. That's horizontal resolution, as sampled. But you won't get more than at most ~700 really discernible pixels with SD composite video's bandwidth. Finally, this picture shows everything: The (green) color burst on the left, the data in the sync gap at the top, and the vsync pulses at the bottom.
  - jamiek88 4y ago
    Wow that picture is so cool. It has a ‘portal’ look to it, I feel like I’m in a sci fi future looking through a floating portal to the past. Or maybe the video output from a terminator robot being sent back to the future (pun intended) me in my evil lair. It has this unreal retro future feel that I’m struggling to put my finger on. This whole thread was fascinating as well.
    - anyfoo 4y ago
      Heh yeah, I know what you mean. It's also just really interesting to me how analog video degrades over bad transmissions[1]. With digital video, you usually don't get much more than just a disappearing stream, but analog video has/had all sorts of different failure modes, and they revealed a lot about the underlying encoding. And they all had their particular "look and feel" to it. There was also a third color modulation scheme, SECAM, which was very different from NTSC/PAL (PAL is really just "NTSC 2.0"). It added the two color signals using plain FM. When degrading, it gave rise to something sometimes called "SECAM fire", and anyone who spent some time in France back then, me included, might subconsciously remember it: https://www.scheida.at/scheida/TV_SEITE/SECAM_Screenshot_Secamfire_lowRF.jpg https://www.scheida.at/scheida/TV_SEITE/SECAM_Screenshot_Sec... http://www.scheida.at/scheida/TV_SEITE/SECAM_Screenshot_Secamfire_Scart_Insert.jpg http://www.scheida.at/scheida/TV_SEITE/SECAM_Screenshot_Seca... (Those pictures are not from me, just found on the Internet.) To the casual onlooker that probably just looks like noisy pictures, what's the big deal... But to me it's interesting because the noise is different. [1] Of course, my picture is not a bad transmission, just bad decoding.
cjdavis83 4y ago
This sounds amazing! To hear that you all have created software for decoding NTSC analog video using digital software. I'm a member of the Domesday project and community where developers are currently trying to improve decoding of RF signals that are captured directly from the head of a Laserdisc player. Have you heard of this?
mrgriscom 4y ago
In my dabblings with SDR, playing around with analog video was one of the highlights. Something about this technology that was such a prominent yet opaque feature of my youth and now being able to control it from the inside out felt extremely empowering. I wrote my own decoder in python (nowhere near realtime) because at the time I couldn't find one that handled color. The deep dive on the design tradeoffs and signal processing hacks for NTSC was fascinating. A few of my exploits below: Full-frame decode of VHS w/ closed captioning: https://mrgris.com/a/ntsc-cc.mp4 https://mrgris.com/a/ntsc-cc.mp4 Faithful reproduction of analog artifacts: https://mrgris.com/a/colorbars_slow.gif https://mrgris.com/a/colorbars_slow.gif Analog scrambling: https://www.youtube.com/watch?v=qceZgxSBHwo https://www.youtube.com/watch?v=qceZgxSBHwo Inject custom captions (it supports color!): https://mrgris.com/a/thanks.mp4 https://mrgris.com/a/thanks.mp4 Sad that these signals are gone now... would have loved to play around with SAP/MTS, teletext, C-band...
- anyfoo 4y ago
  I can see just by the artifacts gif that you've definitely been down the same rabbit hole. Kudos for actually pulling through on also adding some scrambling, I only read about that (and since I don't have any descrambling hardware, I would have had to do that part, too). I share the sadness about those signals being effectively gone. How fun it would have been to work with real live broadcast ones at their heyday. There still are a few ones, but they're mostly pretty basic now.
- pajko 4y ago
  You might find this interesting: https://github.com/ali1234/vhs-teletext https://github.com/ali1234/vhs-teletext

by anyfoo 4y ago

phone8675309 4y ago

Explains the PAL region epithet for NTSC - Never Twice the Same Color

anyfoo 4y ago
Yep, that's the reason! The ingenious idea of using quantum amplitude modulation unfortunately also meant that slight phase shifts--which happen easily in broadcast TV--appear as color errors. PAL fixed it by flipping the phase around every line. By subtracting the current line from the previous line, the phase error would cancel out (but is also more expensive since you need to remember the last line, in a delay line or memory[1]). So, always the same color. (But not ATSC, that's something else entirely...) [1] Well, there wer supposedly "PAL simple" receivers in the very beginning, where no processing of the phase flip was done and your eye was supposed to average the difference out. Probably looked terrible unless you were sitting really far away...
- namibj 4y ago
  Old PAL typically used a quartz prism that served as a folded bulk acoustic wave delay line, using an ultrasonic transducer and exciting the low syndic range of a composite signal to get by with cheap transducer electronics.
  - anyfoo 4y ago
    Intrigued now, where can I find more about that?
    - nyanpasu64 4y ago
      https://en.wikipedia.org/wiki/Analog_delay_line https://en.wikipedia.org/wiki/Analog_delay_line, https://commons.wikimedia.org/wiki/File:Us_delay_line.jpg https://commons.wikimedia.org/wiki/File:Us_delay_line.jpg
  - greesil 4y ago
    Good god, the things people used to do because transistors weren't available, or too expensive.
    - zokier 4y ago
      There is not really good way of accomplishing with transistors what delay lines are used for in PAL, unless you go full digital.
      - anyfoo 4y ago
        I guess you could take a massive amount of them, and some capacitors, and use them for sample and hold. But you already covered insanity like that by saying that there is no good way...
        frabert 4y ago
        That's called a Bucket-brigade device btw
msla 4y ago
That was a problem early on, maybe, but probably by the 1980s and certainly by the 1990s, it was a dead issue in terms of consumer TVs that weren't antiques or damaged somehow.
iso1631 4y ago
I believe when they fixed it with digital, the standard was renamed to "Always Twice the Same Colour"
- LocalH 4y ago
  I find it hilarious (in a mildly sad way) that NTSC (or any other analog system) is a far better system for final delivery when conditions aren't effectively perfect. Guarantee you that a digital broadcast will break down far before any analog broadcast will. If only digital could be used for 99% of distribution, with OTA still being at least some sort of hybrid system for better resilience. Digital broadcasting has very low resilience to interference. Speaking from a US perspective here, where we got saddled with 8VSB (from my understanding, COFDM is much more resilient).
  - iso1631 4y ago
    That's not right. Digital transmission systems will cope with the errors and regenerate a perfect signal upto a point called the digital cliff. With that amount of noise in an analog signal will be a very snowy, staticy, picture. In an analog signal, a bright picture will be 700mV, a less bright picture will be 500mV, a dark one at 200mV and a very dark one at 50mV. Imagine that you get a 300mV error, that loses a lot of data - the dark one will be sort of bright, or vice versa, or the sort-of bright will be really-bright, etc. Now lets say you have a 1 represented by an amplitude of 700mV, and a 0 represented by 50mV. A 300mV error wlll have it at 400mV and 350mV. Your system will go "hey this is 350mV, it's a zero", and reclock it to 50mV, and vice versa. The recovered signal will be identical upto the point that the errors flip the bits - the digital cliff. (In reality of course the signal isn't just high/low but uses various techniques to encode the ones and zeros to prevent DC voltages accruing - Manchester Encoding for example. Push an analog video signal down a cable and it will degrade the longer the cable is. The same will happen in the digital domain -- you can see this on a waveform monitor by looking at the digital eye, but as long as the eye is open enough the signal can be retrieved to it's original state. With an analog signal, the signal is lost, and can't be retrieved.
    - 4y ago

greenbit 4y ago

I know what NTSC is, and what Matlab is, what would be interesting to hear about now is how you got an NTSC signal turned into Matlab data. Was there some kind of video input hardware to digitise composite video for you, or were you just working from example data? Sounds like fun either way.

anyfoo 4y ago
It's a good question! I simply sampled the composite output of my Blu-ray player using my oscilloscope, and exported it as CSV. The bandwidth for NTSC or PAL is 6MHz at best, so even the most crummy digital oscilloscope should do (provided it has enough memory to hold at least a full frame's worth of data). The only Blu-ray I had lying around was Back to the Future II, so that's what I used. Here is one of the very first pictures from my decoder, you can see dot crawl artifacts all over the place from my shoddy filtering (if I filtered at all at that stage): https://i.imgur.com/k2ZiCrH.png https://i.imgur.com/k2ZiCrH.png You can also see the insanely overkill sample rate I used (whatever my oscilloscope was set to, it could do 300MHz) by the numbers on the bottom. That's horizontal resolution, as sampled. But you won't get more than at most ~700 really discernible pixels with SD composite video's bandwidth. Finally, this picture shows everything: The (green) color burst on the left, the data in the sync gap at the top, and the vsync pulses at the bottom.
- jamiek88 4y ago
  Wow that picture is so cool. It has a ‘portal’ look to it, I feel like I’m in a sci fi future looking through a floating portal to the past. Or maybe the video output from a terminator robot being sent back to the future (pun intended) me in my evil lair. It has this unreal retro future feel that I’m struggling to put my finger on. This whole thread was fascinating as well.
  - anyfoo 4y ago
    Heh yeah, I know what you mean. It's also just really interesting to me how analog video degrades over bad transmissions[1]. With digital video, you usually don't get much more than just a disappearing stream, but analog video has/had all sorts of different failure modes, and they revealed a lot about the underlying encoding. And they all had their particular "look and feel" to it. There was also a third color modulation scheme, SECAM, which was very different from NTSC/PAL (PAL is really just "NTSC 2.0"). It added the two color signals using plain FM. When degrading, it gave rise to something sometimes called "SECAM fire", and anyone who spent some time in France back then, me included, might subconsciously remember it: https://www.scheida.at/scheida/TV_SEITE/SECAM_Screenshot_Secamfire_lowRF.jpg https://www.scheida.at/scheida/TV_SEITE/SECAM_Screenshot_Sec... http://www.scheida.at/scheida/TV_SEITE/SECAM_Screenshot_Secamfire_Scart_Insert.jpg http://www.scheida.at/scheida/TV_SEITE/SECAM_Screenshot_Seca... (Those pictures are not from me, just found on the Internet.) To the casual onlooker that probably just looks like noisy pictures, what's the big deal... But to me it's interesting because the noise is different. [1] Of course, my picture is not a bad transmission, just bad decoding.

cjdavis83 4y ago

This sounds amazing! To hear that you all have created software for decoding NTSC analog video using digital software. I'm a member of the Domesday project and community where developers are currently trying to improve decoding of RF signals that are captured directly from the head of a Laserdisc player. Have you heard of this?

mrgriscom 4y ago

In my dabblings with SDR, playing around with analog video was one of the highlights. Something about this technology that was such a prominent yet opaque feature of my youth and now being able to control it from the inside out felt extremely empowering. I wrote my own decoder in python (nowhere near realtime) because at the time I couldn't find one that handled color. The deep dive on the design tradeoffs and signal processing hacks for NTSC was fascinating. A few of my exploits below: Full-frame decode of VHS w/ closed captioning: https://mrgris.com/a/ntsc-cc.mp4 https://mrgris.com/a/ntsc-cc.mp4 Faithful reproduction of analog artifacts: https://mrgris.com/a/colorbars_slow.gif https://mrgris.com/a/colorbars_slow.gif Analog scrambling: https://www.youtube.com/watch?v=qceZgxSBHwo https://www.youtube.com/watch?v=qceZgxSBHwo Inject custom captions (it supports color!): https://mrgris.com/a/thanks.mp4 https://mrgris.com/a/thanks.mp4 Sad that these signals are gone now... would have loved to play around with SAP/MTS, teletext, C-band...

anyfoo 4y ago
I can see just by the artifacts gif that you've definitely been down the same rabbit hole. Kudos for actually pulling through on also adding some scrambling, I only read about that (and since I don't have any descrambling hardware, I would have had to do that part, too). I share the sadness about those signals being effectively gone. How fun it would have been to work with real live broadcast ones at their heyday. There still are a few ones, but they're mostly pretty basic now.
pajko 4y ago
You might find this interesting: https://github.com/ali1234/vhs-teletext https://github.com/ali1234/vhs-teletext