12 ms·
The Hindenburg disaster denoised, upscaled, and colorized using ML [video]
- LargoLasskhyfv 5y agoErr...WOW! That was fast... And I've been unaware that Manhattan had so many skyscrapers at the time. Or maybe not. But one can glimpse that for a few seconds in the video. Awesome.
- jgwil2 5y agoYeah it's wild how modern Manhattan looks in the background. I've seen pictures of course but in color/motion it is really striking.
- jacquesm 5y agoAnother way of looking at that is how little change a typical city will undergo once it is laid out. This goes for Rome and Amsterdam just as it does for NYC. I was away from Amsterdam for about a decade before coming back there after having lived there before for a stretch of nearly 28 years (with a few longer absences) and what surprised me is how little had changed, and yet, here and there there were buildings that I was pretty sure weren't there before or some familiar landmarks that had gone. Over many decades or even centuries that kind of change will add up, and even though for Amsterdam in particular at some point there was a plan to 'overhaul' it and make it more modern (which fortunately got arrested in the earliest stage, but it did do a lot of damage to the east side of the river Amstel) the vast bulk of the city has been unchanged since decades. What real change there is is expansion wherever there was undeveloped land, but that isn't change insomuch as it is simply growth, what was there before remains. https://viewpointvancouver.ca/2019/10/27/the-1960s-when-the-dutch-imported-american-planners/ https://viewpointvancouver.ca/2019/10/27/the-1960s-when-the-... https://en.wikipedia.org/wiki/Expansion_of_Amsterdam_since_the_19th_century https://en.wikipedia.org/wiki/Expansion_of_Amsterdam_since_t... My mom still remembers that just behind the Olympic stadium in Amsterdam there were meadows and cows grazing! (That's now deep inside the city). If you're interested in when buildings in Amsterdam were first constructed you can find that information in: https://www.wozwaardeloket.nl/ https://www.wozwaardeloket.nl/ Just zoom in on the city, click on any building outline on the map and on the right hand side you will find all kinds of interesting information, including the year that ground was broken or the building was formally entered into the registry. This information is not always available but it still contains a wealth of information.
- 323 5y agoNeeds TikTok song: https://www.youtube.com/watch?v=fXLicO0CRvk https://www.youtube.com/watch?v=fXLicO0CRvk
- inglor_cz 5y agoThe crazy, crazy fact: Fatalities 36 (13 passengers, 22 crewmen, 1 bystander) Survivors 62 (23 passengers, 39 crewmen) Looking at the video, you certainly would not expect two thirds of the people on board to survive the hellish fire.
- contravariant 5y agoThis happens quite often with accidental explosions I've noticed. Explosions are not as lethal as you might expect, unless someone deliberately ensured that it caused a lot of damage.
- Zuider 5y agoIt was a design flaw. The flames were able to travel quickly through the central passage which passed through the center of the gas-bladders. The footage shows flames venting from the nose of the airship.
- jacquesm 5y agoIndeed, a little over half a minute from the start of the fire to total destruction of the airframe, it is amazing that there were that many survivors. Important to note that the crew and the airframe itself were two separate components, but that the passenger area was embedded in the fuselage. More miraculously when you have seen that footage is to realize that some of the passengers and crew walked away without major injury.
- marcodiego 5y agoIt is mostly hydrogen, so most of the energy was dissipated in the first few seconds. Most of the other materials or do not burn well or have very low thermal capacity. It was not on its highest altitude when burning started and drag dumped the falling to much slower speeds than a free-falling person. I'd estimate that most people who died were trapped or unable to move. Those who were free to run and had enough "air" were very likely to survive.
- Someone 5y ago
- greenail 5y agoThe temporal color jitter is pretty bad, but the other processing seemed to crisp it up. Based on my watching two minute papers I have to guess they can do better on the temporal consistency of the color.
- dane-pgp 5y agoTwo more papers down the line, I'm sure they'll be able to fix that.
- RotaryTelephone 5y agoWhat a time to be alive!
- consumer451 5y agoKároly Zsolnai-Fehér is just so darn charismatic. That has to be one of the reasons Two Minute Papers[0] has >1M subs. Is there anyone in the space even close to that level of engagement? [0] https://www.youtube.com/channel/UCbfYPyITQ-7l4upoX8nvctg https://www.youtube.com/channel/UCbfYPyITQ-7l4upoX8nvctg
- fastball 5y agoMy guess is that they are doing this frame-by-frame with an NN built for images, and that is why there is some much jitter. Providing actual video as input to the NN could probably do away with this.
- marstall 5y agoa real tragedy, but also a succinct metaphor for Nazi Germany!
- spodek 5y agoOr for our culture of growth, believing we can outdo nature, like stories in The Onion's reporting on the Titanic: "World's Largest Metaphor Hits Ice-Berg" https://lh4.ggpht.com/-gWV2MSK4odI/T4yLpd1STpI/AAAAAAAASrw/o1JupStPATA/Titanic0001_thumb%25255B4%25255D.jpg https://lh4.ggpht.com/-gWV2MSK4odI/T4yLpd1STpI/AAAAAAAASrw/o...
- andreasley 5y agoA beautiful animation of the ship's design and the disaster: https://www.youtube.com/watch?v=VJy17qZmhjE https://www.youtube.com/watch?v=VJy17qZmhjE
- GeekyBear 5y agoI've really come to enjoy these sorts of upscaled videos that allow a view of various cities in the early 1900's. New York: https://www.youtube.com/watch?v=85WMpJMv8aA https://www.youtube.com/watch?v=85WMpJMv8aA San Francisco: https://www.youtube.com/watch?v=VO_1AdYRGW8 https://www.youtube.com/watch?v=VO_1AdYRGW8 Paris: https://www.youtube.com/watch?v=JOPaxhhgyd8 https://www.youtube.com/watch?v=JOPaxhhgyd8 Wuppertal, Germany: https://www.youtube.com/watch?v=EQs5VxNPhzk https://www.youtube.com/watch?v=EQs5VxNPhzk
- FiberBundle 5y agoThis one of Berlin, though not as early as the ones you posted, is the most spectacular one I've found: https://m.youtube.com/watch?v=_YSDgruADlE https://m.youtube.com/watch?v=_YSDgruADlE This gives a much better view into what everyday life must have been like at that time, it almost reminds me in some ways of movies such as Koyaanisqatsi.
- CamperBob2 5y agoThis is absolutely astonishing. The colorization isn't great, but you can tell it will get much, much better as the algorithms improve. The stabilization, however, is ... well, astonishing. There is zero visible judder except in a very few places.
- diggan 5y agoMe too, really interesting to see and easier to connect somehow when the quality is better, compared to the black and white versions with strange frame-speeds. Here is another one: Barcelona, Spain (1911): https://www.youtube.com/watch?v=P-3NlMAdq9I https://www.youtube.com/watch?v=P-3NlMAdq9I
- GeekyBear 5y agoI agree. Correcting the frame rate jitter and also motion stabilization (in addition to upscaling the resolution), really does result in a much more engaging view into the past. I'm perfectly happy without colorization, but also willing to overlook it.
- marcodiego 5y agoConsidering it is entirely automated, this is extremely good. I'm not a bit against ML restoration. We've been paying artist to color BW in the early days, this is just replacing the artist by machines. Judging from the video, it looks like no inter-frame relation is considered, so color varies wildly from on frame to another. The video still lacks some form of stabilization. Frames still have defects inherited from the film. Also, it clearly was recorded in different speeds, so people have an uncanny walk in the last scenes. I hope, in the not too distant future, these flaws will be taken care of and we'll see restorations that are very hard to differentiate from original footage.
- tdrdt 5y agoThe channel Rick88888888 has a ton of restored movies: https://youtube.com/user/Rick88888888 https://youtube.com/user/Rick88888888
- xdennis 5y agoI'd sooner call it vandalism. Restoration is what's shown in "They Shall Not Grow Old" where they paid attention to detail and approached it with respect. Sharp edges and shifting red-blue colours is not what I would call restoration.
- TaylorAlexander 5y agoIt’s not vandalism unless the originals have been damaged. If someone makes a digital copy and goofs around with it I really don’t see any harm being done.
- dylan604 5y agoHahaha, that's their creative touch so they can claim copyright on this for the next 70 years
- seoulmetro 5y agoIt's getting sadder and sadder to see people enjoying these fake restorations. Eventually we'll have so much of a mess that the original source will be forgotten or lost.
- teeray 5y agoThis reminds me so much of the Gene Wilder Willy Wonka Tunnel Scene
- oofbey 5y agoThey should add a regularizing term between frames, like a simple L2 loss between output pixel values, to stabilize the color.
- bsenftner 5y agoAnd stabilize the frames, an early assignment in many computer vision courses. No need for the text frames and video images to be so shaken/stuttered.
- GhostVII 5y agoI think it would be cool if you could have some kind of combo human+ML system, where you use ML to actually detect the different objects and track them between frames, and a human can choose what color to use for each one. In a couple shots at least the Hindenburg showed as fully red instead of silver, and I don't think it is always possible for an algorithm to actually know the correct color without external data. If the algorithm could just say "I've identified this object between frames", and then the human can choose the correct color, could be best of both worlds. Or maybe you could feed in some reference photos with the same objects, but already colorized. And then the algorithm could match objects from the reference photos to those in the black and white ones to get the colors.
- turtletontine 5y agoI don't know if this is a breakthrough but... Frankly this looks awful. I think I could handle unrealistic colors but the way they flicker so much frame to frame is really jarring. It's interesting that the algorithm seems to generate chromatic aberration at hard edges? Most clearly around the letters on the title cards.
- xyzzy21 5y agoThis is where a human videographer could trivially do better or add value. The obsession with "automating everything" is a real disease in ML and CS generally. Sometimes it makes things worse! This is one of those situations.
- sp332 5y agoThe original video was interlaced. The deinterlacing part of the algorithm is not very good, and I think they would have gotten better results with a special-purpose pass before handing off to the neural network.
- jacquesm 5y agoWhat is missing is object continuity with respect to color. That would quiet things down tremendously. Right now it is as if every object gets re-painted from one frame to the next in a completely new (and often garish or wildly incorrect) color.
- MauranKilom 5y agoI believe there already is quite some continuity, otherwise the colors would flicker much stronger from frame to frame. In the video it varies smoothly from frame to frame.
- Someone 5y agoI think they get that not because of putting in that constraint, but only because subsequent frames are similar. That makes the coloring algorithm pick similar coloring.
- ChristianGeek 5y agoManhattan has never looked so green!
- spodek 5y agoCame here to comment on how much park space there was in lower Manhattan. Not the same type a loss as the explosion, but a tragic loss nonetheless.
- ghostly_s 5y agoPlease add "(very poorly)" to the title.
- canjobear 5y agoIt’s interesting that the color of the Hindenburg itself is always shifting. The object is so out of sample that the ML colorizer has no idea what to do with it.
- userbinator 5y agoI was half-expecting it to turn into the colour of a manatee.
- txdm 5y agoI never noticed until now there were big honkin swastikas on the tail.
- gonzus 5y agoI did notice them as well. I wonder if the original video had already been edited so that the swastikas were (in my opinion) mostly clipped out, or if this is a more recent edit...
- WarOnPrivacy 5y agoI remember swastikas in the 1970s. I don't think they were ever edited out.
- deleted 5y ago[deleted]
- deleted 5y ago[deleted]
- bsanr 5y agoHuh. Never noticed the swastikas before.
- diklon 5y agoAlthough visually it appears to be high resolution, it feels like an illusion, like my brain still receives no additional information Vs the original. Which is odd because I can look at individual elements and see more precision.
- wly_cdgr 5y agoThis sent me down a zeppelin Wikihole and led me to a much greater appreciation of the engineering and operational complexity of these airships. Thanks!
- nobrains 5y agohttps://en.m.wikipedia.org/wiki/USS_Akron https://en.m.wikipedia.org/wiki/USS_Akron
- michaelterryio 5y agoA bunch of the comments in this thread are inappropriate. There’s no justification for the over-the-top insulting language on this forum.
- fitzroy 5y agoJoseph Goebbels and the Amazing Technicolor Dream-Blimp