6 ms·

Everyone commenting here that they don't care about photorealism in their games is missing the point. The example games (and movie) given at the start of the ar

Everyone commenting here that they don't care about photorealism in their games is missing the point. The example games (and movie) given at the start of the article lack an appearance of photorealism not because they were going for something else, but because they either didn't pay enough attention to the HDR rendering, or else they didn't have the expertise to do it right. The article also gives examples of games that intentionally went with a non-photorealistic look to achieve a specific effect. So the point is not "these games look bad because they aren't photorealistic", it's "these games look bad because their HDR rendering is bad". I don't know enough myself about HDR rendering to have an opinion on whether the author is right or wrong about any of this, but people arguing that the author is wrong because games shouldn't look photorealistic are attacking a straw man.

gt_ 9y ago
I can confirm everything except gamer audience concerns. I don’t game. I have worked in film production camera department, post-production and now CGI. Color grading and compositing in particular are not specialties of mine, but I know the systems well, and I can confirm the technical critique in the text. This author does an impressive job of cutting out the bull and getting to the bare issues.
- zeta0134 9y ago
  As a gamer, I can also confirm that I tend to have a tough time with dark areas in a lot of mainstream games. If I can get the game to realize that I'm trying to look at them (usually by getting the bright sky out of my viewport so it does the "HDR adjust" fake thing) then the darks come out of the contrast floor and I can suddenly make out the detail. The problem with the game doing fake-HDR is that while it looks great in trailers (or... at the very least, looks like the engine is doing something fancy with lighting, "great"-ness notwithstanding) it doesn't match what my real eyes would do in a situation. Unlike film, a video game doesn't have control over where I'm going to point the camera. I do. And sometimes, I need to see over that ridge, but the detail in the shadows is important too, and the game camera can't see what I'm actually looking at (with my eyes) and adjust accordingly. Breath of the Wild is a great counter example, because it doesn't really try to do the HDR adjust thing at all. It doesn't really need to; sure its daylight scenes are a bit washed out, but real daylight is a bit washed out too. My eyes adjust, just like they would outside, and I can actually see what I'm doing. That's important! With games, tempting though it is to control the camera effects just like you would when shooting film, you can't control the player's actions. It's usually better for gameplay to mellow out the effects, so the player can focus on their actions without being distracted by the 'pretty' effects.
  - blattimwind 9y ago
    > The problem with the game doing fake-HDR is that while it looks great in trailers (or... at the very least, looks like the engine is doing something fancy with lighting, "great"-ness notwithstanding) it doesn't match what my real eyes would do in a situation. An especially egregious offender in this category is Battlefield 1. When looking out of the driver's hatch of any vehicle, the game will randomly and chaotically fade it's "HDR" simulation between the exterior being discernible and a white rectangle (the hatch) set on a solid black background (the vehicle interior). The fade depends on miniscule adjustments in the PoV of the player, which is fixed relative to the outside world, not the vehicle, so you have to constantly track the view port. Battlefield 1 generally looks best in scenes featuring low (natural) contrast. > Yeah, and we screwed that up too. We don’t have the technical capability to run real film industry LUTs in the correct color space (The reason being that even fairly simple color correction pipelines in a real color grading tool keep a mid-range GPU pretty busy at 1920x1080 and higher resolutions).
  - knodi123 9y ago
    > I tend to have a tough time with dark areas in a lot of mainstream games. If I can get the game to realize that I'm trying to look at them (usually by getting the bright sky out of my viewport so it does the "HDR adjust" fake thing) then the darks come out of the contrast floor and I can suddenly make out the detail. Of course, this is also how eyeballs work...
    - zeta0134 9y ago
      This is a valid defense! The real issue though, primarily, is that video game cameras don't emulate this well enough. My eyes don't respond nearly as fast to light changes as a video game camera does, and they're not as sensitive to small variations in the overall light level. They're also quite a bit more sensitive, especially to darkness and shadow, even in bright daylight. I find that most video game lighting exaggerates the shadows way too much. So, adjusting the curves, especially at a slow, steady rate? That might be a good idea, and should actually aid visibility if it's done right. Say, walking all the way into a dark cave should lighten things up a bit, since your real eyes (and most cameras) would do exactly that. On paper, this part of the HDR effect works, and if it's done well it enhances the gameplay rather than distracting from it. Imitating a faster, more jarring camera transition when it fits the mood, especially during cutscenes? That's fine, and the article gives some great examples of this being done well. Scaling up the contrast so that any HDR changes cause you to either lose all the detail in all of the darks, or all the detail in all of the lights? That's the problem. The effect, if it's there at all, needs to be a lot more subtle. This is partly due to limitations with the final RGB space (only 255 color values to work with and weird curves to boot) but mostly due to the fake-HDR effect just being a poor imitation of nature.
- ancientworldnow 9y ago
  I am a colorist and I also want to add that the technical details check out - minus the Red One being better than film. It was most decidedly worse in every way - but was almost as good which was the important thing. I recently was going back and look at One and MX footage and couldn't believe how terrible it has held up while the Alexa sensor is still great today as are the 16 and 35 scans I work with. That aside, I found the discussion about the misuse of ACES particularly interesting. It's like the completely misunderstood the tool and how it's intended to be used (which isn't uncommon with the tech unfortunately).
  - gt_ 9y ago
    Yes, the bit about what the RED One was trying to do was a bit cringy but I thought it skirted around claiming it was better than film. The comparisons between the Alexa and RED One were very good, however. Coincidentally, I was doing work for Oakley as the RED One was being tested. After two test shoots with it, the director declared it B-cam and let a PA operate it, only because we couldn’t get the color right. This was action sports and the frame rate would have been useful. Even now, I am not sure much has changed. I don’t go on sets or handle much live footage these days but my observations have it that much of the production industry who could use it still lacks understanding of ACES. I have not worked with Alexa on any projects where I interacted with both camera and footage but my understanding is ARRI remains the king of blacks.
gilbetron 9y ago
Or, you know, the developers were trying to balance far more factors than what has to happen with a movie. Multiple platforms, not only high FPS but maintaining that FPS with disparate scene complexity, old hardware vs new, support a variety of camera distances and fov, highlighting game elements so that objects don't blend together, handling in-game cutscenes as well as actual play, having an asset pipeline that doesn't destroy your budget, etc. Not to mention players that are random monkeys that like to try to do bizarre things within your game. I guarantee game developers and game artists know a hell of a lot about HDR and color and lighting, and all kinds of things related to it, probably more than most people involved with movies. They just come at it from a different viewpoint - that of real-time rendering.
kllrnohj 9y ago
The author doesn't appear to have bothered to investigate or honestly ask WHY games are the way they are, though. They are just blindly attacking an entire industry on basically the claim that the entire industry is stupid. But the industry isn't stupid, and some of the "over-contrasty garbage" is intentional to help people rapid identify the things that they need to identify. Being able to quickly spot the things that you need to play the game are more important than sensible tone maps and contrast curves. This is not a medium you observe like film & paintings are, it's a medium you interact with, and rapidly at that. Approaching the visuals with the same perspective as something you only observe is a fundamentally flawed approach. This article is packed with baseless assertions, unfounded claims, and offhanded but not investigated technical limitations. Hell, right after saying "partly due to technical limitations" the author proceeds to throw out a "nobody in the game industry has an understanding of film chemistry" snark. The author doesn't even bother to elaborate on the technical limitations that they remarked on, opting instead to just hurl insults for no reason.
- zamalek 9y ago
  I was hoping that the author would go into how to do tone mapping correctly. > ask WHY games are the way they are, though. To add to your point, the main reason for "bad HDR" in FPS games is for simulating eye adaptation. Screens don't have 1,000,000:1 constrast ratio and can't shine as bright as the sun (we wouldn't want them to). This means that games are forced to approximate this effect - inevitably resulting in shortcomings. Furthermore, game development is a race against time. You have milliseconds to render the scene and apply tone mapping. It may very well be mathematically possible to create automated tone mapping that would make a cinematographer proud, but can you make an algorithm that completes in less than 1 millisecond? I doubt it. To my point, there are mods on PC that replace the tone mapper (I think ReShade does this) and they absolutely destroy your framerate - however the results are absolutely gorgeous if you know what you're doing.
  - pfranz 9y ago
    > To add to your point, the main reason for "bad HDR" in FPS games is for simulating eye adaptation... How is that different from what photographs do? > Furthermore, game development is a race against time. You have milliseconds to render the scene and apply tone mapping. Maybe I know just enough to be ignorant of the topic, but LUTs are just lookup tables. People working in film apply LUTs to the footage they're watching in realtime on normal PC hardware. Fragment shaders have been common in games for years. Last year I was working on a VR project (targeting 11ms per frame) and I think the post-processing took between 0.25 and 1.5ms--any more an it would have been dropped). For a desktop game having 16 or 30ms to render many fewer pixels is an eternity, comparatively. The only difference between a LUT and ICC profile (which most OSes support out of the box) is that for ICC profiles are mean to be calibrated against either an input or output--they're used everywhere in realtime. I've never actually used ReShade, so I had to look it up. It does way more than color correcting. Depth of field, ambient occlusion, antialiasing are completely separate from tone mapping and notoriously computationally expensive (not just in video games, but in film as well). I also think since third-parties are writing them, they're not always tuned to be performant.

gt_ 9y ago

I can confirm everything except gamer audience concerns. I don’t game. I have worked in film production camera department, post-production and now CGI. Color grading and compositing in particular are not specialties of mine, but I know the systems well, and I can confirm the technical critique in the text. This author does an impressive job of cutting out the bull and getting to the bare issues.

zeta0134 9y ago
As a gamer, I can also confirm that I tend to have a tough time with dark areas in a lot of mainstream games. If I can get the game to realize that I'm trying to look at them (usually by getting the bright sky out of my viewport so it does the "HDR adjust" fake thing) then the darks come out of the contrast floor and I can suddenly make out the detail. The problem with the game doing fake-HDR is that while it looks great in trailers (or... at the very least, looks like the engine is doing something fancy with lighting, "great"-ness notwithstanding) it doesn't match what my real eyes would do in a situation. Unlike film, a video game doesn't have control over where I'm going to point the camera. I do. And sometimes, I need to see over that ridge, but the detail in the shadows is important too, and the game camera can't see what I'm actually looking at (with my eyes) and adjust accordingly. Breath of the Wild is a great counter example, because it doesn't really try to do the HDR adjust thing at all. It doesn't really need to; sure its daylight scenes are a bit washed out, but real daylight is a bit washed out too. My eyes adjust, just like they would outside, and I can actually see what I'm doing. That's important! With games, tempting though it is to control the camera effects just like you would when shooting film, you can't control the player's actions. It's usually better for gameplay to mellow out the effects, so the player can focus on their actions without being distracted by the 'pretty' effects.
- blattimwind 9y ago
  > The problem with the game doing fake-HDR is that while it looks great in trailers (or... at the very least, looks like the engine is doing something fancy with lighting, "great"-ness notwithstanding) it doesn't match what my real eyes would do in a situation. An especially egregious offender in this category is Battlefield 1. When looking out of the driver's hatch of any vehicle, the game will randomly and chaotically fade it's "HDR" simulation between the exterior being discernible and a white rectangle (the hatch) set on a solid black background (the vehicle interior). The fade depends on miniscule adjustments in the PoV of the player, which is fixed relative to the outside world, not the vehicle, so you have to constantly track the view port. Battlefield 1 generally looks best in scenes featuring low (natural) contrast. > Yeah, and we screwed that up too. We don’t have the technical capability to run real film industry LUTs in the correct color space (The reason being that even fairly simple color correction pipelines in a real color grading tool keep a mid-range GPU pretty busy at 1920x1080 and higher resolutions).
- knodi123 9y ago
  > I tend to have a tough time with dark areas in a lot of mainstream games. If I can get the game to realize that I'm trying to look at them (usually by getting the bright sky out of my viewport so it does the "HDR adjust" fake thing) then the darks come out of the contrast floor and I can suddenly make out the detail. Of course, this is also how eyeballs work...
  - zeta0134 9y ago
    This is a valid defense! The real issue though, primarily, is that video game cameras don't emulate this well enough. My eyes don't respond nearly as fast to light changes as a video game camera does, and they're not as sensitive to small variations in the overall light level. They're also quite a bit more sensitive, especially to darkness and shadow, even in bright daylight. I find that most video game lighting exaggerates the shadows way too much. So, adjusting the curves, especially at a slow, steady rate? That might be a good idea, and should actually aid visibility if it's done right. Say, walking all the way into a dark cave should lighten things up a bit, since your real eyes (and most cameras) would do exactly that. On paper, this part of the HDR effect works, and if it's done well it enhances the gameplay rather than distracting from it. Imitating a faster, more jarring camera transition when it fits the mood, especially during cutscenes? That's fine, and the article gives some great examples of this being done well. Scaling up the contrast so that any HDR changes cause you to either lose all the detail in all of the darks, or all the detail in all of the lights? That's the problem. The effect, if it's there at all, needs to be a lot more subtle. This is partly due to limitations with the final RGB space (only 255 color values to work with and weird curves to boot) but mostly due to the fake-HDR effect just being a poor imitation of nature.
ancientworldnow 9y ago
I am a colorist and I also want to add that the technical details check out - minus the Red One being better than film. It was most decidedly worse in every way - but was almost as good which was the important thing. I recently was going back and look at One and MX footage and couldn't believe how terrible it has held up while the Alexa sensor is still great today as are the 16 and 35 scans I work with. That aside, I found the discussion about the misuse of ACES particularly interesting. It's like the completely misunderstood the tool and how it's intended to be used (which isn't uncommon with the tech unfortunately).
- gt_ 9y ago
  Yes, the bit about what the RED One was trying to do was a bit cringy but I thought it skirted around claiming it was better than film. The comparisons between the Alexa and RED One were very good, however. Coincidentally, I was doing work for Oakley as the RED One was being tested. After two test shoots with it, the director declared it B-cam and let a PA operate it, only because we couldn’t get the color right. This was action sports and the frame rate would have been useful. Even now, I am not sure much has changed. I don’t go on sets or handle much live footage these days but my observations have it that much of the production industry who could use it still lacks understanding of ACES. I have not worked with Alexa on any projects where I interacted with both camera and footage but my understanding is ARRI remains the king of blacks.

gilbetron 9y ago

Or, you know, the developers were trying to balance far more factors than what has to happen with a movie. Multiple platforms, not only high FPS but maintaining that FPS with disparate scene complexity, old hardware vs new, support a variety of camera distances and fov, highlighting game elements so that objects don't blend together, handling in-game cutscenes as well as actual play, having an asset pipeline that doesn't destroy your budget, etc. Not to mention players that are random monkeys that like to try to do bizarre things within your game. I guarantee game developers and game artists know a hell of a lot about HDR and color and lighting, and all kinds of things related to it, probably more than most people involved with movies. They just come at it from a different viewpoint - that of real-time rendering.

kllrnohj 9y ago

The author doesn't appear to have bothered to investigate or honestly ask WHY games are the way they are, though. They are just blindly attacking an entire industry on basically the claim that the entire industry is stupid. But the industry isn't stupid, and some of the "over-contrasty garbage" is intentional to help people rapid identify the things that they need to identify. Being able to quickly spot the things that you need to play the game are more important than sensible tone maps and contrast curves. This is not a medium you observe like film & paintings are, it's a medium you interact with, and rapidly at that. Approaching the visuals with the same perspective as something you only observe is a fundamentally flawed approach. This article is packed with baseless assertions, unfounded claims, and offhanded but not investigated technical limitations. Hell, right after saying "partly due to technical limitations" the author proceeds to throw out a "nobody in the game industry has an understanding of film chemistry" snark. The author doesn't even bother to elaborate on the technical limitations that they remarked on, opting instead to just hurl insults for no reason.

zamalek 9y ago
I was hoping that the author would go into how to do tone mapping correctly. > ask WHY games are the way they are, though. To add to your point, the main reason for "bad HDR" in FPS games is for simulating eye adaptation. Screens don't have 1,000,000:1 constrast ratio and can't shine as bright as the sun (we wouldn't want them to). This means that games are forced to approximate this effect - inevitably resulting in shortcomings. Furthermore, game development is a race against time. You have milliseconds to render the scene and apply tone mapping. It may very well be mathematically possible to create automated tone mapping that would make a cinematographer proud, but can you make an algorithm that completes in less than 1 millisecond? I doubt it. To my point, there are mods on PC that replace the tone mapper (I think ReShade does this) and they absolutely destroy your framerate - however the results are absolutely gorgeous if you know what you're doing.
- pfranz 9y ago
  > To add to your point, the main reason for "bad HDR" in FPS games is for simulating eye adaptation... How is that different from what photographs do? > Furthermore, game development is a race against time. You have milliseconds to render the scene and apply tone mapping. Maybe I know just enough to be ignorant of the topic, but LUTs are just lookup tables. People working in film apply LUTs to the footage they're watching in realtime on normal PC hardware. Fragment shaders have been common in games for years. Last year I was working on a VR project (targeting 11ms per frame) and I think the post-processing took between 0.25 and 1.5ms--any more an it would have been dropped). For a desktop game having 16 or 30ms to render many fewer pixels is an eternity, comparatively. The only difference between a LUT and ICC profile (which most OSes support out of the box) is that for ICC profiles are mean to be calibrated against either an input or output--they're used everywhere in realtime. I've never actually used ReShade, so I had to look it up. It does way more than color correcting. Depth of field, ambient occlusion, antialiasing are completely separate from tone mapping and notoriously computationally expensive (not just in video games, but in film as well). I also think since third-parties are writing them, they're not always tuned to be performant.