8 ms·
To me this was the least interesting part of the Stadia reveal. State share was the real innovation imo. Would any serious game studio use style transfer ml to
by lwb 8y ago
To me this was the least interesting part of the Stadia reveal. State share was the real innovation imo. Would any serious game studio use style transfer ml to actually replace their visual artists? Didn't seem like the quality was there.
That said, it is an awesome PoC. Just not something I see being practically applicable.
- kirkules 8y agoHonestly seems more like a user-end personalization than something a developer would use. In a game settings menu, you choose an image that maybe you uploaded to use as the game style? Definitely something people would use. Especially if they figure out how to make it selectively apply to only certain textures/objects or parts of the screen, which seems likely.
- uxp100 8y agoStreet Fighter 4 had a feature kinda like that (with predefined selectable styles). AFAIK it was not popular. Sometimes my friends would turn it on as a joke.
- xiphias2 8y agoI would have been much more interested in using deep learning to make human faces more realistic. Somebody was experimenting with it in the past quite successfully IIRC, but I'd love to try it on a real game.
- dragonwriter 8y ago> Would any serious game studio use style transfer ml to actually replace their visual artists? No, a serious (AAA) studio would not. OTOH, the platform might intend to support producers that aren't AAA studios, and whose limited pre-release resources are focussed on gameplay more than art assets, and those producers might view it very differently than AAA studios.
- libraryatnight 8y agoIndeed, I'd be curious to see what some indie devs do with it.
- joshuamorton 8y agoImagine a game where you step into a portrait and are suddenly in the art style of the image. You suddenly walk into a countryside that feels american-gothic style, and then time-jump to 1940s New York in the style of Nighthawks. (different) Stylization as a medium in games isn't that explored, and the opportunity for indie devs to play with that is, IMO, really cool.
- NathanKP 8y agoThe Witcher Blood and Wine expansion actually did a great job with this. There is a main storyline quest where you enter a haunted painting
- ghostbrainalpha 8y agoWould it help in game development? For example giving developers better looking playable prototypes while the artists are still working out their designs?
- cwyers 8y agoYou still have to do all the work of building the geometries for the art assets, are you really saving that much on not having to color/texture those assets?
- bduerst 8y agoMaybe? One of the hacks of adding more assets without having to do much work is just recycling existing assets by assigning different color schemes/textures.
- deleted 8y ago[deleted]
- heyitsguay 8y agoI think the more interesting applications will come when you get tools like this used by visual artists, complementing handmade design. The demo is cool but uses style transfer very bluntly, applying one style to the whole image with high intensity. I imagine the future of this is something more like neural "shaders", able to apply real-time pixel alterations to scenes or objects within scenes. Used carefully, they could increase the range of creative choices a visual artist can make.
- Lerc 8y agoThis is where I think the value lies. I have been thinking about a process where a procedurally generated template is completed by artists and subsequently used as a base for training an AI to apply to further procedural generations. I also wonder if you can do micro style adjustments to unify artistic style, train a net on one particular artists work, the rest of the team copy the general style but use a final pass of a style transfer to make it a closer match.
- AnIdiotOnTheNet 8y agoActually, I wonder if there's potential in something like this for accessibility purposes. If you have one of the many variations of color-blindness, for instance, could such a restyling be helpful? Could other neurological disabilities be similarly aided by dynamically restyling visuals?
- cycrutchfield 8y agoThere are many low-tech solutions that can be applied instead of shoehorning in neural networks for this purpose.
- AnIdiotOnTheNet 8y agoYes, but they also require active participation from the developer and many developers are unwilling or unable to spend the time to implement them, especially when there's a rather large range of disabilities to account for. It's possible that tech like this could offer a user-definable solution to these issues.
- tanilama 8y agoExactly...This is a cool gimmick to try once, but it will seriously distort the intended art style. It is another example of forced intrusion of DL techniques creeping into places where it is not needed in the first place.
- tenaciousDaniel 8y agoGimmick is the perfect way to describe it. I really don't understand why they even included it.
- pducks32 8y agoOne incredible use is actually in network training for things like AR and autonomous driving. You want a slightly fake world and you could easily try out various network approaches using a free fake world found in game engines. Microsoft has something for this but cannot find a link or the name right now.
- m3kw9 8y agoMaybe used as a player entering dream like equivalent after eating magic mushrooms. Other than that you’d be hard pressed to see this in any game in memory
- Fellshard 8y agoHypothesis: the rough and relatively unpredictable results are not so much a good fit for finished products as it is for _rapid visual prototyping_. A good art director could use this to quickly settle on a rough goal around which the rest of the game would be targeted. I'm aware the pipeline usually goes from art director -> development, but this could help, say, a competent dev team with a gameplay direction but no artist yet, or a long-standing developer that wants to use its existing engines and mechanics to draft new, distinctive franchises.
- ender7 8y agoThis is the use case they highlighted in the keynote. It doesn't appear to be a system designed for shipped games.
- anonytrary 8y agoI was baffled with the style transfer announcement. It seems arbitrary, random, and out-of-place. Style transfer (applied to art) is really neat, but I can't see it being used to re-clothe games for production. Before I get downvoted, yes I do think it could be useful for prototyping and conceptualization during development, but I doubt anyone would actually ship a complete game with the entire camera view transformed by style transfer.
- pier25 8y ago> Would any serious game studio use style transfer ml to actually replace their visual artists? I doubt that was the point. IMO it is more of a palette testing tool.