4 ms·
I think you're missing the most important point: these models need to be trained on something and that something is a fully developed, working game. You're bas
by qayxc 2y ago
I think you're missing the most important point: these models need to be trained on something and that something is a fully developed, working game.
You're basically saying that game development would need to do the work twice: step 1: develop a fully functional game, step 2: spend ridiculous effort (in terms of time and compute) on training a model to emulate the game in a half-baked fashion.
It's a solution looking for a problem.
- manmal 2y agoThe world model can still be rendered in very low res, and then the diffusion skin/remaster is applied. And this would also be an exciting route to go at remastering old games. I‘d pay a lot to play NFS Porsche again, with photorealism. Or imagine Command & Conquer Red Alert, „rendered“ with such a model.
- qayxc 2y agoNVIDIA's RTX Remix [1] suite of tools already does that. It doesn't require any model training or dozens of hours of pre-recorded gameplay either. You can drop in low-res textures and have AI tools upscale them. Models can be replaced, as well as lighting and the best part: it's all under your control. You're not at the merci of obscure training material that might or might not result in a consistent look-and-feel. More knobs, more control, less compute required. [1] https://www.nvidia.com/en-us/geforce/rtx-remix/ https://www.nvidia.com/en-us/geforce/rtx-remix/
- manmal 2y agoTIL, thanks for posting. The workflow I was sketching out is simpler though: Render a legacy game or low fidelity modern game as-is, and run it through a diffusion model in real time.
- FeepingCreature 2y agoYou can crosstrain on reality.
- qayxc 2y agoSure - and that'll work great on titles like Ratchet & Clank [1] or Tiny Tina's Wonderland [2] because art and style are dead and everything must be a mirror-like reflection of reality in order to be a fun game... [1] https://en.wikipedia.org/wiki/Ratchet_%26_Clank https://en.wikipedia.org/wiki/Ratchet_%26_Clank [2]https://playwonderlands.2k.com https://playwonderlands.2k.com
- FeepingCreature 2y agoThe network learns high-level abstractions, not just style. Crosstraining on reality will make it better at physics, logic, buildings, expressions, character animations etc. - even in a cel shading or topdown style. It's the thing Miyazaki is on about with his famous quote.
- deleted 2y ago[deleted]
- empath75 2y agoNo, you use it to simulate things that we don't have efficient perfect models of -- like the actual world. Everyone is correct that using this to simulate counterstrike is pointless. This is not video game technology, this is autonomous agent technology -- training robots to predict and navigate the real world.