18 ms·
A generalist AI agent for 3D virtual environments
- SomeCooeyGuy 3y agoWhy link to the twitter post and not the article linked from within it? https://deepmind.google/discover/blog/sima-generalist-ai-agent-for-3d-virtual-environments/ https://deepmind.google/discover/blog/sima-generalist-ai-age...
- GaggiX 3y ago@dang will help
- pvg 3y ago@dang doesn't do anything, you should email hn@ycombinator.com
- LeifCarrotson 3y agoTo be clear, @dang does a lot! His moderation is a big part of why HN is such a useful forum. But you're right that the text '@dang' being posted in an HN comment does not result in the software sending a notification to him.
- GaggiX 3y agoI have always seen people using @dang and honestly it has always worked, he even thanks me sometimes.
- modeless 3y agoI submitted that one earlier: https://news.ycombinator.com/item?id=39691783 https://news.ycombinator.com/item?id=39691783 This one got points slightly more quickly for whatever reason. Usually in these cases of duplicate submissions dang will merge the stories together. To the DeepMind team I would say that a snappy summary accompanied by a video at the very top of the page instead of a bunch of whitespace and a static image you have to scroll past would likely help the blog post be more viral, as this tweet demonstrates.
- pvg 3y agoI submitted that one earlier With a made up title which you should avoid, it's in the thing https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
- modeless 3y agoGenerally I editorialize the title when I make submissions in the "new" queue if the actual title is very dry. If I had posted the actual title of the blog post it would be even farther behind the tweet version. I may update the title now that it's on the front page, unless dang does it first.
- pvg 3y agoRight, except the guidelines ask you to not-do exactly that and you shouldn't.
- gitfan86 3y agoThe deep mind team chose to post it to X because it allows vitality and X is also the town square now
- SomeCooeyGuy 3y agothat wasn't the question, but thanks
- deleted 3y ago[deleted]
- dang 3y agoThanks! Changed to that from https://twitter.com/GoogleDeepMind/status/1767918515585994818 https://twitter.com/GoogleDeepMind/status/176791851558599481... now.
- dtx1 3y agoOkay, so now i know how artists feel: AI is destroying that thing i love, now i will always have to fight ais when playing online
- mrnotcrazy 3y agoI think the better deployment of this would be 1 human and 4 AI buddies so you could have a more tactical experience and games could have larger more realistic battles. I think strategy might be more important in the future than switchy aiming
- giovannibonetti 3y agoDon't you already fight AIs when playing in single-player mode?
- jprete 3y agoSingle-player AIs are fine-tuned by the developers for fun instead of frustration. I think the GP is talking about undetectable online cheating.
- educaysean 3y agoMaybe the future is that we no longer have to worry about players cheating online because we simply won't play random strangers online. You can still team up or play against friends, but all other "players" can be bots with varying levels of skills and play styles. Cheating solved.
- Auracle 3y agoThat’s just not the same, even if they act perfectly like humans.
- educaysean 3y agoMy unsubstantiated opinion: Once AI gets to a point where AI agents can act "perfectly like humans", our preconceptions about "friendship" and "companionship" will fundamentally change. We will realize that we can develop deep bonds with AI as we do with other humans, with no "weirdness" attached. There may still be holdouts, but the society will largely see them as old curmudgeons resembling the people of today who claim that "humans are incapable of maintaining long distance relationships, and you're only fooling yourself if you think you're in love". Or as a more extreme example, people who maintain that interracial or intercultural marriages are inferior to marrying in-group, because "shared experience" is fundamental to love. All speculation, of course. But I'm a firm believer that humans are foolish and flexible - we're very easily fooled by anthropomorphic things, and AIs are the ultimate anthromorph. Our monkey brains don't stand a chance.
- jldugger 3y agoMan, its not even science fiction anymore to speculate that the robot apocalypse happens because "exciting" violent games were far cheaper and more plentiful than boring real life simulators.
- seydor 3y agoI wonder if Deepmind's quest for AGI using games as testbed will translate in the real world. It is quite possible that many of those feats rely on the ANNs learning the physics engine of the game. Which as impressive as it is, it 's probably nowhere near as complicated as the real world out there. The last mile may prove to be a very hard problem to solve, and i wonder if they have an alternative strategy to it.
- bigyikes 3y agoAre real world physics really that much more complicated than video game physics? Sure, if you’re talking about E&M, relativity, or QFT, the real world is more complicated, but for every day mechanics, they seem pretty comparable? Video games might be even harder to predict sometimes, since the physics simulations have very strange edge cases. There are no physics glitches in the real world.
- seydor 3y agoi believe it is as hard as it is for robots to act exactly as they do during simulation
- Jensson 3y ago> Are real world physics really that much more complicated than video game physics? Massively, in a game running into a wall is perfectly normal and valid strategy to get close to it, in reality that will wreck you. Or running on a fist sized rock has no consequences, in reality that destroys your foot. Reality is full of such extreme threats everywhere even in normal homes.
- sailfast 3y agoWouldn't a general purpose 3d AI learn just as quickly about those issues in the real world as they do in-game issues? Video game physics can also be made more difficult - it's not a stretch to think about a reality simulator that dials these real-world effects up to 11 for AI to train in, at which point you need the meatspace bot and many things start to happen.
- leetharris 3y agoI will never forget being at TI7 where OpenAI revealed an AI that could take on pro Dota players. Dota is an insanely complicated and difficult game. This was an eye opening moment for me that led to a career shift. https://en.wikipedia.org/wiki/OpenAI_Five https://en.wikipedia.org/wiki/OpenAI_Five
- jerrygenser 3y agoUpvoted. Not sure why this got downvotes. It's very cool that you were at TI7 as I only watched this on youtube. I also thought this was an important moment.
- tantalor 3y ago[flagged]
- leetharris 3y agoI could have left off the career switch anecdote, but I wanted to share this previous breakthrough and project with people who are not familiar. It was the foundation for technology like SIMA from Google.
- shmageggy 3y agoThe "foundation for technology like SIMA from Google" is more likely all of the other RL + games work that Deepmind did before and after that DOTA project.
- jerrygenser 3y agoIt seems like parent comment is the top comment on this post with a lot of replies and facilitated on topic discussion. Not sure which part of parent topic related another AI playing a game is off topic from the original post of an AI playing a game
- jprete 3y agoI know this might be perceived as an obvious question, but what exactly did you switch from, and to?
- sdrg822 3y agoDang they use Transformer-XL from 2019 haha - didn't realize people still used that / XLNet-like architectures
- ado__dev 3y agoI hope devs are able to use this to give more life to NPCs. So many times we've been promised NPCs in RPGs that have their own lives, do their own things independent of the player, etc. and it's never really materialized into anything notable. With AI though, I feel like we may be getting close.
- digging 3y agoI'm suspicious of whether that will actually make games more fun or interesting. For example, the more realistic human character animations get, the deeper we seem to fall into the uncanny valley. The fact is that humans themselves naturally move in ways that look weird when put on a stage, so mocap tends to look sillier the better it is. Which is why we have theater, where movements are exaggerated. Anyway, with AI characters, I expect it will actually be more frustrating and boring than not if they have realistic lives and schedules. All the littler irritations that we deal with and accept form real people just become friction in a game. Games, as movies and books and shows and plays and illustrations, don't need to be more realistic to be better. Media is caricatures of real life, with important information intentionally presented to give us a good experience. Taking inspiration from real life can give us better mechanics but blindly mimicking real life will give us shitty games.
- timlod 3y agoWell, weird movements in games should be a thing of the past in the near future, as we can begin to extract motion capture data from videos of normal people acting normally. I think it depends on the type of game you have, but I wouldn't underestimate this type of technology for say, open world games where it might make the game more immersive due to convincing realism.
- digging 3y ago> Well, weird movements in games should be a thing of the past in the near future, as we can begin to extract motion capture data from videos of normal people acting normally. I think you misread my posts. We don't have awkward animations because our mocap isn't good enough, we have awkward animations because typical human motion looks awkward - our brains just mostly ignore that. People are awkward; we don't actually want characters in games/movies/etc to be like real people. Very few movies, for example, would be well served by conversations frequently and for non-plot-related reasons being interrupted by loud noises, having people talk over each other and nonverbally try to figure out who gets to speak, having characters ask "What?" and then begin to reply without waiting for the answer because their brain caught up half a second later, etc.
- ordinaryradical 3y agoThis is a death knell for MMORPGs where botting is already a massive problem which distorts the player economies and degrades everyone's playing experience. The cat-and-mouse game of stopping these goldfarmers just became exponentially harder.
- xypheran 3y agoMaybe it's better that these time wasters die, speaking as someone who played them way too much.
- malux85 3y agoIt’s not just about time. During the teenage years while the neocortex is growing, teenagers are practicing and honing fine motor control. Video games help develop that, as well as learning about social interactions, emergent system behaviour and strategic vs tactical thinking. I’m not saying they don’t have downsides, but there are some upsides too. Sure, if you’re an addictive personality using video game escapism to ignore your life problems, that’s a whole different thing (and even without video games this type of person would just find another form of escapism) So I don’t agree with your generalisation of games as “time wasters” - maybe for you they are, but not for everyone, I don’t play them anymore very much (just a bit of chess every now and then) but they provided me with a lot of understanding in my formative years
- JohnMakin 3y ago> as well as learning about social interactions A large percentage of social interaction in a game like world of warcraft is profoundly negative and maladaptive. I'm not sure I would want my child learning about that in a MMO.
- malux85 3y agoMine were overwhelmingly positive, and got me friends I still have 20 years later today, it depends on the MMO
- whalesalad 3y agoI want to see it play helldivers on level 9. That would be so fun to watch.
- precompute 3y ago"3D virtual environments and games" today, IRL tomorrow.
- satvikpendem 3y agoPerhaps finally we will have competent AI in video games.
- tristor 3y agoGreat, now there will be even more people botting every single online game.
- TekMol 3y agoThe link should be changed to: https://deepmind.google/discover/blog/sima-generalist-ai-agent-for-3d-virtual-environments/ https://deepmind.google/discover/blog/sima-generalist-ai-age...
- deleted 3y ago[deleted]
- d--b 3y agoThe No Man Sky's "shoot the asteroid" demo is highly disturbing. They really should not ask any AI agent to shoot at anything. Especially when it's not very good at it.
- jamesdwilson 3y ago> It's about developing embodied AI agents that can translate abstract language into useful actions. And using video games as sandboxes offer a safe, accessible way of testing them. not creepy at all.
- cj 3y ago> safe, accessible way of testing them. And once validated, sell to the military? > Ultimately, our research is building towards more general AI systems and agents that can understand and safely carry out a wide range of tasks in a way that is helpful to people online and in the real world. This makes me nervous. I hope AI agents that take actions in the real world are regulated at least as much as self-driving cars have been over the last decade. Or at least AI agents that interact in public spaces.
- klabb3 3y agoI mean they already are, just look at that announcement > Ultimately, [..] I swear this short paragraph style rounding it off with an “ultimately”, “in conclusion” didn’t use to be so common. : Ai is already strongly influencing how people write. After being successfully deployed for a year.
- jamesdwilson 3y agoDeepMind> kill dissidents
- dist-epoch 3y agoYou don't need AI for that, look at Russia, Saudi Arabia, ...
- jamesdwilson 3y agotouché. the real power is the ability to blame the computer, isn't it?
- bogwog 3y ago
- belter 3y ago"A generalist AI agent for 3D virtual environments" - https://deepmind.google/discover/blog/sima-generalist-ai-agent-for-3d-virtual-environments/?utm_source=twitter&utm_medium=social&utm_campaign=SIMA/ https://deepmind.google/discover/blog/sima-generalist-ai-age...
- 101008 3y agoI understand that this is a great leap in AI and it sounds amazing, looks amazing, almost unbeliable. I wonder if it is needed, though. I can't find a good reason for computers playing videogames. I read another comment saying that they could be your buddies in an adventure game... what's the point? The fun is to play with other people. We already are able to play with bots (different algorithms rule them), so I can't see why someone would prefer this over them. About traslating this from a virtual world to the real world... I can't imagine who would think it's a good idea to give this type of freedom to machines in a physical world, were consequences are way riskier than something digital (and yes, digitally they could empty your bank account, physically they could kill someone. One is much worser than the other).
- kapperchino 3y agoIt’s to replace qa testers for video games
- bamboozled 3y agoThey’re expensive and ruin our bottom lines.
- chankstein38 3y ago>About traslating this from a virtual world to the real world... I can't imagine who would think it's a good idea to give this type of freedom to machines in a physical world, were consequences are way riskier than something digital (and yes, digitally they could empty your bank account, physically they could kill someone. One is much worser than the other). Right now there are robots in many factories around the world, some are discrete machines that aren't tethered down and have movement capabilities. You don't think that there are factory managers/etc out there drooling about the idea of getting those or something similar to be able to do general factory tasks? Imagine your employee who tapes up boxes before shipment quits one day out of the blue. "Hey, package carrying bot 9000, can you go tape those boxes? I'll have someone show you what to do" Not necessarily a good idea still but just because we don't want it doesn't mean there aren't a million beneficial uses of this kind of generalizing.
- 3y ago
- solarpunk 3y agostadia buildout paying off more and more.
- qgin 3y agoHonestly did not expect the physical side of robotics to be the bottleneck for fully autonomous robots doing tasks out in the world.
- nsagent 3y agoSometimes I wish I had the reach of Google Deepmind. I created a sandbox environment for the text-heavy RPG 'Disco Elysium' [1]. The current research I'm focused on is having an agent use a natural language interface (via text generation) to solve quests in the game. The project required lots of reverse engineering on my part to make a web-based facsimile of the game such that it's possible to conduct controlled experiments on the language capabilities of current agents. Hopefully what I've created will be useful for others, because unlike big tech, I've released all my code under the AGPL [2]. [1]: https://pl.aiwright.dev https://pl.aiwright.dev [2]: https://git.sr.ht/~dojoteef/pl.aiwright https://git.sr.ht/~dojoteef/pl.aiwright
- doctorpangloss 3y agoIsn't an essential part of what they are doing, and why they have results, that they are tackling all games at the same time, rather than focusing on one? Is Disco Elysium a good choice?
- nsagent 3y agoGood point, they are quite different objectives. Their approach is one that works for simple directives: "Go to ship" or "Pick up iron ore" which lends itself well to sandbox-like games (which seems to be a major focus looking at Deepmind's tech report). Similar research has been done in Minecraft [1]. These instruction following agents are more an RL achievement than a language understanding achievement. On the other hand, Disco Elysium has over a million words of dialogue, and solving the quests requires an agent to understand and reason about language much more extensively. People have looked at text-based game agents, like Microsoft's TextWorld [2], but these are much smaller in scope and not easily adapted for humans-in-the-loop. My work bridges that gap, focusing on the language aspect, rather than navigating a 3D world. Again, they are definitely different objectives, but as a sole researcher there's no way I can compete with Deepmind's budget and manpower anyway. Just look at the extensive author list in the tech report. So it doesn't make sense to necessarily focus on outcompeting them in producing a better generalized RL agent (in fact I merely use GPT-4). Instead, I made a publicly available experimentation platform that allows others to be able to build upon this work, which is valuable for the community at large. At least, that's my take. [1]: https://sites.google.com/view/steve-1 https://sites.google.com/view/steve-1 [2]: https://www.microsoft.com/en-us/research/project/textworld/ https://www.microsoft.com/en-us/research/project/textworld/
- simpletone 3y ago> Introducing SIMA: the first generalist AI agent to follow natural-language instructions in a broad range of 3D virtual environments and video games. If it can be done in 3D virtual environments and video games, it shouldn't be much of a leap to do it in the real world. After all we have cameras, voice recorders, sensors, etc that can map the real world into 3D virtual environments already. Have they tried linking this generalist AI to a robot to see how the robot does in the real world?
- actionfromafar 3y agoReality has a surprising amount of detail, though.
- acover 3y agoAnd variation. Video games cheat at everything.
- isx726552 3y agoLike this? https://news.ycombinator.com/item?id=39691886 https://news.ycombinator.com/item?id=39691886
- wdroz 3y agoSoon the 2017 April joke "GeForce GTX G-Assist" from Nvidia will be doable. [0] -- https://www.youtube.com/watch?v=smM-Wdk2RLQ https://www.youtube.com/watch?v=smM-Wdk2RLQ
- ChrisArchitect 3y ago[dupe] Some more discussion on the official post: https://news.ycombinator.com/item?id=39691783 https://news.ycombinator.com/item?id=39691783
- karmakaze 3y agoI was just thinking how well could it play StarCraft II vs say DeepMind's AlphaStar, if I'm giving the high-level directives and SIMA is executing them. Then I got the creepy feeling that this is likely the kind of wargames that are already being tested. We'll probably also need reverse safeguards where the AI raises concerns and requires confirmation before carrying out some requests.
- pdimitar 3y agoGreat, maybe we'll finally have NPC tanks and healers in dungeon queues so we the DPS players don't have to wait for 25 minutes.
- coddle-hark 3y agoThis got me thinking of Ender’s Game, where they basically tricked a kid into committing xenocide by telling him he was playing a computer game.
- educaysean 3y agoI immediately made this association too. Although thinking back on it, the connection is rather strenuous. Maybe we simply keyword matched on "video games" and "simulations". Or, perhaps more cynically, we're foreseeing a future in which AI agents don't care to differentiate between shooting at the enemy combatant in Call of Duty verses shooting at us in real life.
- ceroxylon 3y agoSeems to be an undercurrent of the release - that they're training it in a 'sandbox' by using 3D games for safety, as if the military-industrial complex doesn't have a huge incentive to implement them into our 3D space once they're done playing games.
- PartiallyTyped 3y agoI am fairly certain that ClosedAI has shown that training agents in robotics simulation generalises to reality rather easily.
- johnny_canuck 3y agoOr in Arrested Development when Buster joined the army as a drive pilot and thought he was playing a video game
- igleria 3y agoHere they are tricking the public into thinking this technology is "just to make the machine learn to play videogames".
- tintor 3y agocombat training agent? [0] this is direct violation of google ai principles on autonomous weapon development: [1] [0] Screenshot from SIMA Technical Report: https://ibb.co/qM7KBTK https://ibb.co/qM7KBTK [1] https://ai.google/responsibility/principles/ https://ai.google/responsibility/principles/
- cboswel1 3y agoDawg, we both know the moment there is any share holder value to be found in the tech, the TOS changes real quick. Look at Open AI.
- smallest-number 3y ago> Weapons or other technologies whose principal purpose or implementation is to cause or directly facilitate injury to people. I dont think an agent fighting in a video game really counts? There is quite a significant gap between an FPS and a missile launcher, and it would be a waste not to explore how these agents learn in FPS environments.
- tintor 3y agoWhat counts then? They intentionally included combat training in the dataset. It is in their Technical Report. How can combat training not be interpreted as "principal purpose or implementation is to cause or directly facilitate injury to people"? Do you believe the agent was trained to distinguish game from reality, and refuse to operate when not in game environment? No safety mechanisms were mentioned in the technical report. This agent could be deployed on a weaponized quad-copter, or on Figure 01 [0] / Tesla Optimus [1] / Boston Dynamic Atlas. [0] https://twitter.com/Figure_robot/status/1767913661253984474?ref_src=twsrc%5Egoogle%7Ctwcamp%5Eserp%7Ctwgr%5Etweet https://twitter.com/Figure_robot/status/1767913661253984474?... [1] https://www.youtube.com/watch?v=cpraXaw7dyc https://www.youtube.com/watch?v=cpraXaw7dyc
- bogwog 3y agoThis thing + Vtuber thing + chat bot that interacts with audience + text to speech == gaming influencer automation
- deleted 3y ago[deleted]
- 10xDev 3y agoSo it can't generalise to other tasks? Then how is this much more than overfitting text/image input to controller output?
- wandynn 3y agoI think it's great
- TaylorAlexander 3y agoCan we link to the blog post instead of the tweet? https://deepmind.google/discover/blog/sima-generalist-ai-agent-for-3d-virtual-environments/ https://deepmind.google/discover/blog/sima-generalist-ai-age...
- deleted 3y ago[deleted]
- gsuuon 3y agoThis would be cool to see as a game dev CI tool, an end-to-end playthrough test which would validate not only UI but the writing and game flow. Imagine getting a report that says something like "time to chop first tree: +20%"
- Jensson 3y agoThat isn't super hard to code, many of the large studios has such tools already. The main thing this could test that other things couldn't is the UX, that the UI actually is easy enough to understand for the AI to be able to navigate it etc. So if I could get reports like "+10% failed to understand how to chop their first tree" that would be good.
- gsuuon 3y agoAnd for release builds, running the tests across a cohort of gaming profiles so you could get detailed results for various personas instead of just a guess and check in production. It'd be great for indie and hobby projects as well - getting playtest feedback cheaply and quickly would be awesome. Hope this turn this into a service.
- 2OEH8eoCRo0 3y agoValheim provides a server that you can run yourself. It would be cool to populate the massive world with AI's.
- aussieguy1234 3y agoIs this AI simply pressing buttons as a human player would, or is it simulating physics to control a body in a 3D virtual space?
- margorczynski 3y agoPressing buttons, basically it operates the game just as a human would (image as input and mouse + keyboard as output/actions)
- hiddencost 3y agoConstrained action spaces are pretty essential to agent focused work.
- hakdbha 3y ago[dead]
- andyst 3y agoHaving played counter-strike on dial-up '99 and not having unlimited internet time, the bots - Botman, PODbot, NNBot and many others using neural nets was ground breaking then. The goals of those niche bots were certainly different but in some ways the recent hype doesn't surprise me as much having experienced that period too. I reflect that the limited internet then drove innovation in offline play that had really stagnanted till recently, I'm looking forward to the first game that really pushes the limit with their NPCs using some of this new tech
- jaimex2 3y agoIs there anything useful currently for anyone wanting to mess around with training an AI agent for a game they are developing? I feel like in terms of game dev nothing supersedes state machines. I know there's Gymnasium: https://gymnasium.farama.org/ https://gymnasium.farama.org/ and CleanRL and plan to mess with those but I havent seen much evidence they can be used to make a compelling adversary AI.
- compumetrika 3y ago> "Westworld was a warning, not an instruction manual!"
- hamoodhabibi 3y agoCombine this with SLAM+VIO + humanoid robot and you got Skynet literally
- iamsanteri 3y ago"We show an agent trained on many games was better than an agent that learned how to play just one. In our evaluations, SIMA agents trained on a set of nine 3D games from our portfolio significantly outperformed all specialized agents trained solely on each individual one. What’s more, an agent trained in all but one game performed nearly as well on that unseen game as an agent trained specifically on it, on average. Importantly, this ability to function in brand new environments highlights SIMA’s ability to generalize beyond its training. This is a promising initial result, however more research is required for SIMA to perform at human levels in both seen and unseen games." Here we go ladies and gentlemen. There's only one direction from here and it is that these things will keep improving and becoming better...
- utdiscant 3y agoDefinitely feels like we are advancing towards AGI quite rapidly. As another commenter mentioned (https://news.ycombinator.com/item?id=39693035 https://news.ycombinator.com/item?id=39693035), the OpenAI DotA game was a big milestone for me. If you think about it abstractly, humans are basically models that take input from our senses, do some internal processing of that and then take actions with our bodies. SIMA is the same - it takes input from video, and takes action through keyboard actions. There is nothing against introducing additional types of input and taking different actions. The ability to train on one game and transfer that knowledge to a different game should allow future models like this to train in games, by reading text, watching videos etc, and then transfer all of that knowledge to the real world.
- ProDemoNo 3y ago[dead]
- skenderbeu 3y agoYour model is only as good as the environment and data it's trained with. Gaming physics change all the time. I find it hard this "generalist AI agent" can play with a constant shifting gravity in XYZ for example. It does however offer a good training space for real world where gravity and other physics mechanics are consistent.
- lairv 3y agoHumans can very quickly pick up a new game and have strong priors on how to move, how to interact with the world etc. so its not unreasonable to expect an AI to be able to do the same
- benpacker 3y agoGoing to be sharing this snippet with non-technical friends and family: “ SIMA agents trained on a set of nine 3D games from our portfolio significantly outperformed all specialized agents trained solely on each individual one. What’s more, an agent trained in all but one game performed nearly as well on that unseen game as an agent trained specifically on it, on average” Many people I talk to assume that when a LLM gets something right, it’s because that specific thing was in the training set. Although the experience of human transfer learning is intuitive to people, I find people have a hard time appreciating that it can happen in algorithms too.
- deleted 3y ago[deleted]
- YeGoblynQueenne 3y agoThat's not right. If DeepMind's agents could really transfer what they learned from one game to another, that they've never seen before, their "specialized" agents, that only trained on one game, would then be able to perform well on unseen games. Instead, in order to get an agent with good performance in one unseen game they had to train it in all but that particular game. That's typical of the poor generalisation displayed by neural nets and clearly not how humans do transfer learning.
- utdiscant 3y agoBut humans have already trained on an incredible number of games (including reality) when they play No Man's Sky for the first time. What they say here is that training on N-1 games makes you better at the Nth game. So you just continue to scale this up.
- YeGoblynQueenne 3y ago"An incredible number of games"? You're saying a kid can't pick up and play No Man's Sky if it's the first time they ever played a video game? Or that they can't get good at it if it's the first game they play?
- YeGoblynQueenne 3y ago>> SIMA’s results show the potential to develop a new wave of generalist, language-driven AI agents. This is early-stage research and we look forward to further building on SIMA across more training environments and incorporating more capable models. From the very beginning DeepMind has promised that its advances in getting agents to operate in virtual environments (mainly, games, e.g. Atari, or chess-go-shoggi) will lead to agents capable of operating in real-world environment with comparable skill and capabilities. So far, it hasn't happened and it keeps not happening. Now they added some super-trendy natural language stuff in, and it will keep not happening. If the point is to get computers and robots to not be dumb in the real world, that's all just a big waste of time and money.
- e12e 3y agoDid I spot a flight sim among the demo video graphics? Can we hook this thing to a reaper drone and have it follow natural language instructions?
- wandynn 3y agoThe video generation effect is amazing, but can it generate long videos?