12 ms·
The science of Destiny 2's 'uniquely complicated' netcode
- deleted 9y ago[deleted]
- aerovistae 9y ago> How do you build a game that blurs the line between singleplayer and multiplayer, where players can meet others simply by hitting "play Destiny," without any traditional matchmaking and lobbies? What? How can you blur the line? It's either online multiplayer or it isn't, there's not really an in-between. You can't "kind of" have other people connected to your game. They're either there or they're not. > It's an enormously complicated problem, and Bungie solved it. ....how is this any different from normal multiplayer?? What's so enormously complicated about this problem compared to every other multiplayer game? Yeah, there's no matchmaking. Great. This is still essentially like all MMORPGs, isn't it? Except it skips the lobby and just sticks you straight into the world?
- setr 9y agoThey mean that the game avoids letting the player realize the distinction exists; they go in and out of multiplayer "mode", presumably based on areas or turns or something, and are none the wiser. All multiplayer/singleplayer scaffolding occurs occur solely in the background IE the souls series, and its invader system. [edit] just read the article properly, it looks like they really wanted it for is seamless transition between "p2p bubbles", so you probably enter singleplayer when waiting for the connection, and you've got a wifi-like connectivity problem (but due to virtual land movement). So its not at all the issue of always-on multiplayer in general mmos; its more like guild wars "instances", and making the grouping automatic and no-felt-loading.
- Rotten194 9y agoSeamless singleplayer / multiplayer is an orthagonal problem to P2P network architectures, though. You can have one without the other.
- elefanten 9y agoWoW started instancing content out in the world several expansions back. As far as I remember and know, people can seamlessly phase in and out of each other's instances. In fact, I think the made it work across realm servers. So, it seems it's proven possible without this hybrid p2p model, which has a sharp performance downside for shooter pvp. I don't understand the decision. Is there something more nuanced experience-wise that their system achieves? Or could it be something else, like an attempt to save on infrastructure costs?
- datasage 9y agoWOW is instanced, but the instances are all hosted by Blizzard. Instances are basically a replication of the world state, and managed automatically depending on load. If you join a group, you will automatically switch to the instance those players are in. In Destiny, some of the instances are hosted directly on the client. Depending where you are and what you are doing.
- munchbunny 9y agoThe article doesn't convey the complexity very well. Destiny keeps PvP and PvE separate. For PvP, it's traditional PvP. But for PvE, there are multiple worlds made up of interconnected regions, but because of processing limitations (even if it's MMO, it's still an FPS), the sub-regions are individual instances. So you need seamless transitioning between regions, while having to find you a populated instance every time you cross a region boundary. Oftentimes you will be doing a 20-30 minute activity that has to cross multiple instance boundaries, so your actual quest state has to persist separately from the physics simulation. If you take their design of the game as a given, then yeah, that's a bit more complex than most MMORPG's. It's not really about matchmaking. PvP has explicit matchmaking, and in PvE lagging hit registration is generally inconsequential because it's not a competition. It's more about the fact that Bungie tried to work around the problem above using P2P servers. The problem arises when PvP is still handled in a P2P-ish way and you have hit registration problems. On a quick read, I'm not sure I fully understand it though, because if the physics server is dedicated, then why are there still hit registration problems?
- SXX 9y agoHandling massive amount of players is always challenging, but there nothing unique about it. PlanetSide 2 exist for years and its able to maintain hundreds of players in same area just fine and more than 1200 per "continent" which built of tons of small zones that have almost perfect sync between them. As for tracking character state and region instancing there tons of MMOs that doing it for years too.
- lesdeuxmagots 9y agoPlanetside 2 is exactly what this sort of reminded me of. In PS2, you can have over 1k players within an entire continent, which is a seamless quilt of many zones, each of which can have up to several hundred players (north of 250 is the most ive seen). The beauty of it being that there is no delineation between areas for players, but clearly the servers are somehow breaking down the continent in some way. So you can have a single battle raging across 2 adjacent areas with 96+ vs 96+, with the perception of being on a single battlefield.
- kaosjester 9y ago> How can you blur the line? It's either online multiplayer or it isn't, there's not really an in-between. You can't "kind of" have other people connected to your game. They're either there or they're not. Dark Souls does precisely this in a fantastic way in two major mechanisms. The first is the shared player "graffiti", wherein players can write messages that are then propagated into others' games. The second is the shared "death ghosts', which play back a player's last moments before death in others' games as a ghost you can't interact with. These make the game feel like you're playing with others in a large world without having to actually put you in the same instance.
- SquareWheel 9y agoNot to mention phantoms, where you can see other players's ghostly images occasionally moving around the world. Other subtle cross-over features exist too. In Dark Souls 1 you are able to hear other players ring a bell after defeating an early boss. A rare mob can also spawn in your world when a player dies with many souls (currency), or loses a powerful item. It definitely does much to make the world feel less lonely.
- wingerlang 9y ago> How can you blur the line? It's either online multiplayer or it isn't. I haven't played it myself, but "Journey" seemingly had multiplayer without the players even knowing it was. So while it IS multiplayer, the line definitely can be blurred.
- feintruled 9y agoI think a game that successfully blurred the line was Demons Souls and its descendants. You would see the ghostly outlines of players doing the same level as you, you could read and leave messages for other players, and you could summon or invade another persons game. Still despite all this, it had very much the feel of a singleplayer game (and could be played as such).
- nicholashead 9y ago> It's either online multiplayer or it isn't, there's not really an in-between Except there is - have you played recent games like Watch_Dogs 1 or 2? Your single player gaming is interrupted/sprinkled in with online events. And it works really nicely sometimes. You'll go to start a single player mission, but someone is hacking you, so you have to stop them first. Of course you can turn it off in the settings..
- judge2020 9y agoThere's a nice video on destiny 2's netcode that I feel goes more in-depth compared to this article. https://www.youtube.com/watch?v=ks5lgcCFvvE https://www.youtube.com/watch?v=ks5lgcCFvvE
- gruez 9y agothat's basically this article in video form.
- Kiro 9y ago> To shield the game from hacks on PC, Bungie is preventing applications from injecting code into the game. What prevents hackers from simply forging the network messages? How does loot, gear, economy, levelling up and other hard incentives work when a player is the host? Where's the authority?
- nichochar 9y agoFrom what I understood from the article, it's not a pure P2P model, but a hybrid model, which makes it particularly interesting. I think the conclusion of the article is very good: the experience is great in "free play" (when you're running around a world and people appear/disappear), but (very) bad for doom/overwatch/csgo style PVP (= the crucible).
- fokinsean 9y agoYeah there's been many complaints of people getting DOS'd in pvp play because it is relatively easy to find the player's ip address.
- drawkbox 9y agoThis happens in most PvP games though, eventually a hack is found that allows people to spam messages to win battles/races. In racing games this happens alot to slow other players or force them to disconnect. In Madden when it was on PC, it was very common for people to run something like this as they started to lose, forcing the other player to disconnect and losing reputation while they gave the victory to the player that didn't disconnect. Spam disconnections are handled better now and incentive is mostly gone from that through game design and verification (a user spamming is booted in cheat detection systems), but you have to be aware of that in PvP especially real-time battles, sports or racing type games.
- drawkbox 9y agoThe authority on these is validation against a server for verification when it comes to currency/purchasing and important events like leveling. You might be able to fake one and get one through (though difficult without understanding the system due to crypto/signatures/timestamps/one-time use) but it will be reversed in most good online systems after verification or not allowed due to that. The server/data is still the authority on the simulation and progress of all actors.
- jackmott 9y agoA peer to peer online game is a game where people are going to cheat a lot. You don't have to inject code to cheat, you can inject bits into the network stream.
- rootw0rm 9y agotrue, but to be fair, injecting bits into an encrypted stream is usually most easily done via code injection.
- Grollicus 9y ago> To shield the game from hacks on PC, Bungie is preventing applications from injecting code into the game. Whats different to like every PC game since 19something? I mean thats a core component of most anti cheat tools and copy protections? (And - spoiler alert - they never really work)
- jackmott 9y agoThe difference is with an authoritative servers many types of cheats become impossible. If the server doesn't broadcast the position of a player when it is impossible to see them, then the client can't hack to get their position. The player cannot cause themselves to move faster than is possible, or grant themselves health or items. There are still types of cheats that remain possible, like aimbots. Nothing can be done about that.
- rootw0rm 9y agoand all that still isn't anything new...
- Grollicus 9y agoBut with their offline mode they don't have authoritative Servers here so some cheats are inherently possible. Only defense is do be as obscure as possible and hide the important bits in megabytes of fog, aka. a race against the popularity of the game.
- kllrnohj 9y ago> If the server doesn't broadcast the position of a player when it is impossible to see them, then the client can't hack to get their position. It's peer2peer, there is no server. There's a server for exp, achievements, and loot, but for actual combat and player positions it's all p2p. Your client know the position of everyone else in the PVP arena. Arguably worse is it also knows the IP of everyone else in the PVP arena, so you don't even need to figure out how to crack the game just open wireshark and fire up your DOS attack of choice.
- 9y ago
- deleted 9y ago[deleted]
- politician 9y agoAfter reading the article, this netcode sounds like a complete mess. It's like Diablo 2, scaled up (contrast with Diablo 3). Maybe they'll throw a blockchain in there to help with the obvious hacking issues that will inevitably happen.
- zitterbewegung 9y agoLet me get this straight. Destiny has peer to peer server hosting at $60. Also it’s expansions are paid. Warframe (a similar game which people have compared it to) is free to play with no $60 up front charge and also has peer to peer server netcode. Nearly all of in game content is locked behind you grinding for resources and waiting for it to be built. Every expansion is also free. Why am I paying for a game if it doesn’t have dedicated servers? And I’m forming over money for the expansions ?
- angersock 9y ago>Why am I paying for a game if it doesn’t have dedicated servers? Do you think the game code and artwork is donated gratis by developers and artists? Fuck no.
- wppick 9y ago>Why am I paying for a game if it doesn’t have dedicated servers? More like: so $ATVI can grow 550% in 5 years.
- djrogers 9y ago> Why am I paying for a game if it doesn’t have dedicated servers? And I’m forming over money for the expansions ? Becuse none of the people that work on the game want to work for free.
- Viper007Bond 9y agoPlenty of paid games have dedicated servers. All of the Battlefield titles for example.
- deleted 9y ago[deleted]
- Jach 9y agoWarframe is just really good (except the latest expansion was rushed and had many bugs), it really has no business being F2P with how good it is.
- ranger207 9y agoThis sounds a lot like Elite: Dangerous's netcode model, which is pretty bad for many of the same reasons.
- qmachu 9y agoThat's what I thought about too.. except that Elite Dangerous is everything but a FPS and thus, does not require high tickrate / low latency. The game is definitely playable.
- dcow 9y agoWait what? ED absolutely has similar latency requirements as an FPS. The only difference is that you're in the cockpit of a spaceship dogfighting instead of controlling a person on the ground.
- zamalek 9y agoThe simulation is highly predictable because it's dominated by inertia. FPS is very twitchy, completely different beast. I've played ED at 300ms and have had no problems. That's barely playable for an FPS.
- jackmott 9y agoyou shoot at spaceships man
- deleted 9y ago[deleted]
- everyone 9y agoVery good analysis of this here. https://www.youtube.com/watch?v=ks5lgcCFvvE https://www.youtube.com/watch?v=ks5lgcCFvvE
- jgmmo 9y agoThe game limits multiplayer interaction big time. It's no more than 3 parties allowed in an instance at any one time, and that's where a single person can count as a party. So really how tough does the netcode be when you really just have instance based coop. PVP is basically csgo in space. Not too many people on each team. Only 2 teams. Etc. As an aside, as a gamer - terribly displeased with destiny 2. Huge dissappointment. Mostly because of it's multiplayer and communicated drawbacks.
- kllrnohj 9y agoIt's made tougher because it's p2p, which is a massive negative for players[1]. But it saves them hosting costs. 1: DOS attacks are a very real way that players cheat at these games, to the extent that many highly competitive shooters like CSGO go to great lengths to avoid leaking anyone's IP to anyone else. Everything, including voice chat on the same team, is bounced off of dedicated servers. Overwatch still sees some of this problem as voice chat on PS4 is peer2peer (controlled by Sony, so blizzard can't really fix it), so with some social engineering and fat fingering players can dos the enemy team. So Destiny 2 still doing p2p for crucible is pretty dumb, and if you're a PC player it's a complete crapshoot if you hit some annoying brat that's going to dos you in return.
- wwarneck 9y agoTo be clear for Overwatch only console party voice chat is peer to peer, not the in game Overwatch voice chat. This means you have to join a PSN party to reveal your IP. This is also true for Xbox One. Subtle but important distinction, don’t want to scare people away from talking in Overwatch but players should avoid console parties with players they do not trust. (Source: I’m a lead programmer on Overwatch at Blizzard)
- Froyoh 9y agoWow no need to brag
- Cthulhu_ 9y ago> But it saves them hosting costs. This is a stupid argument if they really have it; the game still requires dedicated servers on the one hand, and as many people in this thread already commented, it doesn't make for a good gaming experience. If they did dedicated servers and made sure the experience is polished, more people would play and keep playing, and they'd be able to make more money from in-game purchases and the like.
- Mtinie 9y agoAs an avid “Destiny” player for over two years, I was so excited to pick up “Destiny 2”. After three weeks, I’d reached a point where there were no motivating factors to keep me logging in. I haven’t even finished the raid...which, as a pretty heavy gamer, would be at the top of my aspirations when playing. The single-player campaign had so many moments where they hit high notes. But ultimately it was too short, fell into cliches, or hinted at a blended universe (first mission), but then took it away. I really wanted PvP to be the glue that held things together until D2.1 comes out in December. But with the horrid netcode inherited from “Destiny,” and the changes to formats and player counts, they neutered the one aspect that offers replay-ability. For a team with the experience they have, I’m perplexed with the apparent tone-deaf touch they’ve guided the game with. For their sake, I hope that it is the publishers fault :/
- snuxoll 9y agoDon't forget the grind for gear. I never finished Destiny 1 because the campaign was such a grind, playing Destiny 2 was a much better experience so I stuck it out for the end. Then I realized the moment you hit 200 in your gear level it becomes a painful process grinding forever to get new equipment. I can go turn in reputation items and get gear that is a lower level than what I have now, with the only potential upside of at least a purple item being valuable for dismantling to get shards for infusion. I'm just going to play Borderlands 1/2 again, even single player they're way more fun than Destiny 2 is.
- kevingadd 9y agoDestiny 2's netcode may be an engineering marvel that saves them some money on dedicated servers, but it sure undermines the game experience. It was a problem in Destiny 1 also - people exploited the P2P nature of the netcode & design flaws to cheat at multiplayer content and in exclusive content like raids to harvest rewards. People would manually firewall off their PvP opponents' IP addresses to harvest free wins, and in the PvE content they'd do things like have the current host disconnect to break bosses' AI and make them easy to kill. The P2P netcode also results in enemies teleporting around and glitching in difficult content, which is INCREDIBLY frustrating. In 2 I haven't seen as many cheats of this variety, but they remain possible. The real problem is that the multiplayer is a trainwreck: Loading into towns and open world areas can fail because the P2P host's connection is bad, and any time you travel more than a few hundred meters in the open world, all the other players vanish because you get booted to a new host. In practice this means that you don't get to interact with other players for more than a few minutes, AND you can only bring two other friends into the world with you due to the limited party sizes. As an engineer I can totally understand these constraints but the game experience just sucks. I can swap over to Playerunknown's Battlegrounds and get dropped into a 100 player match after about 10 seconds in queue, but joining a 4v4 PvP match in Destiny 2 takes upwards of a minute. The game's multiplayer aspects just feel incredibly dated. Despite this, the content is all tuned for multiplayer - the strikes and heroic public events are nearly impossible to complete solo, and the main sources of powerful gear (nightfalls, trials, the raid) require 3-6 players with good connections that can stick around for an hour+ without getting disconnected from each other.
- snuxoll 9y agoYou also can't matchmake nightfall strikes or raids, they're trying something new where you as a solo player can match with a party needing an extra member (once this "feature" leaves beta) - but ultimately unless you actually know people who play the game trying to access all of the content is difficult at best. The clan system in the game should be the cure for this, but ultimately it offers little in the way to actually communicate with your clan mates. At best you get to help level up your banner to get some perks and show a clan tag next to your name, beyond that they're useless. Every proper MMO on the planet has AT LEAST clan chat, meanwhile Destiny 2 relies on communications facilities provided by your platform and nothing more - which is a pretty big issue on the PC, since there's not exactly a way to join a group audio or chat channel on Battle.net.
- dcow 9y agoDestiny 2 has major issues with its "netcode" that other things like Skype and BitTorrent and Discord and generally webrtc don't have. I've played maybe 40-50 hours and will often get booted from parties and matches. At least a new leader is elected and it doesn't kill the whole instance. It also feels a little pathetic that I can hop around pve with two friends but as soon as a 3rd logs on our only options are pvp or the single raid (which we can't even help the newcommer grid towards since only 3 can do any of the leveling together). Maybe there's a bit of poor product clouding things but I suspect limitations are mostly due to poor technical planning. Not impressed with the netcodes.
- jokoon 9y agoI already thought about P2P netcode, and I think its great. It should scale much better, game servers are much smaller and requires much less bandwidth, and you don't risk of having a bad customer experience if your servers are poorly managed or go down. So it's better for games where you have a large amount of players and where latency is less of an issue. I would not have implemented a p2p netcode in a fps, as long as the game pace and speed is slow enough. And it doesn't mean you can't accelerate the game by enabling game servers in places where you want the game to be smooth, like sessions with more players.