11 ms·
This comment deserves a much more detailed response than I'm able to give at the moment, but I can give some very brief thoughts: Let me say that I have been w
by dijit 5y ago
This comment deserves a much more detailed response than I'm able to give at the moment, but I can give some very brief thoughts:
Let me say that I have been working in AAA online game development for more than 7 years now;
I have worked on games that had 10's of millions of players, and these were full fat $60 AAA games.
Cheating was the second[0] biggest issue of our games, it sucked the entire enjoyment out- getting ganked by a bunch of players shooting through walls is not fun.
Why did we "allow" cheating?: Well, we never did, we used some of the best anti-cheat software we could afford, but it was still possible to cheat.
"Don't trust the client" is a common response, but being fully synchronised to the server has drawbacks too; servers typically "tick" at about 10-20fps, theres a lot of tricks we pull off to make it seem as if it's going the 144-240Hz of your monitor, like showing hitmarkers (but not damage numbers) to make it feel as if it's fast, if your movements were synced to the server you would feel as though you were walking through water, as the movement would be very slow as it needs to do a 150ms round trip to sync a step.
The truth of it is if we fully synchronised every action to the server: not only would it feel abhorrently slow; it would require a full 3d rendered simulation of the game world, we'd be able to run maybe 3-4 users on 40 core machines with 256G of ram... that's not feasible.
"Don't make online games" is another common response to hearing the realities and difficulties of making these kinds of games.
But I'd suggest, if that's your response; even if we made them that doesn't mean you have to install them.
We're both making a decision here: We decided to make an online game because it can be a lot of fun, you decided to install an online game because it can be a lot of fun.
Cheaters want to ruin that fun, we have woefully few tools to prevent that.
(by the by: I'm not in favour of kernel level anti-cheat, but fuck are cheaters the bane of my existence).
[0]: Biggest issue was actually bugs, but when we fixed bugs, cheaters were the next primary complaint.
- okamiueru 5y agoWas there an attempt at detecting cheaters by modeling human reaction times and otherwise inputs, and thus detecting non-human like inputs?
- dijit 5y agoYes. Here's a good perspective on the situation by someone who was cheating: https://www.reddit.com/r/thedivision/comments/4k17n8/confessions_of_a_cheater_and_the_current_problems/ https://www.reddit.com/r/thedivision/comments/4k17n8/confess...
- okamiueru 5y agoThanks for the post. It was very interesting, however, I honestly do not see it addressing my question. Most of the problems he mentions are due to client-side trust issues. However, there is nothing there that should be hard to pick up by modelling normal behavior, and then being able to flag the anomalies. Most things he manipulated were known server side. Going the route of installing rootkits seems like fools errand to me, of which I can understand a possible non-nefarious intention behind... but it starts stinking to high water unless the other more obvious approaches are not seriously exhausted. Develop mathematical models for likelihoods of cheating based on user input, and non-conforming game states. Create a heuristic that takes into account time spent and the possible cost of losing progress. Move possible cheaters into isolated environments where they go up against each-other. Or subtly punish by reducing drop rates. In the post you linked to, he mentioned things like. 125-500% move speed. 200-2500% DMG increases, by manipulating client side states. However, surely, this is trivial to detect server side? The hardest things I can imagine detecting are probably stochastic cheats like randomly improving your aim and reaction time, but these arguably less severe, to a point where if it becomes super-human, it again becomes detectable. And, these are also the kind of cheats that typically can be done through user input, and thus very easy to make undetectable to any root-kit like anti cheat. For lest than the cost of one AAA game, you can buy the hardware required to do this processing completely outside of any rootkit. If cheating is your thing, and based on the post in question, the cheater could make back this investment in 15 minutes... arguably. ---- But, to sort reply to your answer to my question. I'm curious, do you have some more details other than "yes"? The post you linked, to me, read as "nope, The Division does not do that this at all. And if they did, very few things this person did would have been possible".
- foxfluff 5y agoI've had good experience in games with human moderation and recorded demos that you can play back to catch and report cheaters. After building some reputation and trust in the community, you'd be permitted to join a server with fewer random new users and practically no cheaters (and usually far more skilled players). No need for intrusive anti-cheat solutions (that IME just gave legit users trouble and still failed to stop cheaters). Of course, I don't expect AAAs to offer an experience like this, because human moderation doesn't scale cheaply to 10s of millions of players.. race to the bottom <3
- hi_im_miles 5y ago> Of course, I don't expect AAAs to offer an experience like this, because human moderation doesn't scale cheaply to 10s of millions of players.. race to the bottom <3 I think it does scale, but it requires users being able to host their own servers for your game. It doesn't scale in a way that maximizes control for the IP holder, however.
- dijit 5y agoWe did record demos and play them back, but cheaters are intelligent and will do things like change their ID after a game. They use IDs like “iIiiIiliiiiIii1” too, which means getting your report from someone who just takes a screenshot and doesn’t use the in-game report is just noise. Cheaters also do things like buy CD codes/stolen accounts which are sold cheaply on various websites. It also doesn’t help when there are promotional campaigns that let people play the game for free or very cheaply. We even had a problem with people buying the game with stolen credit cards. Regardless of that, human moderation efforts are a full time job, personally I’d be happy to release the server, but the server requires 40 cores and 256G of ram to boot, many people don’t have that, and that’s not including the kinds of nefarious things people did with the binaries of other games gameservers we gave out (like saving garbage back to our persistence, or trying to inject statistics to the leaderboards systems if there are any.) It sounds easy from the outside; if you think it’s easy I really do have a job for you. Maybe I’m stupid. But I was not told (for business reasons anyway) to hold on to the game server binaries. We did it because making the game was easier/possible that way and the gameserver itself is nearly impossible to load for most people anyway. I promise you that it is not cheap to host gameservers — if we could we would have pushed that burden onto players. (Speaking purely economically)
- oehpr 5y agoI would submit that this is more an issue of trust than it is an issue of forcing client machines into compliance. Because of the industries persistent belief that anti-cheat is somehow an effective strategy, let alone a morally acceptable one, has meant that development of systems that develop player trust in others has totally atrophied. This patterns of thinking "Well I'll just download a binary onto my clients machine and force it into compliance, then I can throw all of them into a big pot and they'll all mix just fine!" Is a kind of persistent insanity that is leading to your woes, more than it is the lack of a stiffer boot to land on the necks of client machines. "If we just control the platform" "If we just control the hardware" "If we just control the software" "If we just control everything". "And what of tools to moderate bad actors?" "Eh? Sure, here's a kick function."
- dijit 5y agoSure. But people want to run games on general purpose machines. I’m not saying it’s impossible to cheat on consoles but it wasn’t a problem for us (lag switching aside; which was actually easy to detect). Things like stadia help the platform more than consumers think; but people resoundedly rejected Stadia for a myriad of reasons. I think everyone here paints a rosy picture of what content moderation is, and maybe we stretched our hand a bit thin regarding having enough humans involved (despite games taking 700-1400 people 4+ years to make in the first place)- but the rub is that people can’t have everything. We can’t expect you not to try to tamper with the binaries and ruin games for others. You can’t expect us not to try preventing it. Because at the end of the day; people do submit reimbursement claims because of cheaters ruining their experience, and if there’s one thing that I can promise it’s that no amount of human review will ever be sufficient, we already put 70 or so humans on reviewing reports, and even then it was difficult to punish people, because if you ban someone they just buy another key from a Russian third market reseller for €3 (or if you make the game free god help you)
- oehpr 5y agoI'm not saying "You just need more humans to review and kick cheaters". I'm saying that players often have the barest bones of ways, if they have anything at all, to say who they would and who they would not like to play with. Players refunding over cheating are also refunding because, when they discover cheating, they can do absolutely nothing about it. If they're lucky, they might get to scream into the void and hope a moderator listens. Some brand new player on a $3 key just waltzed into the pool of players and everyone has to trust them as equally as everyone else. This is not how trust works. But then how should one do it? I don't know! Precious little work has been done here. And why? Because it's been wasted on pretending that one can trust the clients machine if we just download enough malware to it.
- oauea 5y agoSo you distribute rootkits to make money. Sounds unethical.