7 ms·
Steam needs to stop asking its customers to fix its problems
- legitster 10y agoI don't get what the ask is. Steam should be even more heavy handed? They should hire people to playtest other people's games? I don't see any alternative reality where they have already taken these actions and are less hated for them.
- elthran 10y agoI think the author wants to suggest a solution where anyone can submit a game, but there is still some sort of quality check before it goes on sale. Currently, we have floods of garbage hitting Steam, with no curation at all. Pre-Greenlight, Steam was a closed shop that was hard to get into. What is needed is a healthy balance, that doesn't have zero chances for an indie game to be seen because it's buried under all the AAA titles, yet doesn't allow trash like Slaughtering Grounds to be sold. The article suggests getting Valve employees to playtest any submission - however, I feel this still wouldn't work due to Valve's 2 main issues. Their flat structure, where people work on what they want - who wants to look after content curation? Secondly, they take a cut of every game sold - regardless of how awful it is. They are financially incentivised to keep subpar (or even scammy) games on the store. I'm not going to pretend I have a solution, but I feel all the issues with the Steam store currently are issues of Valve's own making - the problem is, they don't (seem to, at the very least) care.
- jessaustin 10y agoTheir flat structure, where people work on what they want - who wants to look after content curation? Are you asking, who wants to play video games for pay? One expects that someone could be found...
- elthran 10y agoWell, I was attempting to frame it in the context of the current, free-for-all situation. So, more "who wants to wade through potentially piles of garbage unity-based asset flips made by one guy in his garage, while potentially stumbling across a couple of commercially viable games"
- falcolas 10y agoPersonal Anecdote from a former videogame QA tester and min-spec discoverer: Playing video games as a job is not playing video games. It's software testing a GUI. Basic "does it run on X platform" is even more boring (but more automatable).
- legitster 10y agoBut back in the day people used to hate on Steam because they were a closed shop that was hard to get into. So from their perspective they have to go from being unpopular one way to being unpopular another?
- throwaway2048 10y agodifferent people want different things you cannot satisfy everyone at once.
- BEEdwards 10y agoThey are a multi-billion dollar a year company, they can hire a third party to play test game before they release them on steam. They are destroying their own brand by not doing it.
- sp332 10y agoPeople would be more willing to put money down if they knew they weren't getting garbage in return. A little QA can improve sales.
- falcolas 10y agoThe ask was pretty clear to me: "Game is submitted to the store. Human plays game, finds it doesn’t work. Human emails developer and says, “This game doesn’t work, fix and resubmit.” Done." Doesn't even have to be a human for some of the "does it launch on a sample of devices" tests. You can't get your game onto XBox or PS without passing these kinds of basic checks, and this has an impact on the Valve brand. I'm just not sure Valve has someone in charge of ensuring that their brand is maintained.
- pentae 10y agoIf Apple can manually review and curate the thousands upon thousands of apps a day being submitted to the app store, I think it's reasonable for Steam to manually check that 30 new games a day load and actually work.
- JamesBaxter 10y agoI think you could use Steam Achivements and playtime to recommend games to people. If I've played a game to completion on the highest difficulty presumably I like it. Find me other games that people with the achievement also play and have the equivalent achievement on and you've got something basic.
- vocatus_gate 10y agoMax or close-to-max achievements for a game also is an indicator of skill, could be used to weight a games scores more towards "recommended by skilled players" vs. "recommended by casual players" ?
- JamesBaxter 10y agoYep, you could use achievement rarity too. If 100% of all players get an achievement don't use it for recommending or 1% have it increase the weighting?
- falcolas 10y agoI would have a hard time equating achievement coimpletionism as skill, to me they are more of a measure of time spent in a game. Yes, some achievements in some games do require a mediocrum of skill, but most of them do not; they're used primarily as a form of feedback for the developer on how people play their game, and secondarily as a lure for completionists who want the points on their profile.
- dkns 10y agoI agree. See for example achievement 'Astronomically Low Odds' from Faster Than Light: http://ftl.wikia.com/wiki/Achievements http://ftl.wikia.com/wiki/Achievements "Fail to evade 5 shots in a row with a full powered and upgraded engine." It's almost pure luck. Wiki mentions ways that you can increase odds for you but still it's mainly luck.
- jon-wood 10y agoIt only dawned on me today that achievements aren't really for the players, they're the gaming equivalent of Mixpanel, allowing developers to see which parts of the game players are actually experiencing.
- gwbas1c 10y agoUhhhh... Steam needs a decent startup time. I only play computer games about once a month. When I click on the link on my desktop, Steam always takes 5-10 minutes to update itself. This is ridiculous. I never have this problem with games on my Nvidea Shield.
- elthran 10y agoSteam's startup time is completely reasonable. What would a reasonable time for startup be in your eyes beyond 5-10 minutes before you play your games once a month? 1 minute? Instant?
- tdb7893 10y agoI would prefer it if the update is unimportant if it downloaded it while steam was running and installed it when it starts up next time. But at least for me I seem to always have to wait for a download, which is especially annoying when trying to play with friends
- jon-wood 10y agoIf you leave Steam running in the background that's exactly what happens, and it does the same for any games installed.
- falcolas 10y agoThis particular problem is shared by every game distribution mechanism that exists. Xbox One, PS4, Steam, Origin, UPlay, all of them. Even stand-alone installs (which are stupidly rare these days) auto-update themselves on first load.
- Cthulhu_ 10y agoHow many updates does the Shield itself and the games on there get per month? I know Android automatically updates apps in the background, just like iOS; if you have Steam autostart in the background (which I do),the startup time becomes negligible and the updates unnoticeable. But that's the benefits of PC gaming, you get the choice on whether or not to have things start up and keep updated in the background - and if you choose not to, you end up with a situation like that. I think it's pretty cool that they have a development pipeline that allows for frequent releases.
- smacktoward 10y agoThe problem with Steam is Valve. Valve is famously organized as a place where everybody gets to pick the problems they want to work on (https://www.bloomberg.com/news/articles/2012-04-27/why-there-are-no-bosses-at-valve https://www.bloomberg.com/news/articles/2012-04-27/why-there...). Manually reviewing dozens of (mostly crappy) games every day in the hope of finding a few that are worth recommending is the kind of dull, grinding work that nobody would ever pick for themselves to work on.
- mjolk 10y agoCore complaints of article (please add any that I missed): 1. Steam receives dozens of releases a day and it's difficult for developers/publishers to make their title stand-out without performing marketing. 2. Author perceives that Steam's display algorithm results in display of outliers (very good/bad). 3. Very low quality titles are released/being sold by Steam. 4. Reviews are a very poor metric as reviewers can be shills or rate content poorly out of pettiness or malice. 5. Author thinks that staff-curated titles are the solution. My responses: RockPaperShotgun is a game review site. Reviewing games is how they manage to make ad revenue (well, besides click-bait articles). If the defense is that more content comes out than RockPaperShotgun can review, then RockPaperShotgun should hire more people. If that's cost prohibitive, and there's market demand for it, then why are they asking Steam to do it? 1. Welcome to selling anything. 2. I don't know if this is true; I'm not rejecting this claim, but I'd love to see the data. 3. Quantifying "good enough to sell" is a risky game. I'm okay with spending $5 (most of a beer at a bar) on something kind of buggy if it's amusing for 30 minutes. For someone else, that amount may be double or $0 on principle. 4. If this subproblem gets solved without background checks on reviewers, you have a serious business that Amazon/Yelp/etc would love to buy from you. 5. Beyond catching content that simply _does not do what it says on the box_, this is all personal taste. And as an aside, there's a "curious" market that exists in low-quality games that have DLC/content that ends up on the Steam Community Market (Steam gets a % of each transaction), so the "how did a broken game end up on Steam?" question has more depth than a casual observer would guess.
- zamalek 10y ago> Core complaints of article (please add any that I missed 6. Games that received poor reviews are relegated to the trash bin forever. Response: Untrue.[1] The converse also applies, games don't keep their good reviews forever - this helps identify abandonware or post-hype truth. [1]:http://store.steampowered.com/news/21695/ http://store.steampowered.com/news/21695/
- ramy_d 10y agoAsking review sites to sift through the dredges in the spirit of "more business is better!" is naive. Jimquisition comments regularly on this and it has turned into a longstanding and ever constant critique of Valve and its "Whatever goes" attitude to getting on their Steam platform. At 20 or 30 new games _a day_ consumers don't have time to go on review websites and see what's on the "do not touch list". What a monumental task for consumers! If steam would block games that, out of the gate, did not work, that would be great. As the author stated: This morning in half an hour I got through three interesting-looking games that didn’t have functioning controls. You can't even play them! How are unplayable games on Steam!? Additionally they should make sure that the min spec IS an actually min spec that run the game in a playable state. No studio should be immune to such a level of scrutiny (see Rocksteady's Batman Arkham Knight).
- drivingmenuts 10y agoI'd rather Steam get back to the core business of selling games, rather than trying to be some sort of oddball social network. Drop the achievements (do a large number of players actually pay attention to that?), drop the trading cards (I still don't know WTF those are for). Drop everything that isn't about selling a game to a player. Then hire some competent UI people to simplify and clean up that abhorrent interface that tries to do too much. In fact, separate Steam from Valve entirely. Let Valve focus on producing games and let Steam focus on selling them, but put a wall between them.
- striking 10y agoThe trading cards are part of the Steam economy. It's a money-making ploy. I don't know if it works or not, but it probably does. If they dropped everything that isn't about selling games to players (Steam Matchmaking, social features, the Steam economy especially wrt CS:GO and Dota) I don't think Valve would be able to sell and host games as cheaply as it does, and I think more people would pirate games rather than getting them on Steam.
- chrisdbaldwin 10y agoDing ding ding! Each one of those trading cards facilitates trade. When there is more trade, there are more transactions for valve to skim. It's simple broker economics, and it works great for everyone involved.
- elcapitan 10y agoExcept for the people who get annoyed by a message in Steam for every new achievement for jumping from platform a to b (like me).
- dageshi 10y agoValve doesn't seem to really care about making games for the sake of making games, they make games if they can do something new/cool which hasn't really been done before. In other words, it's not that Valve can't produce games right now it's that they don't want too. They're too busy with Steam/VR cause those things are new/cutting edge.
- researcher11 10y agoI'm an applied researcher in search science. This is a very typical domain specialized search problem. These days it uses Big Data, Machine Learning, constant experimenting / prototyping, A/B testing. I get to geek out each and every day. It is my dream job :) I consider it one of the main reasons Apple lost so much content market share to Amazon despite Apples first mover advantage - Amazon has better search and you can actually find the stuff you want. AFAIK Apple tried to start up an applied research group to fix the problem but they refused to pay enough and ended up with the dregs. They tried to hire me 3 years ago for $130K. It highlighted that they didn't understand the importance of the problem and we're likely to fail. I typically make ~$240 as FTE and more as a contractor. Apple also has a culture of secrecy where as search science is pretty open. Anyway; I checked out Steam. The search there is clearly very poor and can easily be improved. The overreliance on tags is usually a good indication that they are not digging into their usage data for their recommendations.
- mrskeltal 10y agoCan you recommend some readings for developers who aren't familiar with search science?
- researcher11 10y agoIt's basically the union of Information Retreival, Big Data, and Machine Learning. There is a lot of good and bad info out there. It's best to tailor your learning around a problem so you can get feedback on what works. Building bespoke search engines is expensive and often not worth it until the problem is big enough. Machine Learned optimization is even more expensive. So in the likely instance that your problem is small; I'd stick to an off the shelf Lucene. If you need more specialization write plugins for it. If you need more speed then DIY OkapiBM25 in native (maybe Rust these days). If you need Big Data I'd use Spark. If you need ML then GDBT in R. If you need advanced NLP then Deep Learning. At each stage it's usually diminishing returns. So quit once you start losing money on the additional effort. Edit: As a fun aside. Page Rank doesn't work very well and AFAIK Googles major advance was from creating 'meta documents' using anchor text and search queries. Google has a habit of sending out red herrings to guard their important ideas. So if some blogger is waxing lyrical about Page Rank you know they're full of it.
- TorKlingberg 10y agoPeople love to demand that Valve or Google hire lots of people to do manual curation or phone support. Yet that costs money, and people would buy their games elsewhere it it's two cents cheaper.
- majewsky 10y agoI don't know. There might well be websites or apps where $game_that_i_buy is 2 cents cheaper, but I don't even bother with anything else than Steam. I've just decided to buy into the ecosystem. The question then is: How common is my behavior among Steam users (or gamers in general)?
- arca_vorago 10y agoHonestly I have been thinking more and more about the problem with steam, and I realized that even as a foss, anti-drm proponent, steam is one of the few things I have bended for on those positions because of the quality of the marketplace. If they continue to fail, I truly hope something like Lutris or Desura or GoG steps up to the plate and open sources a game store (bonus if DRM free like GoG is). I mean, does anyone remember the days of hating games that required you to have a CD in the tray so you would get a noCD warez just to play? Steam solved those issues, which is what propelled it to it's current state. I don't think that's a problem with modern games though, so perhaps steam is weaker than Valve realizes if people ever actually thought about it. Now it's main function is as a game library stored in a cloud. That makes me really sad to realize too, because I feel like Valve is one of the only companies that has the resources to really push linux gaming into a new zone, but this hasn't been delivered on yet. I highly suspect they are waiting for Vulkan, but the time can't come soon enough to offer many people the last reason they need to switch to linux from windows: gaming. I have also noticed this sort of let the customers do the work for us attitude far too often lately. For example, I am loving working in Unreal Engine 4, but they promised a native linux editor and then ingored it for a long time, only once linux native users submitted enough patches to their own fork(s) before Epic finally spent some time to push those changes to the official repo. I think sometimes open source users who want things do work to get them but some companies abuse this process. In Epic's case, we still don't have a marketplace launcher on linux, and there are tons of editor bugs, such as I can't even edit skeletal animations/rigging without crashing the client. There is a balance to be had between user help and the companies that need it, but that pendulum seems to have swung far too far over to the user lately, and it needs to readjust.
- kelvin0 10y agoI've been using Steam for many years and I play 5-10 hours a week. I simply find it great, to purchase games and play them (unlike EA origin and all it's clones out there, last time I checked) The way I decide to purchase a game is simple: 1) I see/read a review about a game 2) If it piques my interest I go check out some videos and read a few more reviews 3) Add it to my wishlist 4) Purchase it when it's on 'special' Finally, I almost never buy games unless they are at least 1 year old (save a few exceptions). This article seems mostly to have a contention about new releases and the 'suggestions' made by Steam (which I almost never look at anyways). Hope this can help others with their Steam purchases.
- slantyyz 10y agoI understand that the reviews and discoverability are legit problems for smaller developers trying to sell their games, but I have to wonder what percentage of people using Steam are simply "in and out" customers who are looking for the known titles anyways. Those people (like me) don't care so much about user reviews or discoverability. I'm an "in and out" customer - I love games but I basically only buy big name titles (old behaviour from my console days). I know I'm missing out on some other great titles, but I only have a limited number of hours to put into games. The only time I might get a lesser known game is when it got a lot of buzz outside of Steam, but the most likely scenario is via a heavily discounted bundle that contains a big name title that interested me. Of the ~100 games in my Steam library, only about 20% are games I specifically wanted the buy. The rest were basically freebies that came along for the ride.