6 ms·
The discovery algorithm serves the consumer first and foremost. When users start complaining about not being shown interesting stuff, then Valve will jump into
by criddell 8y ago
The discovery algorithm serves the consumer first and foremost. When users start complaining about not being shown interesting stuff, then Valve will jump into action.
In this case, how do we know that the algorithm change isn't correcting a problem? I'm sorry for the game developer in the article, but every time his game was being promoted, somebody else's wasn't. How do we know he wasn't being over-promoted with the old algorithm? Without seeing everything that Valve sees, can we really know?
- sbarre 8y agoThe point here is not about this particular developer, but at about recommendation engines in general and the challenges they pose. I'm not arguing against algorithms here, there are just too many games on Steam to show everyone a raw list of products and let them fend for themselves.. You need some kind of automated curation. But as a seller of products, you have to put all your faith in the marketplace's ability to put your products in front of the right people as much as possible, and it can be frustrating when you suddenly start seeing data that shows this is happening less, and you don't know why.
- netcan 8y agoExactly what I meant. They're not meceydoing a bad job, but just having that central decider (human or botmaster) is disheartening.. when things don't go your way. ..it's a gatekeeper, and we have a complicated relationship with those guys.
- sbarre 8y agoFor sure, I agree and I know exactly where you're coming from.. A decade ago or so I was tasked with writing a recommendation engine for a "creators community" company I worked at, and the feedback we got after launching that feature was pretty much constant for as long as I was still working there. Everyone wanted to know exactly how it worked (so they could min/max for the logic) and no one was happy with the results.
- AnIdiotOnTheNet 8y ago> When users start complaining about not being shown interesting stuff, then Valve will jump into action. I'm pretty sure there are a lot of complaints about it, but as much as Valve tries to better the situation there's a significant problem: It is hard to match people with games they'll like based solely on broad metadata about both.
- deleted 8y ago[deleted]
- MattRix 8y agoFrom the article, we know there is a problem with the algorithm change because the "other product pages" graph stops matching the other graphs, see the orange line here after the start of October: http://greyaliengames.com/blog/wp-content/uploads/RegencyTraffic.jpg http://greyaliengames.com/blog/wp-content/uploads/RegencyTra... > every time his game was being promoted, somebody else's wasn't This isn't necessarily true. Imagine a recommendation list of 4 items being shortened to a list of 3 items... Or 4 small promotional thumbnail links being redesigned into a single larger image link for a single game. That larger image isn't going get 4x the traffic + clicks just because it's 4x bigger.
- babuskov 8y ago> This isn't necessarily true. Imagine a recommendation list of 4 items being shortened to a list of 3 items... Or 4 small promotional thumbnail links being redesigned into a single larger image link for a single game. That larger image isn't going get 4x the traffic + clicks just because it's 4x bigger. But that isn't the case here. "More like this" list was always 12 games. Both before and after the October change.
- mistrial9 8y agohighly naive to consider only new-style algorithmic truths; traditional markets are heavily manipulated at every turn, even under scrutiny and threat, no?
- shaki-dora 8y agono?
- j-c-hewitt 8y agoSteam's discovery and categorization are pretty awful. Despite never having purchased an anime visual novel, played one, or even looked at a store page for one, Steam advertised them to me nonstop on the front page. I blacklisted anime. Problem solved. But then I just get lots of trash tier roguelikes. A couple years later, I realized that blacklisting anime actually blacklisted all Japanese games entirely -- even those without an anime art style, which is too bad. My guess is that because those games are so inexpensive, they probably sell a ton of units irrespective of price and category, and if the system is optimized to show stuff that is moving a lot of units in a short period of time, it will bubble to the top. The other day, the only good recommendation I've seen in a long time came up: Battle Brothers has a new DLC, even long after the devs said they were not going to make any. But that's the only one I can really think of. I think most personalization features on marketplaces are kind of overrated. I care way, way, way more about sales than I care about 'personalization.' I am just about never going to buy something at full retail apart from daily essentials. I think his problem more realistically is that his category is extremely weird. Adventure solitaire RPG? How would you even begin to SEO that product page in a way that didn't cause a ton of confusion? Even something like Thronebreaker, which is basically a solo player card game RPG, does not try to distinguish itself on search. It promotes itself based on the strength of the Witcher brand and on Gwent.
- saulrh 8y ago> Despite never having purchased an anime visual novel, played one, or even looked at a store page for one I'm going to be honest, given this information I'm wondering how you know you hate them. Any individual recommendation is likely low-quality, but that's mostly thanks to Sturgeon's law - Steam certainly has a good enough grasp of what I'm looking for in a game to point me at the right genres.
- bfrydl 8y agoHonestly man I don't need to play an anime visual novel to know I won't like it. I don't like visual novels and if it's anime it's probably about high schoolers.
- watwut 8y agoSteam discovery is and was useless for years. It is not really a place to find games you might like.
- deleted 8y ago[deleted]
- mysterydip 8y agoI followed a conversation he started on Twitter about it, and every dev that responded had similar graphs for that time period. Still could be some bias, but there's more than one data point.
- Wowfunhappy 8y ago> The discovery algorithm serves the consumer first and foremost. When users start complaining about not being shown interesting stuff, then Valve will jump into action. Anecdotally, I've been seeing users complain about Steam's recommendation algorithm for a long time, on gaming forums like ResetERA.
- eropple 8y agoI don't recall a time when I wasn't hearing people complain about their recommendations. Steam's recommendations are legendarily bad in the circles I hang out in and I don't remember the last time I bought a game off of one. I may never have.
- BEEdwards 8y agoSteams algorithm sucks, it has a bad habit of recommending games I already own.
- joker3 8y agoBut not DLC for those games that I haven't bought yet....
- hutzlibu 8y agoHis point is, that he suspects AAA games get more favovered, because they make more money for Valve. So good for Valve, not necessarily the consumer who might have been happy with a less expensive indie game as well ...