Hi all!

I'm running a poll about people's thoughts on Steam's newly announced changes to store user reviews.

You can read the blog post here:

https://store.steampowered.com/news/app/593110/view/4326355263805583415

Feel free to let me know your thoughts on the changes here! I'm writing an article this week talking about it and I'm keen to hear what the thoughts are from Steam customers and developers.

3 months ago

Comment has been collapsed.

What do you think about Steam's Changes Coming to User Reviews?

View Results
It's a positive change
It's a negative change
Unsure/Don't know/Indifferent

In my experience of comparing the new system with the old system, I think the new system is absolutely horrid in practice and just seems to have the positive reviews rise up more to drive sales (or it's just not properly calibrated yet).

Examples:
Payday 3 - https://store.steampowered.com/app/1272080/PAYDAY_3/
Concord - https://store.steampowered.com/app/2443720/Concord
Diablo 4 - https://store.steampowered.com/app/2344520/Diablo_IV/
Wo Long - https://store.steampowered.com/app/1448440/Wo_Long_Fallen_Dynasty/
Chivalry 2 - https://store.steampowered.com/app/1824220/Chivalry_2/

I don't have anything against those games, I haven't even played them, but you can see how few "helpful votes" a positive review has compared to the negative reviews. The helpful votes are almost always above the negative in sorting (and the negative are pushed all the way to the bottom) usually if you sort by "Summary" or "Most Helpful" with their new system. Some of the reviews don't even list how many "helpful votes" it has, indicating maybe 0 (?) but they are still above negative reviews with dozens or helpful votes. If you disable it, the negatives rise up to the top.

I don't think there's a way to set a "default" review order and to disable it so I have to remember to disable it every time I look at reviews.

I definitely like the idea of removing dumb meme/joke/not helpful reviews from the summary (while keeping it in the review score) but instead that's not what it actually did in practice.

3 months ago*
Permalink

Comment has been collapsed.

The helpful votes are almost always above the negative (and the negative are pushed all the way to the bottom) usually if you sort by "Summary" or "Most Helpful" with their new system. If you disable it, the negatives rise up to the top.

I just glanced at Diablo 4s reviews and sorted by most helpful... would say about 75% of the reviews shown are negative ones, with the top ones being all negative. I even see negative reviews with fewer helpful votes above positive reviews with more helpful votes.
so there is some other criteria in the background for the sorting.

3 months ago
Permalink

Comment has been collapsed.

You see what I mean more if you stick to default, which is ticked for new helpfulness and "summary" sorting. The sorting by "Most Helpful" of new helpfulness vs old system has less variability but there are definitely some games where there's a massive difference with what order the positive vs negative are shown. Regardless, I think the positive always moves up spaces if you use their new system. I don't think these are cherry-picked, they are just games that I am interesting buying and looked at the reviews.

Not trying to be all negative, I believe (and also hope) that Valve will continue to improve it and change the weighting for factors but right now, I don't think it's good.

3 months ago
Permalink

Comment has been collapsed.

Case in point: Skull and Bones currently sits at Mixed with 62% positive reviews and yet the whole page features 5 negative reviews out of 20, 90% of these are not about how the game actually sucks but about Steam issues (and one guy who complains about his kid having bypassed the tutorial and not knowing what to do next because apparently he doesn't know Youtube exists)...

I mean... I'm aware that there is a lot of negativity around the game (most of which justified but most likely expressed in various pointless levels of immaturity) but Steam combing through valid negative reviews to find a few they can display that won't reflect the actual issues with the game just so they look fair is kinda funny.

3 months ago
Permalink

Comment has been collapsed.

from what I have read its just pushing the meme reviews to no longer be the top displayed ones, they will still be there and readable.

so its a good change for those who want to see why people like/dislike a game to see actual reviews instead of ascii images and memes.

3 months ago
Permalink

Comment has been collapsed.

It's keeping the old but defaulting to the new. I think that's great.

I'll still be careful when purchasing by reading positive and negative reviews but the community fun ones are important to people like me too.

I like the new system in theory, let's see how it rolls out.

3 months ago
Permalink

Comment has been collapsed.

By just checking some games i did not had the feeling that the reviews are more informative.
Quite the opposite there where games where the top shown reviews say even less about the game then before.
The game Dex for example has right now only 4 top shown reviews that are longer then a single sentence (some of them even less) out of the 10 shown ones.
With the "old" system it is the other way around.
Thankfully we can choose how we want it to be shown, as it is obvious that the new feature does need more work to work proberly.

3 months ago*
Permalink

Comment has been collapsed.

I thought it already started like a week ago?

3 months ago
Permalink

Comment has been collapsed.

It did, almost 2 weeks ago

3 months ago
Permalink

Comment has been collapsed.

Didn't you made the very same topic about a week ago?

3 months ago
Permalink

Comment has been collapsed.

The last one was about store descriptions.

3 months ago
Permalink

Comment has been collapsed.

It was exactly the same post and almost the same title but no the "thread" last week was about the change of rules for games descriptions

3 months ago
Permalink

Comment has been collapsed.

I don't really care about game reviews but since the review section has become such a shit show, it doesn't really entice me to scroll down just to read the same BS on every game page. Maybe the cleaning job will make me scroll down again... then again maybe not.

3 months ago
Permalink

Comment has been collapsed.

It will come down to minute execution, but no one reads my reviews anyway.

3 months ago
Permalink

Comment has been collapsed.

i dont trust them
before they implemented a new system to stop review bombing games, they claimed would work both ways.
when two game were review bombed for the +% one cause of memes and another cause i dont recall they didnt do shit. they only went after games that were negatively reviewed in mass for things like stealing music, firing staff who made game, dev who made game was rapist, so on
just another tactic to boost overall % and steam sales

3 months ago*
Permalink

Comment has been collapsed.

I like having options. So, I'm good with this.

I don't really rely on the product page's highlighted reviews anyway. I generally go to the review page, look at the most helpful, spend about one to two seconds clicking on negative only, read some of those, spend another one to two seconds clicking on positive only, read some of those. I'll then visit the forum, see what's being said there. And from there, I'll consider the overall picture.

3 months ago
Permalink

Comment has been collapsed.

Sign in through Steam to add a comment.