Greetings, everyone.

I'm currently working on a graduate work in the sphere of game recommendations, for Steam users.
We have been studying the system and algorithms on figuring the best approach to recommend games lately. Thus, it would be a great help if some of you can help me with that by testing how well this whole project works at this moment. In order to do that, please visit the site.

http://steamrec.com/newgames/

You'll have to choose one of four available algorithms or auto mode and give a score (from 1 to 5) depending on how well system managed to meet your preferences at choosing suitable games. (I'd really appreciate if you can test all 5 algorithms, even though that's not really necessary)

How it works:

  1. Choose any options: algoritm and filter;
  2. You should copy your steamlink and paste it in string "Profile link", after click recommend;
  3. Rate this pool of games as whole.

Some problems:

  • Keep in mind that you won't be able to use the service if your Steam profile is private since your public information (in order to perform the test) can't be accessed from the profile.

  • When you put wrong link, you will got error 500 (will fix soon)

  • Server is very weak. So, you will get some troubles probably.

Giveaway

7 years ago*

Comment has been collapsed.

Bump!

7 years ago
Permalink

Comment has been collapsed.

Well, I rated the "content-based" algorithm one and a half stars, because half the games it recommended were already in my library. That's a bit of a problem.

7 years ago
Permalink

Comment has been collapsed.

Friendly bump for now :)

7 years ago
Permalink

Comment has been collapsed.

Tried content based. From 9 suggestions, I already owned 4, 1 would be interesting and 4 are pretty much the last kind of games I'd play (CoD).
User based was much better. But mostly games from series I already own or games from my wishlist.
Item based seems to be all over the place. Just random suggestions. SVD was decent, in comparison.

7 years ago
Permalink

Comment has been collapsed.

error 500, might try later when it's back up and I don't forget
edit: actually some really interesting recommendations!

7 years ago*
Permalink

Comment has been collapsed.

error 500 :/

7 years ago
Permalink

Comment has been collapsed.

Well, content based worked out best. The other threw things a my, I had a look at and decided it was nothing for me. So it probably makes sense to show them to me, because they seem to be to my liking... but aren't :]

7 years ago
Permalink

Comment has been collapsed.

No idea what the algorithm is but at least in my case I'd say it doesn't work particularly well. Usually only 1 to 5(very rarely 5) of the games recommended would be ones I'd even consider and 90% of the time they're already part of my wishlist or installements from franchises I partially own which kinda beats the point. I do see a correlation between games I own and have hours logged in and the types being recommended so it's not THAT far off either.
Have you considered along with the pool rating to give the option to rate individual recommendations with the algorithm, saving that data for that session and adjusting to that? Also if this is based solely on hours played there's a big pitfall there to avoid, idling. That generates incorrect data so achievements earned might be a better metric used in conjunction with the rest of the data.

I tried all algorithms multiple times and the one that came the closest were mostly Content and Item Based. User and SVD rarely got more than 2 right, in fact they even brought up games I have marked as "Not Interested" quite often(I know you can't pull that data, I'm just emphasizing how mismatched it was :3 )

Anyway best of luck with your project!

7 years ago
Permalink

Comment has been collapsed.

Did it with every combination possible, both popular and without, including auto.

Im not sure this method (without any questionaries) is the best.
Surely it works for what it focuses most - an overall formula- but it avoids gathering data that could help you change the algorithms; All it does is telling wich of the versions is 'best' right now - and only by aproximation, i mean, with a bigger data set(more testers) and perhaps even in a different day the result could be different (depending on how the algorithms work). For example as of late i have been playing a lot of retroish games and rogue-likes. Couple weeks back i was into fps. A month ago rpgs. Considering how many weren't really played before, how much of what i won i actually like or not...

Theres also a fuzzy definition of recommendation. We can interpret it as 'kind of games you like/might like' or more specific/better 'games you might like that you're unaware of'.

7 years ago
Permalink

Comment has been collapsed.

No matter what I do, I get Server Error (500)

7 years ago
Permalink

Comment has been collapsed.

Edited;

I was getting "Server Error (500)" over and over but I just tried it again and it worked. I got 12 recommendations on auto settings. One was an RPG from my wishlist. There was Timberman and Five Nights at Freddy's and a cheap multi-player FPS - none of which look like games I would play. There was also a bunch of RPGmaker games and visual novels that I wouldn't claim a key for if they were free.

Content-based got me a 50/50 mix of stuff that was on my wishlist and stuff that looked like complete poop. User-based was almost complete poop. Item-based was actually complete poop. Whatever SVD is got me a few games that were already on my wishlist, a bunch of HOGs, a couple more RPGmaker games and some games based on strange regional sports from the USA that I'm sure I would find repugnant if I actually understood them.

I'll admit I'm probably not the best test subject for this kind of thing though - given that I'm forced to do a fair amount of gaming in offline mode stats from my profile might be a bit off...

7 years ago*
Permalink

Comment has been collapsed.

mate, it's good. I need every opinion for now. Thanks for checking.

7 years ago
Permalink

Comment has been collapsed.

"Server error (500) here"

7 years ago
Permalink

Comment has been collapsed.

Bump!

7 years ago
Permalink

Comment has been collapsed.

It should really filter out owned games from the recommended results. Without this it is useless.

Also, it should filter out "hidden" games before running algorithm.

7 years ago
Permalink

Comment has been collapsed.

error 500 right now but it sounds interesting so I will try again later

7 years ago
Permalink

Comment has been collapsed.

Bump

7 years ago
Permalink

Comment has been collapsed.

ERR_CONNECTION_REFUSED
localhost rejects)

7 years ago
Permalink

Comment has been collapsed.

it says error 500:( Maybe I will try some time after thanks:D!

7 years ago
Permalink

Comment has been collapsed.

yeah, thanks for checking and testing. I should fixed something now.

7 years ago
Permalink

Comment has been collapsed.

I just tried it and it worked really fast, here is my feedback. However, I chose not to "rate" any algorithm because I didn't want to spoil it with my (perhaps) unexpected requirements & higher standards:

  • Auto - 1/12
  • Content-based - 1/12
  • User-based - 2/12
  • Item-based - 0/12
  • SVD - 0/12

Why so low? I use Linux and if the game isn't supported on my OS I have no interest in it (in fact, I don't even know most of the games that were recommended). Perhaps the algorithm could be tweaked ... in my case, 98% of my playtime is from games available on Linux - this should be a pretty obvious indicator of a preference (likely, anything 90% and above would be).

7 years ago
Permalink

Comment has been collapsed.

Thank you for you explanation. Good point. I could add options about OS.
Btw, This work just a start and I need time to imrove this service and realize some other parts of this service.

7 years ago
Permalink

Comment has been collapsed.

The not well known game recommendation I didn't know a lot of it but I knew a few of the games that I had or would be interested. The popular game option for all the choices had a lot of games I knew and was or still interested in. So I thought it worked fine.

7 years ago
Permalink

Comment has been collapsed.

Bump

7 years ago
Permalink

Comment has been collapsed.

All filters work almost the same for me:

Most games i am interested in, majority on my wishlist
Few games i played similar, so i could find them interesting and i understand why they are there
And the rest i have no interest in and have no idea what are they doing there

Just a suggestion, maybe add filter for wishlisted games(to include them in recommendations or not) :)

7 years ago
Permalink

Comment has been collapsed.

Good point, but as I said it's just a start.
Also, steam api doesn't provide information about wishlist. Other way could has lower perfomance.

7 years ago
Permalink

Comment has been collapsed.

I know it is just a start and i didn't know that steam api is not providing information about wishlist, so it works great then. Since it suggested nice amount of games i really want to get/play some day :D But then again i like playing games of various genres, so it is harder to miss what i would like to play :)

Also not sure if that is a bug, but just wanted to mention that from time to time it show less than 12 games in the grid.

7 years ago
Permalink

Comment has been collapsed.

I could name it "bug', but it's one more problem in service. (for real) :)

7 years ago
Permalink

Comment has been collapsed.

Also, thanks for testing.

7 years ago
Permalink

Comment has been collapsed.

You're welcome :)

7 years ago
Permalink

Comment has been collapsed.

beump

7 years ago
Permalink

Comment has been collapsed.

500 error
/shrug

7 years ago
Permalink

Comment has been collapsed.

wait some seconds and try again.

7 years ago
Permalink

Comment has been collapsed.

Closed 7 years ago by TinyLuther.