Great work, but you mention yourself that the sample is biased as you only sampled SG users (forum users at that). Do you plan to sample users from other sites as well? If not, this would be something any thesis advisor should ask you to do.
GL with your dissertation.
Edit: I doubt your sample is representative. You mention, you compared your sample to Steam's hardware survey. Of course SG users sample Steam users, as hardware is mostly based on the available money, but why should it hold true the other way? I would think that SG forum users are more active in general than the average Steam user.
Comment has been collapsed.
I'm not too familiar with all the terms the OP use but I'm doubting the sample to be representative as well. If you look at the education you see that 60 % have an university degree. It is unrealistic to believe that this is represantitive for the whole Steam Community. It rather shows the willingness of people familiar with scientific work to help you. The work may still have it merits but I would be prudent on how to formulate its representativeness to others.
It would be interesting to gather information from other sources with another level of education and look how well it compares. Looking at the timeframe this may be in the works or come for the future. After all the survey is from last month and a dissertation takes normally a bit longer.
Comment has been collapsed.
Yeah, the best way would have been to post the survey on Steam forums but according to the Steam Online Conduct they can not be used in connection with surveys.
The sample is only representative for the mentioned variables, you are right, SG users might have higher (or at least different) engagement toward Steam than the average Steam user.
Comment has been collapsed.
Have you tried to contact Steam and ask them if they would support your research, by allowing a survey (or best case feature it)?
Comment has been collapsed.
Other thought: Have you asked cg, if he could provide you with numbers of users visiting your old thread in the given timeframe, so you can determine the percentage of people participated in the poll? (If those numbers exist)
Comment has been collapsed.
"Over 91% of you sign in the Steam client almost everyday or more than once per day"... well well well, you found out my dirty little secret! xD
On another note, try to be a little less black & white with your statistics (i.e. dont entirely discount or accept any hypothesis).
I know it sounds pedantic, but the term 'correct' implies quite a strict output from a stats test. I try to stick with terms that factor in that stats are not conclusive, like "statistically significant" etc., and include how close or far you are from you critical value (p).
Also, what were your stats parameters? i.e. one or two-way ANOVA, confidence level, and choice of post hoc.
When is your write-up due? All the best finishing it off Szat :)
Comment has been collapsed.
Yeah, you are right, I could have used phrases like 'supported' or 'not supported' instead of 'correct' and 'not correct' here but I wanted to as simple as possible because I didn't know how many of you have relevant statistical knowledge.
I used one-way ANOVA, with a confidence level of 95%. Post hoc tests: Scheffe and Tukey (these were recommended by my advisor).
Comment has been collapsed.
Bump for nice statistics.
I didn't dig how you tested the second hypothesis, so my next question might be rooted in that misunderstanding.
How did you distribute the dimensions of engagement among the Steam features? Could it be that the incorrect hypothesis formulation could have led to it's acceptance our rejection?
Comment has been collapsed.
On a side note: could there be anothr source of bias within the SG community as only the active forum participants (who might have higher levels of engagement) might be present in your sample?
I have to admit I'm missing out on forums lately and I totally missed the point where I could take part in your survey, sorry.
Comment has been collapsed.
Do you mean the assumption upon which I selected the dimensions of engagement? If so, I used the literature review (e.g. in the case of badges) and my own personal assumptions regarding the possible relationship between the Steam features and the levels of engagement. I did not mention here (but in my dissertion I do) that there can be other features to be investigated as well as other possible dimensions of engagement to be investigated (e.g. Steam Workshop - emotional engagement).
SG forum users might have higher levels of engagement, but it is not clear whether towards SG or Steam in general. But it is worth noting, for sure :)
Comment has been collapsed.
If levels of engagement and dimensions of engagement are the same, then yes, it is what I had in mind.
The presence of personal assumptions might be a minor flaw: what if some of your hypotheses were rejected because your personal assumption was incorrect? Say, your hypothesis 3a says tests for connection between profile backgrounds and cognitive engagement. Why do you only want to test it against cognitive engagement? What are the reasons for that? Could you test it against social engagement? Againt a combination of emotional and behavioural engagements?
I guess, you can actually try finding out the connection between features and dimensions by testing a feature against different (all of them separately and possibly double/triple combinations too) dimensions - seems like an interesting research point (i.e., what actually drives people to use those features)?
Comment has been collapsed.
Levels of engagement refers to low and high (and everything in between) and dimensions of engagement refers to cognitive, emotional, etc.
Results of hypotheses are not rejected based on personal assumptions but based on the data. I mean, hypotheses are of course based on the researcher's assumption of what to investigate (and what connections might be among the given variables). But you are right, there can be other possible relationships I did not investigate in this study.
Comment has been collapsed.
I understand that the rejection is based on a data. What I mean is that if the hypothesis is false because it is based in a wrong assumption it will be most defitely rejected based on the data because it was intrinsically false, so, yes I think it will be beneficial to see more hypotheses tested and a more systematic approach to hypothesis formulation.
By the way, what is that reference you mentioned above about the connection between badges and behavioural engagement?
Comment has been collapsed.
I'm most surprised by the 2% having elementary school education or less.
Comment has been collapsed.
I am really surprised that there are only 13% females on SG. Any way, thanks for sharing!
Comment has been collapsed.
1,067 Comments - Last post 12 minutes ago by Lep9six
66 Comments - Last post 1 hour ago by kakokazo
10 Comments - Last post 3 hours ago by Inkyyy
204 Comments - Last post 3 hours ago by Hawkingmeister
47 Comments - Last post 4 hours ago by jzone55
483 Comments - Last post 5 hours ago by Vincenzo77
710 Comments - Last post 5 hours ago by MeguminShiro
212 Comments - Last post 1 minute ago by Bum8ara5h
3,618 Comments - Last post 7 minutes ago by Mhol1071
1 Comments - Last post 7 minutes ago by Cim
83 Comments - Last post 11 minutes ago by Inkyyy
1,919 Comments - Last post 14 minutes ago by hebert2099
93 Comments - Last post 19 minutes ago by NyaaSA
282 Comments - Last post 24 minutes ago by rockpin
Hey everyone!
As I promised in the thread in which I asked for your help, now I share the main results of the research of my dissertation. Thanks to the result of the poll, I will share both results related to Steam and Steam users and to engagement itself.
Note: It is going to be a REALLY LONG post which is structured as follows. Firstly, I give you a brief overall introduction of engagement in marketing context (definition and dimensionality). After that, I introduce some information about the sample, my research hypotheses and the testing of them and some other results of my study.
Also if there are any misspelling or something, that's because of the length of this text (and the fact that English is not my native language) :)
Please bump this thread so others can see the results, too.
A brief introduction of engagement
The emergence of the term ’engagement’ in the marketing literature can be dated back to the early 2000s. The concept of engagement itself has its roots in the field of psychology and organisational behaviour. Academics do not have a consensus about the definition and the dimensionality of engagement nor about its actual name (you can come across with terms like ’customer engagement’, ’consumer engagement’, ’brand community engagement’ and so on). However, I agree with those researchers who conceptualize engagement (regardless of its prefix) as a person’s state of mind related to a brand/organisation/community (i.e. the object of the engagement) which has multiple dimensions (namely cognitive, emotional, behavioural and social) and which is a context dependent phenomenon that can have different levels over time.
However, I assumed there could be another dimension, namely ’personal importance’ which would discribe the degree to which a person is engaged to something in terms of missing it from his/her life and the affect of the object of engagement has on the person’s view of himself/herself.
Engagement has a distinctive role in describing the relationship between a customer/consumer (I will use these two denominations as interchangeble though they do not mean the same) and the object of engagement. It means engagement have antecedents (e.g. commitment, involvement, participation, satisfaction) and consequences (e.g. loyalty, trust, word-of-mouth), and engagement can also ect as antecedents of some other concepts such as participation and commitment. There is no mutual agreement about the model of engagement, but according to the literature review I made, this approach can be made (see further the attached image).
My hypotheses
My main research goals after the literature review were to investigate whether Steam has a leading role in Steam users’ game purchasing habit compared to the main online competitors as far as the sources of game purchases are concerned. My other goal was to test whether engagement has five dimensions as I assumed or not. The last objective of my research was to identify if there is a relationship between the importance of given Steam features and the levels of the given engagement dimensions.
So my hypotheses were the following:
H3b: Those users who would miss Steam Workshop to a greater extent has higher behavioural and social engagement.
H3c: Those users who would miss Steam Greenlight to a greater extent has higher social engagement.
H3d: Those users who would miss trading to a greater extent has higher behavioural, emotional and social engagement.
H3e: Those users who would miss the Community Market to a greater extent has higher behavioural, emotional and social engagement.
H3f: Those users who would miss badges to a greater extent has higher behavioural engagement.
H3g: Those users who would miss game reviews to a greater extent has higher social engagement.
H3h: Those users who would miss community guides to a greater extent has higher social engagement.
H3i: Those users who would miss Curators to a greater extent has higher behavioural and social engagement.
About the sample
I chose quantitative approach to test my hypotheses. I constructed an online survey which you completed. Eventually I gathered 980 answers out of which 956 answers were usable (I had to exclude the obvious trolls and those who showed high inconsistency among the answers). So my usable sample was 956 (n=956).
Note that the following statistics refer to the sample and can not be generalized as the sample only included members of the SteamGifts community.
A brief description of the sample:
Further information about Steam users:
I tested whether the sample is representative based on the hardware and OS statistics. I compared the data with the Steam hardware and software survey. Apart from the number of CPU cores, the sample can be deemed to be representative of the Steam users (for these variables: manufacturer of the CPU, manufacturer of the GPU, OS).
Test of the hypotheses
Test of H1
To test whether the H1 hypothesis is correct, I compared the frequencies of the usage of the different sources you use for buying games. There were 3 questions in the survey related to this topic: where have you ever bought a game (’ever’), where do you buy games most frequently (’frequently’), where would you buy a game if it had the same price at all sources (’preferred’).
I compared the frequencies of the different sources with which they were chosen at each questions. The Top 3 sources are the following:
(Note: GOG was the third in the ’preferred’ comparison with 5,2%).
According to these results, my H1 hypthesis was correct.
Test of H2
To test the H2 hypothesis I used factor analysis. After checking that the subsets of items are reliable and that they can be used for factor analysis, I investigated the optimal number of factors. Supporting my hypothesis, I got that 5 factors can be deemed as ideal (based on a number of criteria), so I investigated whether the a priori assumption of dimensionality was correct. I looked at the rotated component matrix (I used Varimax rotation), and the results showed my assumption was correct as the subsets of each dimensions loaded on the same component (for example the items I used to measure emotional engagement all loaded on Component number 1). Only a few items loaded significantly on another factor than the majority of the subset items, mainly items from the assumed personal importance subset (2 of them loaded approx. to the same extent on the component representing the cognitive dimension). Thus I run another factor analysis with 4 factors and as I thought, the former personal importance and cognitive factor merged into a new one, while the other factors remained the same. However, because only a few items showed significant correlation with another factor, I accepted my H2 hypothesis with the note that maybe a 4 dimensional approach can be correct as well.
Test of H3
At first I looked at the means and the medians of the questions ’On a scale from 1 to 7, how much would you miss the following features if they were removed from Steam?’ (see further the attached image).
After that I created three groups based on the answers to the above mentioned questions:
After this I used ANOVA (analysis of variances) to determine whether there is a relationship between group membership and the level of the given dimension (for this I used the factors from H2).
The results:
Further notes
I would like to thank you once again for your contribution to my research :) If you have any questions regarding it, feel free to ask it in the comment section below. I try to answer all of them.
Comment has been collapsed.