If people start out hating Britain when they begin your survey, then you give them 100% neutral questions that do not themselves hint at anything bad about Britain, they will answer badly on their own, due to their initial hate they started with.
So you’d be measuring THEM, not just measuring yourself. Which is what you want.
You are right indeed. I have been a bit too “styerotypical” with these questions, as my argument is that certain trees are underestimated, and if these questions has told me the otherwise, I will be able to disprove my previous argument more effectively. I am not sure about other social sciences but the education I received taught me that relatively more objective views has to be formed from multiple lenses, hence I used these styerotypes to get people’s feedback that makes me thinking more critically about the topic.
It is also why I did not mention the good aspects of these nations, as players tends to agree more on what is good than what is bad. Let’s say Britain 10.3, most people say it is the best, some say Italy is better but most people goes to these two answers. But if I ask “what is the worst tree in the game at top tier?”, then any answer that is not Sweden or Russia will appear.
If I got my masters sorted, I will investigate about the case about copypastes, and I should be able to look into the studies more objectively. Weirdly enough, being a intpol student, I never did any interviews or surveys(I PLAY WARTHUNDER DUH).
Your suggestions would create bias, and they imply bias. You can create your own survey. A survey is a survey. There’s no such thing as neutral questions. Your suggestions are based in bias.
It would be like asking if people believe the claims about russian bias, then you saying you shouldn’t ask that biased question, suggesting they should ask about the strength of Russia in a neutral way, but that dismisses the fact that claims of Russian bias exist. In fact, you are biased to suggest it’s not a commonly spoken thing.
If he wants to ask if people believe the British suffer from solid shot like many claim, he’s asking regarding it developing into a meme. If people haven’t heard the claims presented, then they can say unsure or something. The question is entirely valid regardless. It’s not indicative of bias to suggest that people make the common claim. What you’re trying to do is akin to censorship.
To the extent that they exist, they will reflect in the answers of the survey due to the ANSWERER’S bias that they brought in with them.
The goal of any survey is to measure the answerer, not to measure the test maker.
If 70% of people are convinced there’s russian bias, and 20% think there is none, and 10% of people think there’s anti-Russian bias, then
If your own test adds no bias itself, then you will get purely the respondents’ biases coming through, and you’ll measure 70/20/10
If your own test itself adding it’s own bias ends up pushing a bunch of people one step higher in their answer, then you’ll incorrectly get something like 85/10/5 as your answers
lol You keep thinking it’s a test. It’s just a survey, and bias does not matter. His questions are based on the community, not some bare bones objective analysis of the game. I don’t know why you’re fighting this so hard.
A survey is literally a sub-category of tests. A survey IS a test. Just like an apple is a fruit.
It is specifically a test that:
Measures humans (as opposed to, say, testing stiffness of a block of concrete), and
Uses verbal or written self-report as the method of data collection (as opposed to measuring your height or reaction time)
Usually implies that it is guided by a fairly tight list of questions, not just wildly free-form
There is no point in running a biased survey (or any other kind of test). Except perhaps “to intentionally lie and mislead people” would be the only reason you’d WANT to.
Same as how there is no point in using a ruler where the inches are the wrong size.
hahahhaha
it does not matter if it is categorically similar. You don’t know what questions he wants answered if you can’t read the questions plainly. You are telling him to change his questions. It’s nonsensical. You don’t know what he’s looking for
Yes, because there is literally no point in running a biased survey.
Any more than there is a point in using a ruler with inches that are the wrong size.
You don’t know what he’s looking for
This is the same as saying “You don’t know what object he’s measuring the length of, so you can’t know whether he should use a ruler with the wrong sized inches or not!”
It makes no difference what you’re measuring the length of, ALL objects can only be usefully measured if your ruler has the correct markings on it. Otherwise you will get lengths other than the true length of the object.
And ALL questions can only be usefully surveyed if your survey has no bias in it. Otherwise you will get inaccurately measured “opinions” more negative or more positive than people’s actual opinions.
You’re the one calling it biased, and there is a point to a “biased” survey even if it is biased.
This is a bad metaphor. I suggest we don’t even work with it.
Again, you’re the one calling it biased.
His questions are based on community feedback already present. He’s not trying to data collect to find out if there is a general feeling about British tanks and their solid shot. It’s already a community topic. He’s asking if people agree with it. How is that bias? The thing exists already!
This is actually a good way to do a survey as it is directly referencing common complaints from the players of minor nations. It’s a good way to gauge reactions from the players of those nations and others.
It helps to distinguish if people who do and don’t play the nations agree with common complaints about the tech trees, in addition to seeing what sort of comments are brought up by using wording that could be seen as combative.
I mean it obviously was able to get a reaction from you, so I think it is working.
This is more of a reason to do a survey anyways, since if there is just no one from minor nations at top tier that’s a really good reason to pay attention to them more (since there wouldn’t be as many advocates of the tech tree).
This is about as random of a sample as the average non-content-creator can do while also having the ability to reach a large amount of people, additionally the forums has people from all nations.
If you’ve decided you know what the community thinks already, then why are you running a survey, lol? You’ve already concluded your answer, asking something you’ve already concluded the answer to ahead of time is obviously dumb.
The only reason to measure something is if you DON’T know the answer already
In case you never realized, when people say stuff like “What’s your favorite Kevin Bacon movie, and why is it Tremors?” it’s a JOKE, not a serious way to ask questions, lol
Research methods/logic don’t care about your convenience. If you can’t figure out a way to do something correctly, it doesn’t just magically change how logic works to accommodate you. It simply means you can’t do it at all then.
Do it right, or give up, only two valid options.
Scientists: “Awww but building a gigantic supercollider that costs trillions of dollars sounds REALLY HARD!!!” The universe: “Okay okay, fair’s fair, I’ll just tell you how particles work for $5 then, deal?” Lol no, until they were able to do it right, they just didn’t get to know the answer. The end.
And ESPECIALLY if your goal is to raise awareness among normal players, or find out more about normal players, etc., then that’s the worst possible situation to only be measuring a weird, hyper-narrow niche group of super old veteran players with thousands of battles and who are all on their 4th nation, etc.
My dude where else is this guy supposed to post this survey to? If he isn’t a content creator (i.e. doesn’t have a large following) either here or the War Thunder reddit are his best bets
One way to do a much closer to random sampling would be go through the replay server and find people from one game per a few spread out sample BRs who played in the last 24 hours, write down all 32 people’s names in a notepad file, and DM each one asking if they’ll fill out a survey.
That’s roughly how Gallup works (they phone randomly generated phone numbers)
But again, if you can’t figure out a better way, TOO BAD. You just failed to get an answer then. Universe doesn’t care. “Best I could do” =/= truth. “Actually good enough to avoid biases” = truth.
Yeah I guess that might be a better way that is also incredibly time consuming, but posting the survey here is - if anything - just going to show the thoughts of experienced players (if you want to say that only experienced players post here). I don’t see the problem with that as long as that is taken into account in your conclusions.
It is using pre-established complaints from subsets of the community and asking questions on how the larger community (including those subsets) feels about said complaints. I don’t see what is biased about this.
I mean pilot studies exist for a reason and qualitative analysis is just as important as quantitative since they can be used in different ways.