When conducting research, or simply looking at a piece of information, it’s important to know the attributes of good research.
While it sounds like an easy question, it’s anything but.
Given the state of the world – where information, disinformation and misinformation often co-exist – it’s an increasingly emotional discussion, not just a rational question.
But at the same time, I have a lot of students and workshop participants who still need to conduct research for work projects, and they need a bit of guidance on how to judge a piece of information.
This post isn’t meant to be the final answer. But, from doing my own research over the years, here is a list of eleven attributes of ‘good’ research framed as questions. Use them if they are helpful to you.
Is the information …
- As close as possible to the original source?
- Objective?
- From a cross section of diverse sources?
- Representative?
- Current?
- Based on previous research?
- Gathered through systematic (repeatable) and proper data methods?
- Valid?
- Transparent?
- Quality references?
- Ethical?
Here is more detail on each attribute above.
As close as possible to the original source?
Were you able to get the information directly from the original source (the person)?
Every step removed from the original source adds bias.
Objective?
How much bias, stereotypes, prejudice or motives are involved?
This is particularly true of the source itself. Sometimes a way to determine bias is to compare one piece of information to another from a different source, perhaps from an ‘opposite’ perspective. By comparing the two sources, ask yourself why the information might be different. One (or both) of the sources may have an agenda.
Cross section of diverse sources?
Can the information be confirmed from a cross-section of diverse sources?
Representative?
Were enough people, and the right type of people, consulted or interviewed?
Current?
How recent is the information?
Nothing wrong with old information, but check to see if any part has been updated, or corrected. If it hasn’t why hasn’t it? If it has changed, why? What variables have changed if the new information is different?
Gathered through systematic (repeatable) and proper data methods?
Could (or has) the information still be accurate if it was re-created “as is” a second time?
Valid?
Was the way it was gathered and measured trustworthy? Does it measure what it says it measures?
Transparent?
Was the research conducted honestly, fairly and openly?
Quality references?
Does the background of the author or publisher stand up to public scrutiny?
Ethical?
Did the people whom the information was gathered know they were part of a research study?
Was any part of the information falsified, fabricated or plagiarised?
Check there was no deliberate bias to twist the conclusion(s) to suit the situation.
As a final point, one of my college professors gave me this good advice. Spend half of the research time trying to prove myself wrong, not just only trying to prove myself right.
What other criteria have you used to decide if a source or piece of information was useful? Please add your thoughts and comments below.
No comment yet, add your voice below!