Collect data
In order to be able to collect data it is important to realize that there are two kinds of data: qualitative (words and stories) and quantitative (numbers) data. These two kinds of data complement each other when used in combination. Qualitative and quantitative data can be collected in different ways, depending on the purpose and the possibilities of the data. In order to select the right method(s), the advantages and disadvantages of each method are briefly explained below. The decision on what kind(s) of data to collect also depends on the costs involved and the extent to which this fits with the total budget for your activities.
It is important to collect and use the data in a responsible manner and to store it securely in accordance with the privacy legislation (GDPR). Read more about research ethics and privacy (legislation) in the Infosheets.
Infosheets
Tips on how to prepare a good survey and how to conduct an interview.
Ethical and privacy issues play a role in data collection.
Case study
Experiences of a British consultancy with conducting surveys among users of help lines.
Questionnaires
Questionnaires (surveys) are a widely used method for collecting quantitative data and answering questions such as 'how much' and 'how often'. A structure with multiple-choice questions and (validated) scales ensures that answers are easy to analyze. Questionnaires are suitable for collecting users, feedback and outcome data.
Positive
wide reach
easy to analyze and compare
anonymous
Negative
people are tired of surveys and it takes time to get a response
it is time-consuming if the answers cannot be collected digitally
it is less suitable for certain target groups (e.g. the illiterate, people with diminished mental capabilities); it also allows for less nuance and context in comparison to qualitative methods
View this guide on online surveys or take a look at the page about online survey tools
Interviews
An interview is a conversation, either by phone or face-to-face, that is aimed at gathering qualitative data. Interviews are often used to interpret quantitative data by asking more detailed questions about this data.
If you are not working with a (human) target group, you can choose to interview experts about the change which you aim to achieve.
Interviews are mainly used to collect outcome and impact data, for example by applying Outcome Harvesting and Most Significant Change.
Positive
variety of experiences by different people
geographic coverage
in-depth and nuanced insight, which is more suitable for sensitive subjects
Negative
time-consuming
scares off people who prefer to remain anonymous
View this online interview guide.
Focus groups
A focus group is a facilitated discussion with a small group of people. Focus groups are suitable for collecting qualitative information about how an activity has been experienced and which effects are attributed to the activity.
Positive
insight into experiences, similarities and contradictions
collecting ideas for improvement
lively and interesting discussion (if well prepared!)
Negative
results cannot be analyzed per individual
it is difficult to gather detailed information (due to the discussion format)
not suitable for sensitive subjects
Click on the links to read more about organizing and conducting a focus group.
Creative and participatory methods
(More) creative methods of qualitative data collection are, for example, storytelling or participatory methods in which effects are visualized with diaries, drawings and videos.
Positive
fun to do
useful for target groups that do not or cannot participate using traditional methods
Negative
greater risk of prejudice
interpretation and aggregation are more difficult
Read more about participatory methods here.
Observations
A research focusing on the activities of a (human) target audience is best approached through aquiring the target audience’s perspective. This can be done by, for example, participating in the activities of the target audience. This is called participant-observation.
Activities without a (human) target audience that have a concrete goal, for instance making an area more green, can also be monitored by observation when exact measurements are too costly or too hard to conduct.
This method is most suitable for gathering output data, which tends to be quantitative data.
Positive
insights that help to further develop what you can offer
Negative
expensive: non-biased observation often requires hiring an external researcher
Existing information
A lot of quantitative data is periodically collected at a local, national and international level. This data is often accessible free of charge and can provide insight into the results of activities carried out on a scale comparable to that on which the information is collected.
In the Netherlands, the Central Bureau of Statistics, for example, collects data about health and wellness, nature and environment, education, and agriculture.
Positive
free and reliable data
Negative
The data has probably not been requested in such a way that it can be directly related to your activities. Attribution is very important when using existing information. You can read more about this in level 3.