Notice: Function Elementor\Core\Experiments\Manager::warn_removed_or_hidden_dependency was called incorrectly. Feature mega-menu depends on hidden experiment nested-elements. Please see Debugging in WordPress for more information. (This message was added in version 4.4.1.) in /home/u63711/domains/thecharityspark.co.uk/public_html/wp-includes/functions.php on line 6260
Simplifying Evaluation: Capturing Data in an Easy to Use Format – The Charity Spark

Simplifying Evaluation: Capturing Data in an Easy to Use Format

Data collection is an important part of any evaluation project. The data we gather builds the foundations of the project and report, allowing us to prove what we are saying is accurate. However, gathering data can be overwhelming and it can be hard to know where to start. Read on for our top tips.

  • Develop an analysis plan early on to work out what you need to collect. Make sure you have gained informed consent from everyone involved. This is especially important when handling sensitive data such as special category data under GDPR (e.g. ethnicity or sexual orientation).

  • Plan for how to account for any missing data, for example partial responses or cases where a question is not answered. Preventing data gaps is generally the best solution (keep your collection method as simple as possible, consider incentives for the people you are engaging with) but plan for how to handle missing data. You will likely want to consider different approaches depending on the extent of missing data to try to fill some gaps. If it’s a small amount of missing data, you can probably just omit them from the analysis. If it’s a larger amount you may want to revise or reword the questions and try again or not report on it depending on its importance. 

  • Make use of categorical data where it is appropriate to do so, such as bracketing age groups, ethnicity, gender, and other demographic information. Ensure you include a “prefer not to say” option where needed. On ethnicity, ensure your categories are appropriate and using best practice language e.g. in the UK, following the government guidelines helps ensure your categories are suitable. For gender, this may mean including an option for “I identify as another gender” and giving the respondent space to state how they identify.

  • Use scales for rating purposes. With these, be consistent and ensure that all scales have the same number of points. 

  • Only collect data that is needed to answer your research questions. This is a good approach ethically as well as meaning your analysis will be more defined. It is much more efficient and saves you time. Devise and refine your methodology early on, ensuring that specific questions are firmly within the scope of your overarching research questions.
  • Consider your format, what is the most appropriate tool for your respondents? If you are doing surveys, online is easier for you to produce, share and collect answers with but is it accessible for your participants? For example, if you are working with respondents who may not have access to a computer or have suitable IT literacy skills, then an online survey might limit responses. Be sure to consider what impact this may have on your timelines. If you plan to facilitate survey completion with respondents, you need to have the time to do this. Likewise, if you go with a pen and paper approach, you need to have the time to input and analyse the data.

  • If you are using qualitative methods, are you going to make use of one-to-one interviews or group conversations? How formal and structured do you want these to be? Again, consider the individuals you are going to be engaging with and adapt to their needs. It may be that speaking to multiple stakeholders as a group leads to great discussion but if covering sensitive topics, one-to-one conversations are a better option as long as the setting is appropriate.

  • Pre-test your survey, fill it in yourself and pass to colleagues and the commissioning organisation to make sure it is reliable, easy to use and doesn’t have any gaps in the information it gathers. Sharing ensures that any significant issues are picked up in the same way if you were to get someone to proof read some work for you. Pilot it by testing it with internal staff and with the commissioning organisation, but be mindful that they are not your respondents. It is best to pilot the survey or interview questions with your respondent community to confirm that they are suitable. Ideally, co-produce materials with your respondent community to allow them to have a say in what feedback they give and how. 

  • For collecting qualitative data, you need to make sure you structure your note taking effectively so that you don’t miss any important points. Alternatively, make use of voice/video recordings or transcription tools to save you time and ensure nothing is missed. Again, think ahead of time about how the responses will be analysed and presented.

For more advice or support with developing evaluation projects get in touch with us  hello@thecharityspark.co.uk