Notice: Function Elementor\Core\Experiments\Manager::warn_removed_or_hidden_dependency was called incorrectly. Feature mega-menu depends on hidden experiment nested-elements. Please see Debugging in WordPress for more information. (This message was added in version 4.4.1.) in /home/u63711/domains/thecharityspark.co.uk/public_html/wp-includes/functions.php on line 6260
Our Evaluation Approach – The Charity Spark

Our Evaluation Approach

Key evaluation approach considerations:

Co-design

As part of our participatory approach we will use small focus groups to co-design the survey. This ensures we remove unconscious bias from our own research as well as providing an opportunity to test question wording and ensure language is accessible to all. We suggest two focus groups convene virtually.

Efficient use of time

It is imperative that our evaluation approach is respectful of the time we are asking grant holders to invest in this process. Our evaluation will be proportionate, balancing efficient use of time and robust methods.

Theory of Change (ToC)

An iterative, co-designed process enables us to develop a testable theory of change for any programme. We will work alongside you to refine and review any existing model that is currently in place. In the absence of an existing ToC, we will share our findings around specific outcomes observed for grant holders.

Accessibility and inclusion

We recognise the importance of maintaining an accessible research methodology. We will work with your team, as well as research participants, to remove any possible barriers to access including:
1. Being flexible in our availability for interview slots (during the working day and evenings),
2. Using video calls for interviews to reduce time and cost
3. Reimbursing expenses if incurred (e.g. by the focus group if this is run face to face)
4. Ensuring written documents are appropriate for all audience members and
5. Ensuring there is a clear route to raise accessibility concerns.

Our budget includes a small accessibility contingency to ensure we can adapt and remove barriers to participation for any of the survey or interview participants. This will mean we can use sign language interpreters, translators, cover volunteer time and/or expenses, and use audio-recording software for the survey if required. This will be unbilled if unused but an essential part of ensuring equitable access.

Statistical relevance

Research should be reliable and robust. We will create a comprehensive and complete sample frame at the beginning of the project which will be agreed with the organisation. This will be used for the survey sample and qualitative interview candidates will also be drawn from this. We ensure that sample sizes are relevant and appropriate considering the size of the sample frame. Data analysis will be considered and statistically relevant including mitigating for sample and non-sample errors, 95% confidence interval and a 5% standard for statistical significance.

Quality assurance

In order to maintain high standards of research and evaluation we will have a number of processes in place. A comprehensive project plan will ensure the timelines are adhered to and any problems resolved swiftly. The team will work together to provide peer review capacity to each other at each stage of the project. A quality assurance policy will be provided for the project which will encompass standard operating procedures that ensure agreed, defined methodology for the research tools outlined in this proposal. All templates, files and raw data generated during this project will be shared through secure file storage to provide transparency of project management and quality assurance.

Data protection

All data processing will be conducted within ICO guidelines and adhere to GDPR. We will work closely with the organisation to understand what existing consents are in place to enable us to contact grant holders and seek additional consents where necessary. This will be documented in a data protection matrix.

Clear communication

We believe that reports should be written in a way that is accessible, clear and empowering. We commit to producing documents that are ready to share, inspiring and engaging for all stakeholders. We work with a designer and proof-reader to ensure the report we produce is ready to publish.

Research ethics

The Charity Spark evaluators always ensure consideration of the six core ethical evaluation categories when conducting evaluations:

  • Informed consent – anyone participating in the evaluation is fully informed about the evaluation being conducted. Participants need to be made aware of the purpose of the project, who or what group is funding it, how the findings will be used, if there are any potential adverse impacts of their participation and who will have access to the findings. This is so participants can make an informed decision as to whether they will participate in the evaluation or not. Consent forms will be gathered for any organisation participating in qualitative interviews. Clear consent statements will be present on all outgoing surveys.
  • Voluntary participation – it is the right of anyone participating in the evaluation to withdraw at any point without impacting future grant applications.
  • Do no harm – Harm can be both physical and/or psychological and therefore can be in the form of stress, anxiety, diminishing self-esteem or an invasion of privacy. It is imperative that the evaluation process does not in any way harm (unintended or otherwise) participants.
  • Confidentiality – Confidentiality means that any identifying information is not made available to, or accessed by, anyone but the evaluation team. Confidentiality also ensures such identifying information is excluded from any reports or published documents.
  • Anonymity – Anonymity is a stricter form of privacy than confidentiality, as the identity of the participant remains unknown to the research team. Anonymity can be granted using digital surveys but is not possible when interviewing individuals representing organisations however confidentiality will be adhered to
  • Only assess relevant components – Only assess those components that are of relevance to the small grants research project. It is important to keep the evaluation as simple as possible and to remain focused on the intention of the evaluation and what the data gathered will be used for. This is particularly important when considering what demographic or socioeconomic profile data is being captured.

Need to speak to one of our charity consultants regarding our evaluation approach? Get in touch now.

Sign up for our newsletter.

It will only take a minute.