Evaluation Series | Developing Terms of Reference for Reviews and Evaluations
Annex 1 | Questions to be Answered in an Evaluation Plan
In the methodology section of the TOR, ask evaluators and reviewers to answer these types of questions in their ‘evaluation plan’:
- Who are the stakeholders in the review or evaluation, what is their interest or stake in the evaluation or review, what type of stakeholder are they (primary - directly benefit from the activity being evaluated or reviewed, secondary - indirectly involved with the activity etc), what issues or constraints are there in their involvement in the review or evaluation (e.g. power issues, access, confidentiality)?
- What information will be needed to answer each of the evaluation or review questions?
- What are the most appropriate methods for data/information collection to address each of the evaluation or review questions? e.g. Will qualitative or quantitative methods be used and why? How will evaluation or review participants be selected? What specific methods will be used - interviews (face-to-face or phone), email questionnaire, workshops, survey, focus groups etc? For quantitative surveys how will the appropriate sample size be decided, and what statistical analysis will be used to allow judgement on the reliability of results?
- From whom will information be collected to answer each of the evaluation or review questions, and how will the evaluation or review team ensure that the opinions of all appropriate stakeholders (eg women and men, young and old, powerful and less powerful) are included?
- What questions will be asked in questionnaires or interviews?
- How will information gathered be cross checked?
- What procedures will be used for data analysis - how will qualitative data such as interview notes be analysed, how will survey results be analysed?
- How will the way that crosscutting and mainstreamed issues (gender, environment and human rights, and if appropriate HIV/AIDS and conflict) have been addressed in the activity being evaluated or reviewed be assessed, and how will the evaluation/review be conducted in a way that takes crosscutting issues into account? [Reference: Screening Guide for Mainstreamed and Other Cross Cutting Issues]
- How will the findings be fed back and discussed with appropriate stakeholders during the evaluation process, and how will this be incorporated into the report?
- What risks, limitations or constraints are there likely to be to the review or evaluation and how can these be mitigated?
- How will ethical issues be addressed? For example how will participants of the review or evaluation be informed of the purpose and use of information they will provide? How will sensitivity to gender and culture be ensured during the review or evaluation? Is informed consent required from evaluation or review participants, if so how will this be obtained? How will confidentiality of participants be ensured and how will confidential material be stored? What potential harm to participants is there and how will potential harm be minimised?