1.1 Plan International in Zambia
Plan International is an independent development and humanitarian non-governmental organisation that advances children’s rights and equality for girls. Working in Zambia since 1996, Plan International Zambia’s development and capacity building programmes focus primarily on Education, Health, Water and Sanitation, Economic Security and Youth Empowerment, including Child Protection and Participation. Plan International Zambia has programme units in; Central, Luapula, and Eastern Provinces including in Lusaka, where the Country Office is located.
1.2 Overview of the Norad funded project to be assessed
Promoting Girl’s Education aims at improving access to quality, inclusive basic education for children (especially girls) in the 100 schools in 7 target districts of Central and Luapula provinces. The Project target is 12,000 pupils (60% girls and 40% boys and 10% Children with disabilities), each of direct beneficiaries reaching out to at least 3 peers. Partnering with FAWEZA and ZOCS, the project focuses on holding duty bearers particularly government accountable for creating a safe and inclusive environment in schools and ensuring school attendance for girls/children with disabilities through participatory score card approach.
Child Protection and Participation aims at improving protection and participation in decision making of children and young women, including those with disabilities. Approach being used include; awareness raising, training and active engagement of other stakeholders. The primary beneficiaries are children particularly the marginalized in 36 selected communities in 9 districts of Central, Luapula and Eastern Provinces. At district level, targeting; 200 police officers; 20 members of parliament; 30 from Community radio stations. At National level the program will target State Actors (Government institutions including police, magistrates and judiciary and the Zambia Agency for Persons with Disabilities), Media institutions (TV and Radio). Partners on this project are Advocacy for Child Justice, Child Help Line, and Children in Need Network.
18+: Ending Child Marriage project’s overall objective is contributing to eradication of Child Marriage in Zambia. The primary target group is 15,000 girls in and out of school in Vubwi, Chisamba and Mansa districts through the girls’ groups and safe spaces. Partnering with Society for Women & Aids in Zambia and Women & Law in Sothern Africa. Other stakeholders will include: boys/men, parents, traditional leaders / initiators, community health workers, community members, government workers (police, social welfare and teachers, including staff from Ministry of Chiefs and Traditional Affaires, Ministry of Gender and Child Development and Ministry of Community Development, Mother and Child Health and CSOs.
Building Skills and Economic Resilience for Girls and Mothers. Through the 18+: Child Marriage Project, this project is mobilizing girls and mothers into groups and train them in vocational skills. Implemented by Plan International Zambia, the goal is to strengthen the economic resilience of mothers and girls to contribute to ending child marriages in the Eastern, Central and Luapula provinces of Zambia. The projects has targeted 2,190 girls aged between 16 to 24years to economically empower them and to be resilient against child marriages. It will further economically empower 1,425 parents/ guardians of girls at risk of child marriages.
2. The Purpose of the Evaluation
The main purpose of the evaluation is learning. We hope to identify strengths and weaknesses of the program/projects, which will guide the project towards improvement during the current implementing period and for planning of future program/projects.
3. Scope and scale of the evaluation
The evaluation will be done at the country level, based on the latest result framework, which is a consolidated total results of all Norad Frame Agreement projects in the country. From here on this will be referred to as Country Program. Projects funded outside the Norad Frame agreement are not subjected to this evaluation.
4. Content of the evaluation
The evaluation will be organized in chapters/headings according to the following sequence
4.1 Assessment of project management
4.1.1 To what extent does this project fit with the implementing partner organisations’ own strategies?
4.1.2 Describe the monitoring routine, data collection/documentation routine, learning routine in the project both at Plan and at implementing partners’ levels.
We would like the description to cover two dimensions: situation as is and situation as wishes. We are interested in “routine” which implies system that are regularly implemented. If there has not been specific routine made yet – please say so in the situation as is.
Situation as is Situation as wishesMonitoring routineData collection routineLearning routine
4.1.3 To what extent do the staff at field level in Plan and in implementing CSOs have good understanding of what the project tries to achieve or are they unclear?
4.1.4 What are the routines for Anti-corruption in the project at Plan level and at partner organization level. A list of routines are adequate, no need to elaborate in details.
4.1.5 If the project has experienced underutilization or overutilization of its yearly budget deviation exceeding 5% per year in 2017, please describe the main reasons for this excluding those caused by delay of fund transfer.
4.1.6 Any recommendations to strengthen the internal project management at Plan level seen from the evaluator perspective? Please formulate them as simple, concrete recommended actions. Please also suggest who could deliver this.
4.2 Effectiveness and efficiency
Going through the Result Frame work for Country Program (see attached). The evaluation shall indicate if the project has achieved reasonable level of results for each of the outcome indicator, given the resources it has (the budget level) based on the data collected during 2015 (baseline year), 2016 and 2017, interview with relevant stakeholders to answer the following questions:
For each outcome indicator
4.2.1 Is the pace of progression reasonable (use targets and achieved data in result framework). Please recommend improvement of efficiency nature, if needed.
4.2.2 Is the target/coverage reasonable given the resources? Recommend improvement on efficiency, if relevant.
4.2.3 Which specific areas of challenges are there that need to be addressed to ensure that results is achieved and with good quality (effectiveness) for a particular indicator? Recommend ways to address these challenges.
4.3 Gender equality
4.3.1 Was the project planning and implementation based on a situation analysis where men and women of various social backgrounds are able to have a say and present their own views? Give examples of how the analysis informed the project design.
4.3.2 Are there differential impacts on women and men (intentional or unintentional) observed during implementation? Do these lead to adjustment in the implementation? In which way?
4.4 Disability inclusion
4.4.1 To what extent have children/youth with disabilities, parents of children with disabilities and/or organisations of people with disabilities (DPOs) been engaged and taken part in the project, either as active participants or as collaborating partner organisations? (Please elaborate.)
4.4.2 What are the strengths or weaknesses found in disability inclusion efforts?
4.5 Unexpected results
Are there unexpected results both positive and negative that the project should document for future learning?
4.6 Added value and Participation:
In this section, we ask the evaluation team to use the given tools to assess Added-value and Participation level in this program.
A) Added-value assessment.
a. Use the Added-value assessment tool attached.
b. Interview the Civil Society Organization partners of Plan
c. Fill the data in the tool.
d. The completed document is attached to the evaluation report as annex.
a. Use the Participation checklist (attached) to assess degree of participation in the Plan program.
b. Interview relevant actors.
c. The completed document is to be attached to the evaluation report as annex.
4.7 Cross-cutting issues:
Assess how the project address the following issues
4.7.1 Environment and vulnerability to climate change that affects the results of the project
4.7.2 Has the program put in place interventions that will increase sustainability of the results after the program ends in two years. Please give specific examples.
1. Lead and coordinate the evaluation in close collaboration with Plan staff, partners and relevant stakeholders.
2. In carrying out the evaluation, the consultant(s) is/are expected to familiarize him/herself/themselves with secondary data relevant to this project from Plan, her partners, communities and other stakeholders.
3. Develop a data collection methodology appropriate to answer each of the questions posed in the TOR. Information should come from both insiders and outsiders of the projects to ensure objectivity and triangulation. The methodology will be discussed and approved by Plan Country Office before launching the investigation.
4. Analyze data and document the findings according to the structure given in this TOR.
5. Produce the evaluation report that is short and to the point. Recommendations should be concrete.
6. Share the draft report with Plan CO, NNO and its partners for feedback.
7. Finalized the report.
6. Quality of information
Data collection shall strive to give a representative picture of the situation. The consultant(s) shall apply participatory evaluation techniques to gather both quantitative and qualitative data necessary to answer all the questions the TOR. The consultant shall ensure that the voice of women and marginalized groups is heard.
i. An inception report and evaluation work plan.
ii. A draft report after the analysis of target group disaggregated data for Plan and stakeholders’ feedback.
iii. A final report in English of no more than 35 pages (excluding references and annexes) utilizing the format below:
Front page with title of the evaluation, date and authors of the reportExecutive summary that presents the key points of the different sections.Methodology and Limitations of the evaluationDescription of the project or programmeFindings and analysis according to section 3 aboveConclusionsRelevant annexes, which as minimum must include:
i. List of people/organizations interviewed or consulted
ii. Bibliography of the documents reviewed
iii. Evaluation work plan
iv. Terms of Reference for the evaluation
i. A summary of the findings (in Ms PowerPoint) to be used for subsequent dissemination.
ii. The final cleaned dataset used for analysis and production of final report in an accessible electronic format (csv, excel, SPSS, STATA). All raw sex age disaggregated data (quantitative data files, transcripts of FGDs etc.) should also be submitted to Plan for reference and future use.
8.0 Bidding process and requirements
1. A detailed technical proposal clearly outlining the proposed methods for the evaluation and examples of gender responsive tools to be used. The disability inclusion perspective should also be taken into account in the evaluation.
2. Curriculum Vitae(s) of proposed staff outlining relevant education expertise and experience including gender.
3. A table clearly stating the level of effort of each proposed team member.
4. A financial proposal with a detailed breakdown of costs for planning and carrying out the evaluation study.
5. A proposed timeframe detailing activities and a schedule/work plan (including a Gantt chart), in line with the timeframe provided in this TOR and with consideration for the time it will take for Plan to review documents (inception and evaluation report, etc.) before finalization.
6. Names and contact information of three references who can be contacted regarding relevant experience
The detailed technical proposal should:
Show a thorough understanding of this terms of referenceInclude a description of the preferred gender and disability sensitive data gathering and sampling methodsDemonstrate previous experience in conducting quantitative and qualitative study approachesDemonstrate inclusivity gender equality and non-discrimination in the conduct of the studyDemonstrate approaches that will be used to ensure child protection and ethics and principles will be applied throughout the design and data collection phases of the project, and how marginalized or vulnerable women, girls, boys and men will be included.
The financial proposal should contain:
Itemized consultancy fees/costsItemized field data collection expenses, including lines for enumerator compensation and transportationItemized administrative expensesValidity period of quotationsAdheres to payment schedule of 50% upon production of acceptable inception report (including proposed tools) and 50% upon production of acceptable Final report (50:50).
The consulting team profile should contain:
The full names of all participating consultants and their roles, including technical expertisePhysical address of the firmTelephone number (s) of the firm (if applicable) and participating consultantsFull name and contact information of the contact person within the consulting teamDate of registration and Registration NumberCopy of registration or other certificate, VAT and PINFull names of Directors/Proprietors
The consultant is expected to suggest a reasonable time (working days) during which they are able to accomplish the task. Take note that these proposed days are subject to agreement with Plan International. Plan reserves the right to determine the number of days within which the study will be undertaken.
All documents, project designs, completed survey instruments, drawings, technical data and other information including FGD transcripts shall remain the property of Plan International and shall be treated as confidential by the consultant(s) at all times. Plan reserves the right to access these documents at any point during the consultancy period. They shall not be made available to any third party whatsoever, in any form, without the prior written approval of a properly authorised employee of Plan.
The utilisation of all proposals, plans and reports and other information provided by the consultant(s) is the property of Plan International and the use thereof is solely at the discretion of Plan International. All documents and other papers, whether in soft or hard copy and whether containing data or other information, provided by Plan International shall be returned complete to Plan International upon completion of the assignment.
12.0 Child Protection Policy
The consultant and associates must sign and demonstrate commitment to strictly adhere to Plan’s Child Protection Policy. It is also the responsibility of the Consultant to ensure that all persons hired, used or otherwise consulted by him/her are made familiar with the Policy and agree to abide by it during the execution of this work.
13.0 Consultant(s) Qualifications
The consultancy should have an integrated team of experts in child protection, economic empowerment, Education with a bias on early child hood care and development, M & E specialist, with demonstrated high level experience in evaluations for development projects with a good working knowledge of gender equity, disability inclusion and child participation.
The Consultants must have the following competencies:
The lead consultant must have a background in Child Protection, Education with a bias on Early Child hood Care and development or related Social Sciences field (at a minimum of Master’s Degree Level) and have particular expertise in child protection integrated with education and disability inclusionTeam members should have a minimum qualification of degree in social sciences, education, child protection and an extensive knowledge and understanding of community based child protection mechanismsHave at least five years’ experience in the area of child protection/ early childhood careExperience in the formulation, monitoring and evaluation of child protection & education projectsDemonstrate evidence of undertaking similar work in Zambia for child protection and education projects.High level of professionalism and an ability to work independently and in high-pressure situations under tight deadlines.Strong interpersonal and communication skillsHe/she or a team member must be a qualified statisticianThe consultant must have working experience in Zambia and be familiar with the cultural background of rural communities where the project operatesDemonstrate experience with community development approaches; gender responsive participatory methodologies, disability inclusion, environmental protection, and children participation and inclusive education.Evidenced experience in conducting gender sensitive participatory qualitative and quantitative studiesEvidenced report writing (English language) and documentation skillsDemonstrates meeting all legal requirements.
14.0 SUBMISSION OF PROPOSALS
The Technical and Financial proposals MUST be prepared in conformance to the guidelines and template provided in this terms of reference as minimum standard. All applications received by the submission date will be reviewed by a selection committee based on pre-determined objective criteria. Upon selection, the consultant(s)/ consulting firm would be invited for a discussion and requested to submit a detailed inception report and work plan prior to starting any data collection exercise.
Interested Consultants should send queries and submit their proposal clearly marked “TERMS OF REFERENCE TO CONDUCT A MID TERM EVALUATION FOR NORAD FRAMEWORK”
The Administration Manager,
Plan International Zambia,
87A Kabulonga Road, Lusaka
Email: email ;protected
Please ensure that you mention www.gozambiajobs.com as the source of this job advertisement.
Closing date for submission is Tuesday, 24th April, 2018