Impact Evaluation Specialist Job at DevTech Systems, Inc.
About Us:
At DevTech, we care deeply about doing work that leads to positive change in the world. We value diverse perspectives and are committed to an inclusive work environment. We encourage each person to learn, develop, and meet their professional potential. We rethink and evolve how we do things to grow and improve our company. Overview:
1.Minimum required data to understand the intervention, the treatment and control groups Post study design*
DevTech is currently collecting first-hand data on schools characteristics and developing a Study Design Blueprint based on critical assumptions. These Blueprints will inform the final Study Designs for conducting assessments in the five countries mentioned above, one for primary education interventions, and another for ECE interventions. Responsibilities:
Estimated Level of
Deadline
1
10 days
February 3, 2023
2
10 days
February 3, 2023
4 days
4 days
4 days
Final Data Analysis Plan for South Africa, incorporating feedback from Palladium and USAID.
1 day
Final Data Analysis Plan for Tanzania and Rwanda,
1 day
Final Data Analysis Plan for DRC and Zambia,
1 day
EEO Statement:
DevTech Systems, Inc. (DevTech) is an international consulting firm dedicated to development, with 38 years of experience providing advisory services and technical assistance to government, private sector, and civil society stakeholders in more than 100 countries. DevTech core practice areas include: Monitoring Evaluation, Research and Learning; Data Solutions; Public Financial Management and Fiscal Sustainability; and Education, Gender, and Youth.
At DevTech, we care deeply about doing work that leads to positive change in the world. We value diverse perspectives and are committed to an inclusive work environment. We encourage each person to learn, develop, and meet their professional potential. We rethink and evolve how we do things to grow and improve our company.
DevTech is seeking two
Impact Evaluation Specialist to advise on the evaluation of the USAID CATALYZE EduFinance opportunity in Democratic Republic of Congo, Rwanda, Tanzania, South Africa, or Zambia implemented by Palladium. The aim of the CATALYZE EduFinance mechanism is to improve the educational and learning outcomes in disadvantaged children and youth by mobilizing private capital for the non-state education sector. Under this mechanism, USAID is funding public-private sector partnerships (PPPs) and private sector activities in several countries (hereafter called “EduFinance activities”).
Interventions
- School Improvement Loans to schools
- School Fee Loans to parents
- Education quality improvement package through the professional development of school managers and teachers as well as school development planning.
Target groups (non-random sampling)
- Democratic Republic of Congo- 1,000 primary schools
- Zambia- 785 primary schools
- Tanzania- 633 primary schools
- South Africa- 334 early childhood centers
- Rwanda- 134 early childhood centers
Unit of analysis
- School
Indicators to measure
Pre-primary (year before Grade 1)
- Percent of pre-primary learners with an increase of at least one early learning and development level in early learning skills
- Percent of pre-primary learners who are developmentally on track
Grade 2
- Percent of learners with an increase in at least one proficiency level in reading at the end of grade 2
- Percent of learners attain a minimum grade-level in reading at the end of grade 2
Grade 6
- Percent of learners with an increase of at least one proficiency level in reading at end of Grade 6
- Percent of learners attain minimum grade-level proficiency in reading at the end of grade 6
Independent evaluations will measure the association between EduFinance activities and change in education outcomes as operationalized above. Findings of the evaluations aim to strengthen implementation and support adaptive management and learning of EduFinance activities and inform future activity design. USAID will share evaluation findings with key stakeholders, such as Congress and the EduFinance Community of Practice, to expand the body of evidence about Private Sector Engagement (PSE) initiatives strengthening development outcomes.
Proposed data collection phases
Pre study design
1.Minimum required data to understand the intervention, the treatment and control groups Post study design*
2. Baseline assessment of cognitive skills at the start of the grade (year before 1st grade, Grade 2, and Grade 6 depending on the country).
3.Endline assessment of cognitive skills at the end of the grade (year before 1st grade, Grade 2, and Grade 6 depending on the country).
- or data collection strategy proposed by Design Lead.
DevTech is currently collecting first-hand data on schools characteristics and developing a Study Design Blueprint based on critical assumptions. These Blueprints will inform the final Study Designs for conducting assessments in the five countries mentioned above, one for primary education interventions, and another for ECE interventions.
- Attend consultation with DevTech, Palladium and USAID to explain the proposed study design and seek feedback
- Use inputs from Study Design Blueprints and preliminary data collected from the intervention schools to develop a final Study for each intervention category: primary education and ECE
- Using first-hand data, validate critical assumptions used in the Study Design Blueprints
- Prepare data analysis plans, considering the study objectives, research questions and/or hypothesis, data set to be used, inclusion and exclusion criteria, variables to be used in the main analysis, statistical methods / tests proposed, and table shells for univariate, bivariate analysis and multivariate analysis and any other items as necessary
- Incorporate feedback from DevTech, Palladium and USAID into the study designs and data analysis
- Master’s degree or higher in Economics, Education Policy, Program Evaluation, or related
- Quantitative research experience evaluating large scale international development/or education
- Demonstrated experience in designing and conducting mixed method evaluations and/or using quasi-experimental methods.
- Experience with conducting meta-analyses in which results of several evaluations are combined to determine overall trends.
- Ability to oversee the production of a high-quality evaluation report that includes data
- Excellent interpersonal skills; and
- Fluency in written and spoken English
Preferred Qualifications:
- Knowledge of evaluating public-private sector partnerships (PPPs) and private sector financing
- Experience using the Annual Status of Education Report (ASER) and Measuring Early Learning and Quality Outcomes (MELQO) tools.
- Experience working in Africa preferably in Democratic Republic of Congo, Kenya, Rwanda, Tanzania, South Africa, and Zambia.
#
Deliverables/ Activities
Estimated Level of
Effort
Deadline
1
Final study design for the assessment of learning outcomes
in pre-primary, incorporating Palladium feedback on the design blueprint for early childhood education interventions.
10 days
February 3, 2023
2
Final study design for the assessment of learning outcomes
in primary, incorporating Palladium feedback on the design blueprint for primary education interventions.
10 days
February 3, 2023
3
Draft Data Analysis plan for South Africa. The data analysis plan must consider the study objectives, research questions and/or hypothesis, data set to be used, inclusion and exclusion criteria, variable to be used in the main analysis, statistical methods / tests proposed, and table shells for univariate, bivariate analysis and multivariate analysis and any other items
as necessary
4 days
February 16, 2023
4
Draft Data Analysis for Tanzania and Rwanda. The data analysis plan must consider the study objectives, research questions and/or hypothesis, data set to be used, inclusion and exclusion criteria, variable to be used in the main analysis, statistical methods / tests proposed, and table shells for
univariate, bivariate analysis and multivariate analysis and any other items as necessary.
4 days
February 16, 2023
5
Draft Data Analysis Plan for DRC and Zambia. The data analysis plan must consider the study objectives, research questions and/or hypothesis, data set to be used, inclusion and exclusion criteria, variable to be used in the main analysis, statistical methods / tests proposed, and table shells for univariate, bivariate analysis and multivariate analysis and any
other items as necessary.
4 days
February 16, 2023
6
Final Data Analysis Plan for South Africa, incorporating feedback from Palladium and USAID.
1 day
March 3, 2023
7
Final Data Analysis Plan for Tanzania and Rwanda,
incorporating feedback from Palladium and USAID
1 day
March 3, 2023
8
Final Data Analysis Plan for DRC and Zambia,
incorporating feedback from Palladium and USAID.
1 day
March 3, 2023
NOTE: This job posting should not be construed to imply that the requirements are the exclusive standards of the position nor will it be the sole basis for any subsequent employee evaluations. Incumbents will follow any other instructions and perform any other related duties as may be required by their supervisor.
All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of race, color, national origin, religion, sex (including pregnancy, childbirth, or related medical conditions), age (40 and older), physical and mental disability, genetic information (including family medical history) or characteristics, military status, protected veteran status, sexual orientation, gender identity, citizenship or alienage, or any other protected status as established by applicable federal, state, or local law.
All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of race, color, national origin, religion, sex (including pregnancy, childbirth, or related medical conditions), age (40 and older), physical and mental disability, genetic information (including family medical history) or characteristics, military status, protected veteran status, sexual orientation, gender identity, citizenship or alienage, or any other protected status as established by applicable federal, state, or local law.
Please Note :
www.epokagency.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, www.epokagency.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, Site.com is the ideal place to find your next job.