A
ARPS Institute
Solutions
ProgramsWorkshopInsightsContact
Applied Research Methods

Impact Evaluation: Methods and Practice

An advanced, methods-focused programme in impact evaluation: design and analyse randomised and quasi-experimental evaluations, combine them with theory-based and mixed methods, and turn results into decisions.

Duration
8 weeks
Level
Advanced
Format
Self-Paced
Language
English
Certificate
Verified Digital
Impact Evaluation: Methods and Practice
Preview this programme
$950
One-time payment
Open enrolment
In this programme
✓Thirty in-depth lessons across eight modules, one module per week, with seven module assignments and a Final Project
✓Sixty curated videos and sixty original titled diagrams explaining designs, methods and processes
✓Six verified reference readings and a Practice Studio portfolio checkpoint in every lesson
✓150 scenario quizzes, each with a retake variant, and a reflection in every lesson
♛
ARPS Institute Certificate
Upon completion you will receive a digitally signed, QR-verified certificate – shareable on LinkedIn and recognised globally.
Overview

What You Will Learn

Governments, development agencies, foundations and NGOs increasingly need to know whether their programmes cause the changes they intend, by how much and at what cost. Impact evaluation answers these questions by comparing what happened with what would have happened without the programme. Doing it well requires careful design, sound analysis and honest communication. Over eight weeks you will master the logic of causal inference and the main evaluation designs: randomised trials, including sample size and power; difference-in-differences and event studies; regression discontinuity; interrupted time series; matching; instrumental variables; and synthetic control. You will learn to measure outcomes well, use survey and administrative data, analyse heterogeneity responsibly, and combine experimental designs with theory-based and qualitative approaches such as contribution analysis, process tracing and outcome harvesting. You will also learn cost-effectiveness analysis, how to judge whether results will hold at scale, and how to make evaluations transparent and useful. This programme builds on monitoring and evaluation foundations and is the specialist next step after the ARPS Institute Monitoring and Evaluation (M&E) programme. Every lesson includes a Practice Studio activity with practice data and worked answers. Seven module assignments, applied to a programme of your choice, build into your final project. Your mark comes from the module assignments (50%) and a final project (50%), each marked against a published rubric. Lesson quizzes help you check your understanding but do not count towards your mark.

✓Explain the logic of causal inference, counterfactuals and threats to validity
✓Design randomised evaluations, including stratification, clustering and statistical power
✓Apply and interpret difference-in-differences, regression discontinuity, interrupted time series, matching, instrumental variables and synthetic control
✓Measure outcomes well and use survey and administrative data responsibly
✓Combine experimental designs with theory-based, qualitative and mixed methods
✓Assess cost-effectiveness, external validity and readiness to scale
✓Communicate impact findings transparently and support their use in decisions
Who this programme is for
Evaluators and evaluation managers
M&E specialists moving into impact evaluation
Researchers and research analysts in universities and think tanks
Programme and policy staff in government, donors and NGOs
Economists and data analysts working on programme effectiveness
Graduate students preparing for evaluation careers
Included

This Programme Includes

◆Thirty in-depth lessons across eight modules, one module per week, with seven module assignments and a Final Project
◆Sixty curated videos and sixty original titled diagrams explaining designs, methods and processes
◆Six verified reference readings and a Practice Studio portfolio checkpoint in every lesson
◆150 scenario quizzes, each with a retake variant, and a reflection in every lesson
◆A running case, the Evidence Bridge Collaborative, following evaluators in Abuja, Lucknow, Medellín and Hanoi
◆Worked examples and common mistakes drawn from evaluations around the world
Curriculum

Programme Outline

8 modules · 38 lessons · 8 weeks

The programme is structured across 8 modules, each covering one stage of learning.

What impact evaluation is, the counterfactual, theories of change and evaluation questions, and threats to validity.
1.1 What Impact Evaluation Is and When to Use It1.2 The Counterfactual and Potential Outcomes1.3 Theories of Change and Evaluation Questions1.4 Threats to Internal and External ValidityModule 1 Assignment: Evaluation Framing and Causal Logic Note
Designing randomised evaluations, sample size and power, analysis with compliance, and ethics, attrition and spillovers.
2.1 Designing Randomised Evaluations2.2 Sample Size, Statistical Power and Minimum Detectable Effects2.3 Analysing Trials: Intention to Treat and Compliance2.4 Ethics, Attrition and Spillovers in TrialsModule 2 Assignment: Randomised Evaluation Design
Difference-in-differences, event studies with staggered adoption, regression discontinuity and interrupted time series.
3.1 Difference-in-Differences3.2 Event Studies and Staggered Adoption3.3 Regression Discontinuity Designs3.4 Interrupted Time SeriesModule 3 Assignment: Quasi-Experimental Design: Changes over Time and Cut-offs
Matching and propensity scores, instrumental variables, synthetic control and choosing a design.
4.1 Matching and Propensity Scores4.2 Instrumental Variables and Encouragement Designs4.3 Synthetic Control Methods4.4 Choosing an Impact Evaluation DesignModule 4 Assignment: Design Comparison and Justification
Measuring outcomes and effect sizes, survey data quality, administrative and new data, and heterogeneity with multiple testing.
5.1 Measuring Outcomes and Effect Sizes5.2 Survey Design and Data Quality5.3 Administrative and New Data Sources5.4 Heterogeneity, Subgroups and Multiple TestingModule 5 Assignment: Measurement and Data Plan
Mixed methods, contribution analysis, process tracing, and outcome harvesting with Most Significant Change.
6.1 Mixed Methods Impact Evaluation6.2 Theory-Based Evaluation and Contribution Analysis6.3 Process Tracing6.4 Outcome Harvesting and Most Significant ChangeModule 6 Assignment: Mixed Methods and Theory-Based Component
Cost-effectiveness, external validity and scaling, transparency and pre-registration, and communicating impact evidence.
7.1 Cost-Effectiveness and Cost-Benefit Analysis7.2 External Validity and Scaling Up7.3 Transparency, Pre-Registration and Reproducibility7.4 Communicating and Using Impact EvidenceModule 7 Assignment: Cost-Effectiveness, Scaling and Use Plan
Planning, assembling and presenting your Impact Evaluation Design and Analysis Portfolio.
8.1 Planning Your Impact Evaluation Design and Analysis Portfolio8.2 Assembling and Presenting Your PortfolioFinal Project: Impact Evaluation Design and Analysis Portfolio
Programme facilitator

Meet Your Instructor

AI
ARPS Institute
Programme Developer & Provider
56 programmes on ARPS Institute · Applied Research Methods
More by ARPS Institute
Monitoring and Evaluation (M&E)
Applied Research Methods
Monitoring and Evaluation (M&E)
6 weeks$950
Policy Research and Public Sector Analysis
Applied Research Methods
Policy Research and Public Sector Analysis
6 weeks$950
Institutional Research and Higher Education Analytics
Applied Research Methods
Institutional Research and Higher Education Analytics
8 weeks$950
FAQs

Frequently Asked Questions

The M&E programme focuses on building monitoring systems, indicators, evaluation management and learning. This programme focuses on methods for proving and measuring impact. Many participants take M&E first.
You should be comfortable with basic statistics such as means, percentages and confidence intervals. All Practice Studio activities can be completed in a spreadsheet; R, Python or Stata are optional.
Plan for about 8 to 10 hours a week over eight weeks, including lessons, Practice Studio activities and module assignments.
Yes. You will choose one programme or policy at the start and apply every assignment to it. Use only data you have permission to use.
Participants who meet the assessment requirements receive an ARPS Institute certificate and their completed final project.
Your mark comes from the module assignments (50%) and a final project (50%), each marked against a published rubric. Lesson quizzes help you check your understanding but do not count towards your mark. You need 60 per cent overall, and at least 50 per cent in each half, to pass, and you may resubmit the final project up to twice.
$950
Programs

You May Also Like

Browse all programs →
PAR for Public Health and Rural Development
Applied Research Methods
PAR for Public Health and Rural Development
7 weeks$850
Doctoral Supervision and Researcher Development
Education & Higher Education Leadership
Doctoral Supervision and Researcher Development
★ 4.8$900
Public Sector Leadership and Governance
Management Sciences
Public Sector Leadership and Governance
7 weeks$900
Applied Quantitative Research Methods
Applied Research Methods
Applied Quantitative Research Methods
6 weeks$700

Advancing Professional Expertise,
Research & Leadership.

Global professional certification programs, research training, software solutions, and institutional consulting for scholars and practitioners worldwide.

Company

  • About Us
  • Solutions
  • Workshops
  • Programs
  • Insights
  • Join Us
  • Contact

Research Projects

    Workshops & Training

      Stay informed — get new programmes & research insights.

      No spam. Unsubscribe at any time.

      • Privacy Policy
      • Terms & Conditions
      • Refund Policy
      • Cookie Policy

      © 2026 ARPS Institute. All Rights Reserved.