North America Evaluation Toolkit

J-PAL North America’s Evaluation Toolkit is intended for research teams preparing to launch a prospective randomized evaluation.

Incorporating lessons learned through our own experience and guidance from researchers and research organizations, we provide practical guidance for designing, implementing, and communicating about evaluations. While most of the content in this toolkit is relevant across countries and contexts, certain elements are most applicable to research conducted in the United States or research that utilizes administrative data.

Please reach out to [email protected] with questions and feedback. 

Choose a View:

Introductory Checklist

Resources

Section Summary

This is an overview of the Evaluation Toolkit, including a checklist for researchers and their teams with resources grouped by topic.

Partnerships and Assessing Feasibility

Resources

Section Summary

What do we need to consider when exploring a new randomized evaluation, and how can we ensure the elements are in place for a strong research partnership? How can researchers determine whether a randomized evaluation is right for a particular program, and what questions should we ask of implementing partners to determine the likelihood of a successful randomized evaluation?

Implementation Strategy

Resources

Section Summary

Once we have explored the potential intervention and determined that it makes sense to continue with the design process, how can we ensure that our study design is feasible and makes sense in the context of the intervention? How can we set processes in place to make sure the evaluation is running as planned?

Data Collection and Access

Resources

Section Summary

Determining what kinds of data will be necessary for a randomized evaluation will be a key consideration for project feasibility and study design. What data do we need to answer our research questions, how will we go about collecting and accessing data, and how will we use data when we have them?

Data Analysis and Sharing Results

Resources

Section Summary

Accessing and analyzing data may take significant time before results are ready to share or publish. How can we plan to use data once we have them and think about proactively managing expectations with stakeholders? After analysis is complete, what actions do we need to take to publish data and prepare to submit a paper to an academic journal?