North America Evaluation Toolkit
J-PAL North America’s Evaluation Toolkit is intended for research teams preparing to launch a prospective randomized evaluation.
Incorporating lessons learned through our own experience and guidance from researchers and research organizations, we provide practical guidance for designing, implementing, and communicating about evaluations. While most of the content in this toolkit is relevant across countries and contexts, certain elements are most applicable to research conducted in the United States or research that utilizes administrative data.
Please reach out to [email protected] with questions and feedback.
Choose a View:
This is an overview of the Evaluation Toolkit, including a checklist for researchers and their teams with resources grouped by topic.
Partnerships and Assessing Feasibility
What do we need to consider when exploring a new randomized evaluation, and how can we ensure the elements are in place for a strong research partnership? How can researchers determine whether a randomized evaluation is right for a particular program, and what questions should we ask of implementing partners to determine the likelihood of a successful randomized evaluation?
Once we have explored the potential intervention and determined that it makes sense to continue with the design process, how can we ensure that our study design is feasible and makes sense in the context of the intervention? How can we set processes in place to make sure the evaluation is running as planned?
Data Collection and Access
Determining what kinds of data will be necessary for a randomized evaluation will be a key consideration for project feasibility and study design. What data do we need to answer our research questions, how will we go about collecting and accessing data, and how will we use data when we have them?
Data Analysis and Sharing Results
Accessing and analyzing data may take significant time before results are ready to share or publish. How can we plan to use data once we have them and think about proactively managing expectations with stakeholders? After analysis is complete, what actions do we need to take to publish data and prepare to submit a paper to an academic journal?
J-PAL North America’s Evaluation Toolkit is intended for research teams preparing to launch a prospective randomized evaluation in the United States. Research organizations have published a number of...
This resource outlines steps to establish and build a strong working relationship with an implementing partner at the beginning of a randomized evaluation. Topics include questions to consider when...
This resource guides researchers through background research and early discussions with a program implementer who has expressed interest in a randomized evaluation, and with whom a partnership seems...
This resource is intended for researchers who are designing and assessing the feasibility of a randomized evaluation with an implementing partner. We outline key principles, provide guidance on...
This checklist provides guidance on the logistical and administrative steps that are necessary to launch a randomized evaluation that adheres to legal regulations, follows transparency guidelines...
Implementing partners and researchers should work closely together during the study design phase of a randomized evaluation to create a feasible implementation strategy. This resource is intended to...
Several challenges arise from the length and complexity of randomized evaluations, including the management of multiple data sources or multiple rounds of surveys, sensitive or personally identifiable...
Administrative data are information collected, used, and stored primarily for administrative (i.e., operational), rather than research, purposes. These data can be an excellent source of information...