Below are resources we’ve developed through our work building evidence government-wide.
OES sends out regular newsletters with upcoming events, recent project results, and other news. You can subscribe to our newsletter here.
- February 2023: Results from four evaluations of the American Rescue Plan’s State and Local Fiscal Recovery Funds Program
- December 2022: Results from a descriptive study of equity and efforts to improve Supplemental Security Income outreach
- November 2022: The Office of Evaluation Sciences (OES) is Hiring!
- August 2022: Sharing the purpose of a default increases responses
- June 2022: Reminder cards increased the return of unused prescription opioids
- April 2022: A series of emails and a letter increased take-up of the American Opportunity Tax Credit
- March 2022: How much do low-cost, behaviorally informed letters increase health insurance enrollment?
- February 2022: What are the best ways to encourage COVID-19 vaccination?
- January 2022: Supporting NOAA’s Equity Assessment Teams
- December 2021: A Community Toolkit for Addressing Health Misinformation from the Office of the Surgeon General
- November 2021: A Behavioral Insights Guide for Improving Payment Integrity
- October 2021: OES@100: Celebrating 100 Collaborations Across Government
- August 2021: Text reminders increased clinic visits for family planning services in Mozambique
- July 2021: Using behavioral insights to improve customer experience within government
- April 2021: New working paper shows how OES letters tripled SSI awards
- March 2021: Learn more about OES behavioral maps, intervention packs, and evaluation designs
- February 2021: Two-year follow up shows that effects of an OES anchoring intervention persist
What leads to a successful evaluation? Reflections from 100 OES collaborations
OES has completed 100 collaborations across government since 2015. This has entailed working with agency collaborators across 21 federal departments, in addition to 139 OES team members from 83 institutions. Our evaluations have involved over 44 million individuals. In this document, we share our reflections on what we have learned about how to build and use evidence in government to date across 100 completed collaborations.
OES@100 Handout (PDF)
How to Design Effective Communications
The United States government sends hundreds of millions of letters and emails to its citizens every year. These communications serve as a critical touchpoint by which citizens engage with our government programs and impact outcomes such as health insurance coverage, education enrollment and financing, tax compliance and benefits take-up, retirement security, and employment. Designing effective communications is therefore vital to ensuring that our government programs reach the people they are intended to serve. Since 2015, OES has completed more than 50 communication-specific interventions and evaluations with more than a dozen Federal agencies. Here’s what these tests have revealed about how to design effective communications.
Communications Design Tips (PDF)
Responding to the COVID-19 epidemic has made it more important than ever for the government to design effective health communications. Here’s what these collaborations have revealed about how to design more effective health communications:
Health Communications Tips (PDF)
Effective Strategies to Encourage COVID-19 Prevention Behaviors
This quick turnaround effort shares insights on what works to promote healthy behaviors, as relevant in the effort to combat COVID-19. These insights come from previous research on decision making and behavior change in other contexts, and more recent evaluations in the specific context of the COVID-19 crisis. The document includes relevant evidence on the message and the format.
Encouraging COVID-19 Prevention Behaviors (PDF)
OES Equity Evaluation Series Memos
This memo series is intended to guide OES’ commitment to equity in our evaluation process and our efforts toward understanding and reducing barriers to equitable access to federal programs. These memos are intended to be internal guidance documents for OES team members, covering a range of topics including defining equity in quantitative evaluations and methodological guidance on choosing control variables in regression analyses. Their goal is to improve the consistency and quality of equity in OES evaluations, as well as to provide training resources for OES researchers in this field.
Defining Equity in Federal Government Evaluations (PDF)
Matching an Evaluation Method to Your Equity Question (PDF)
Choosing Controls in Regression Analyses Involving Equity
Guidance on Using Multinomial Tests for Differences in Distribution (PDF)
Intergovernmental Personnel Act (IPA) Toolkit
OES uses the Intergovernmental Personnel Act (IPA) Mobility Program to bring on unique talent to support agency priorities and evidence needs. The purpose of this toolkit is to provide internal guidance on how OES has utilized the IPA Mobility Program in the past to fill highly technical positions in a quick and simple way where there might otherwise be capacity gaps. Personnel with IPAs at OES have served in roles as fellows, academic affiliates, and statistical methods support.
OES IPA Toolkit (PDF)