Building evidence

Since 2015, the Office of Evaluation Sciences has completed more than 70 evaluations with more than a dozen agencies.

Because results from OES evaluations impact the lives of millions of Americans, the quality of our work is of paramount importance. We follow the OES Evaluation Policy and six steps to ensure our findings are relevant and reliable.

Learn more about our project process here.

Year Completed

All
2015
2016
2017
2018
2019
2020

Status

All
Complete
Ongoing

Domain

All
Communications
Economic Opportunity
Education
Employment
Government Efficiency
Government Operations
Health
Retirement Security

Agency Collaborator

All
Agriculture
Census
Defense
Department of Education
Department of Labor
Education
General Services Administration
Health and Human Services
Housing and Urban Development
Office of Personnel Management
Postal Service
Small Business Administration
Social Security Administration
Treasury
United States Agency for International Development
Veterans Affairs

Increasing homeowner participation in wildfire risk assessments

Analysis Plan Registration

Read more about Increasing homeowner participation in wildfire risk assessments

Characterizing Nonresponse Bias in the American Housing Survey (AHS)

Analysis Plan Registration

Read more about Characterizing Nonresponse Bias in the American Housing Survey (AHS)

Increasing utilization of family planning services in Mozambique through an SMS Intervention

Analysis Plan Registration

Read more about Increasing utilization of family planning services in Mozambique through an SMS Intervention

Project SOAR

Analysis Plan Registration

Reducing Concurrent Opioid-Benzodiazepine Prescriptions Through Provider Messages

Analysis Plan Registration

Read more about Reducing Concurrent Opioid-Benzodiazepine Prescriptions Through Provider Messages

Timely Wage Reporting Among SSI Recipients

A reminder encouraged SSI recipients to self-report changes in wages earlier, potentially reducing overpayment.

Read more about Timely Wage Reporting Among SSI Recipients

Increasing Vaccine Uptake Through Performance Feedback

Analysis Plan Registration

Read more about Increasing Vaccine Uptake Through Performance Feedback

Using Proactive Communication to Increase College Enrollment for Post-9/11 GI Bill Beneficiaries

A general proactive email, encouraging increased postsecondary enrollment, influenced the enrollment intensity of Post-9/11 GI Bill users

Read more about Using Proactive Communication to Increase College Enrollment for Post-9/11 GI Bill Beneficiaries

Increasing School Attendance in Seattle

Proactive communications do not change attendance outcomes

Read more about Increasing School Attendance in Seattle

Using Social Norms to Decrease Energy Use in Public Housing

Letters with feedback on energy use and comparisons to efficient neighbors did not reduce energy use among public housing residents

Read more about Using Social Norms to Decrease Energy Use in Public Housing

Increasing Vaccine Uptake Among Veterans at the Atlanta VA Health Care System

A modified clinical reminder did not increase patient vaccine uptake.

Read more about Increasing Vaccine Uptake Among Veterans at the Atlanta VA Health Care System

Increasing Survey Response to Improve USAGov Email Content

A timeline making government operations transparent increased survey response and an early message of gratitude decreased survey response.

Read more about Increasing Survey Response to Improve USAGov Email Content

Increasing Use of Patient Generated Health Data through Patient Reminders

Sending reminder messages focused on provider accountability increased patients’ use of electronic blood glucose flow sheets.

Read more about Increasing Use of Patient Generated Health Data through Patient Reminders

Increasing Use of Patient Generated Health Data through Provider Encouragement

A virtual provider training and encouragement increased use of electronic blood glucose flow sheets.

Read more about Increasing Use of Patient Generated Health Data through Provider Encouragement

Increasing FAFSA Completion Among Public Housing Residents: Seattle and King County

A pair of communications do not change FAFSA completion rates

Read more about Increasing FAFSA Completion Among Public Housing Residents: Seattle and King County

Increasing FAFSA Completion Among Public Housing Residents: NYCHA

A series of communications do not change FAFSA completion rates

Read more about Increasing FAFSA Completion Among Public Housing Residents: NYCHA

Improving Employment Services for UI Claimants in Oregon

Requiring personal employment plans did not change the employment rate

Read more about Improving Employment Services for UI Claimants in Oregon

Communicating Employment Supports to Denied Disability Insurance Applicants

Letters to denied disability applicants about employment support programs did not reduce appeals.

Read more about Communicating Employment Supports to Denied Disability Insurance Applicants

Increasing Flu Vaccine Uptake Among Veterans at the New York Harbor VA

Emails incorporating behavioral insights were not effective in increasing flu shot uptake.

Read more about Increasing Flu Vaccine Uptake Among Veterans at the New York Harbor VA

Decreasing Energy Costs in Federally Assisted Housing

Sending flyers with energy-saving tips did not change energy use.

Read more about Decreasing Energy Costs in Federally Assisted Housing

Increasing Flu Vaccine Uptake Among Veterans at the St. Cloud VA

Postcards incorporating behavioral insights were not more effective than a basic informational postcard.

Read more about Increasing Flu Vaccine Uptake Among Veterans at the St. Cloud VA

Increasing Vaccine Uptake Among Seniors

Sending postcard reminders increases vaccination rates among elderly

Read more about Increasing Vaccine Uptake Among Seniors

Increasing Immunization Compliance in Schools

Data visualization for school-specific immunization compliance reports did not impact compliance rates.

Read more about Increasing Immunization Compliance in Schools

Encouraging Flu Vaccine Uptake Among Pregnant Patients at Duke

Targeted email outreach via an electronic medical record messaging system did not increase uptake of the flu vaccine among pregnant women.

Read more about Encouraging Flu Vaccine Uptake Among Pregnant Patients at Duke

Increasing Flexible Spending Account (FSA) Participation Among Government Employees

Targeted email outreach to GSA employees did not increase enrollment in Flexible Spending Accounts.

Read more about Increasing Flexible Spending Account (FSA) Participation Among Government Employees

Increasing AHS Response Rates

A second advance letter does not significantly improve outcomes.

Read more about Increasing AHS Response Rates

Increasing TSP Enrollment among USPS Employees

Testing mailings to increase USPS retirement enrollment and contributions

Read more about Increasing TSP Enrollment among USPS Employees

Increasing SSI Uptake Among a Potentially Eligible Population

Letters to adults 65 or older increased SSI awards by 340%.

Read more about Increasing SSI Uptake Among a Potentially Eligible Population

Increasing ART Adherence and Retention in Care for HIV Positive Women in Ethiopia

Phone calls delivered to HIV+ women did not increase ART adherence.

Read more about Increasing ART Adherence and Retention in Care for HIV Positive Women in Ethiopia

Preventing Malaria During Pregnancy

Redesigned referral process did not increase antenatal care (ANC) attendance for pregnant women.

Read more about Preventing Malaria During Pregnancy

Identifying Students for the Education for Homeless Children and Youth Program

Identifying Homeless Students for Educational Support Services

Read more about Identifying Students for the Education for Homeless Children and Youth Program

Increasing Pre- and Post-Natal Care Uptake Among Medicaid-Eligible Mothers

Home Visiting Uptake Among Medicaid-Eligible Mothers.

Read more about Increasing Pre- and Post-Natal Care Uptake Among Medicaid-Eligible Mothers

Reducing Overprescribing of Quetiapine in Medicare Part D

Peer comparison letters for high prescribers of quetiapine reduce prescription volume and improve guideline conformity of prescription fills.

Read more about Reducing Overprescribing of Quetiapine in Medicare Part D

Matching Government Surplus Property with Interested Buyers

Customized emails reduced no-bids and increased overall revenue on gsaauctions.gov.

Read more about Matching Government Surplus Property with Interested Buyers

Testing Variations of Maternal Immunization Messages

Variations of an ad did not lead to detectable differences in site visits.

Read more about Testing Variations of Maternal Immunization Messages

Increasing Veteran Health Care Benefits Enrollment

Emails to transitioning servicemembers about VA health care benefits did not affect enrollment.

Read more about Increasing Veteran Health Care Benefits Enrollment

Increasing FAFSA Renewal Rates

Reminder emails sent to current students led to an increase of approximately 250,000 FAFSA submissions.

Read more about Increasing FAFSA Renewal Rates

Encouraging Action Among Students At Risk to Withdraw

Reminding students to reapply for financial aid or begin loan repayment decreased postsecondary enrollment by one percentage point.

Read more about Encouraging Action Among Students At Risk to Withdraw

Increasing Voluntary Submission of Demographics Information with USAJOBS Applications

The combination of default settings and simplified language increases voluntary submission of demographics information by 19%.

Read more about Increasing Voluntary Submission of Demographics Information with USAJOBS Applications

Prompting Decisions on Retirement Saving

Encouraging higher TSP contribution rates during new employee orientation showed no detectable effect on the likelihood of contributing 5% or more.

Read more about Prompting Decisions on Retirement Saving

Improving Capacity of Federal Managers through Project Management

A 16-week training course for Federal Supervisors shows potential to improve organizational culture and performance.

Read more about Improving Capacity of Federal Managers through Project Management

Encouraging Microloan Applications from Women-Owned Farms

A single direct mailer had no statistically reliable effect on the likelihood that female farmers who received it would apply for microloans.

Read more about Encouraging Microloan Applications from Women-Owned Farms

Increasing Military Patient Use of Secure Messaging through Email Reminders

Emails sent after an appointment-based intervention had no statistically reliable impact on patient registration for secure messaging.

Read more about Increasing Military Patient Use of Secure Messaging through Email Reminders

Increasing Military Patient Use of Secure Messaging through Personal Appeal and Assistance

Provider encouragement and on-the-spot assistance increased patient registrations for secure messaging.

Read more about Increasing Military Patient Use of Secure Messaging through Personal Appeal and Assistance

National School Lunch Program Eligibility Verification

Timely communication with beneficiaries has mixed effects on response rates.

Read more about National School Lunch Program Eligibility Verification

Industrial Funding Fee Reports Update

A confirmation prompt reduced financial self-reporting errors initially, but the effect did not persist in subsequent periods.

Read more about Industrial Funding Fee Reports Update

Increasing TSP Enrollment Rates through Active Choice

Presenting TSP enrollment as an active choice during in-processing increased enrollment by 6-7%.

Read more about Increasing TSP Enrollment Rates through Active Choice

Increasing Newsletter Subscription Rates of Active Duty Servicemembers

Clear communications emphasizing active choice increase subscription rates.

Read more about Increasing Newsletter Subscription Rates of Active Duty Servicemembers

Encouraging Engagement of Military Caregivers

Emails to caregivers of ill or wounded servicemembers increased awareness of available benefits.

Read more about Encouraging Engagement of Military Caregivers

Increasing FAFSA Completion by HUD-Assisted Youth

Sending letters to HUD-assisted youth had no significant effect on FAFSA completion rates.

Read more about Increasing FAFSA Completion by HUD-Assisted Youth

Increasing Enrollment in the Small Business Administration's Learning Center

Simplifying a registration form increased learning course completion and data collection.

Read more about Increasing Enrollment in the Small Business Administration's Learning Center

Improving Voter Participation in Local USDA Elections

Sending redesigned ballot materials to eligible farmers increased voter participation by 2.9%.

Read more about Improving Voter Participation in Local USDA Elections

Decreasing Non-responses to NSLP Income Verification Requests

Simplifying the income verification letter for National School Lunch Program recipients increased response rate by 2.1%.

Read more about Decreasing Non-responses to NSLP Income Verification Requests

Increasing Tax Filing Among Lower-Income Individuals

Sending postcards effectively increased uptake of Earned Income Tax Credit among eligible population.

Read more about Increasing Tax Filing Among Lower-Income Individuals

Increasing Health Insurance Enrollment Among Uninsured Americans

Modified emails encourage open rates about health insurance enrollment.

Read more about Increasing Health Insurance Enrollment Among Uninsured Americans

Encouraging Medicare Beneficiaries to Self-Identify as ACO Patients

Sending a letter to Medicare beneficiaries increased voluntary alignment to Accountable Care Organizations.

Read more about Encouraging Medicare Beneficiaries to Self-Identify as ACO Patients

Increasing Patient Use of Health IT

Revising patient instructions following appointments led to 9.98% increase in online health portal activation.

Read more about Increasing Patient Use of Health IT

Increasing Student Loan Rehabilitation Rates for Defaulted Borrowers

Emphasizing the negative consequences of loan default increases entry into loan rehabilitation programs.

Read more about Increasing Student Loan Rehabilitation Rates for Defaulted Borrowers

Increasing IDR Re-certification Among Student Borrowers

Including required payment amount increased IDR recertification by 8.4%.

Read more about Increasing IDR Re-certification Among Student Borrowers

Increasing IDR Applications Among Eligible Student Loan Borrowers - Scale Up

Email scale-up resulted in more than 6,000 borrowers signing up for income driven repayment plans.

Read more about Increasing IDR Applications Among Eligible Student Loan Borrowers - Scale Up

Increasing IDR Applications Among Eligible Student Loan Borrowers through Targeted Messages

Emails increase application submissions for income driven repayment plans.

Read more about Increasing IDR Applications Among Eligible Student Loan Borrowers through Targeted Messages

Increasing Access to PSLF Benefits Among Eligible Population

Emails increased Public Service Loan Forgiveness form submissions three-fold without increasing the error rate.

Read more about Increasing Access to PSLF Benefits Among Eligible Population

Increasing Military Retiree Reactivation of Online MyPay Accounts

Emails increased myPay account reactivation by military retirees.

Read more about Increasing Military Retiree Reactivation of Online MyPay Accounts

Encouraging Flu Vaccine Uptake among Medicare Beneficiaries

Letters sent to Medicare beneficiaries increased uptake of the flu vaccine.

Read more about Encouraging Flu Vaccine Uptake among Medicare Beneficiaries

Reducing Summer Melt

Eight personalized text messages to low-income students resulted in a 6% increase in college enrollment.

Reducing Self-reporting Errors by IFF Form Users

Adding the signature box resulted in an extra $1.59 million paid to government by vendors.

Read more about Reducing Self-reporting Errors by IFF Form Users

Increasing Post-Grace Period Loan Payments by Student Borrowers

Emails sent to student loan borrowers at risk of default increased payments.

Read more about Increasing Post-Grace Period Loan Payments by Student Borrowers

Increasing Satisfaction Survey Response Rate from Federal Tenants - Time of Day

Emails sent at lunchtime saw 1.5% more Federal employees click through to a workplace survey.

Read more about Increasing Satisfaction Survey Response Rate from Federal Tenants - Time of Day

Increasing Satisfaction Survey Response Rate from Federal Tenants - Subject Lines and Day of Week

Emails with subject lines that included the word "please" increased Federal employees responses to a workplace survey.

Read more about Increasing Satisfaction Survey Response Rate from Federal Tenants - Subject Lines and Day of Week

Increasing Satisfaction Survey Response Rate from Federal Tenants - Calendar Invite

Emails including a calendar invite reminder led to increased survey responses from Federal employees.

Read more about Increasing Satisfaction Survey Response Rate from Federal Tenants - Calendar Invite

Increasing Chapter 36 Benefits Uptake by Veterans

Emails informing veterans about education and career benefits increased applications.

Read more about Increasing Chapter 36 Benefits Uptake by Veterans

Reducing Inappropriate Prescribing of Schedule II Substances in Medicare Part D

Sending letters to potential overprescribers did not influence Schedule II prescribing activities.

Read more about Reducing Inappropriate Prescribing of Schedule II Substances in Medicare Part D

Encouraging Account Transfers by Securities Holders

Scheduling appointments to transfer securities increased call-in rates by 2.37%.

Read more about Encouraging Account Transfers by Securities Holders

Increasing Farmer Microloan Applications

A new letter increases farmers' access to credit by 22%.

Read more about Increasing Farmer Microloan Applications

Increasing Online TSP Enrollment by Servicemembers

A single email to military Servicemembers nearly doubled the rate of savings plan enrollment.

Read more about Increasing Online TSP Enrollment by Servicemembers

Increasing Servicemember On-Base TSP Enrollment

Explaining benefits of TSP during in-processing doubled the number of Servicemembers enrolling.

Read more about Increasing Servicemember On-Base TSP Enrollment

Increasing Duplex Printing Among Federal Workforce

A digital pop up significantly lowers office-wide printing costs.

Read more about Increasing Duplex Printing Among Federal Workforce

Increasing Health Insurance Enrollment Among Uninsured Americans

A letter increased health insurance enrollment by 7.15%.

Read more about Increasing Health Insurance Enrollment Among Uninsured Americans

Increasing IDR Applications Among Delinquent Student Borrowers

Sending emails to delinquent borrowers positively impacted IDR application completion.

Read more about Increasing IDR Applications Among Delinquent Student Borrowers

Increasing Servicemember Roth TSP Re-Enrollment

One email enables 22% more Servicemembers to re-enroll in their Thrift Savings Plans.

Read more about Increasing Servicemember Roth TSP Re-Enrollment

Increasing Debt Repayment by Delinquent Lenders

A modified letter sent to delinquent borrowers increased utilization of online payments.

Read more about Increasing Debt Repayment by Delinquent Lenders

Building evidence

Filter the project listing By year completed, current status, domain, and agency collaborator

Increasing homeowner participation in wildfire risk assessments

Characterizing Nonresponse Bias in the American Housing Survey (AHS)

Increasing utilization of family planning services in Mozambique through an SMS Intervention

Project SOAR

Reducing Concurrent Opioid-Benzodiazepine Prescriptions Through Provider Messages

Timely Wage Reporting Among SSI Recipients

Increasing Vaccine Uptake Through Performance Feedback

Using Proactive Communication to Increase College Enrollment for Post-9/11 GI Bill Beneficiaries

Increasing School Attendance in Seattle

Using Social Norms to Decrease Energy Use in Public Housing

Increasing Vaccine Uptake Among Veterans at the Atlanta VA Health Care System

Increasing Survey Response to Improve USAGov Email Content

Increasing Use of Patient Generated Health Data through Patient Reminders

Increasing Use of Patient Generated Health Data through Provider Encouragement

Increasing FAFSA Completion Among Public Housing Residents: Seattle and King County

Increasing FAFSA Completion Among Public Housing Residents: NYCHA

Improving Employment Services for UI Claimants in Oregon

Communicating Employment Supports to Denied Disability Insurance Applicants

Increasing Flu Vaccine Uptake Among Veterans at the New York Harbor VA

Decreasing Energy Costs in Federally Assisted Housing

Increasing Flu Vaccine Uptake Among Veterans at the St. Cloud VA

Increasing Vaccine Uptake Among Seniors

Increasing Immunization Compliance in Schools

Encouraging Flu Vaccine Uptake Among Pregnant Patients at Duke

Increasing Flexible Spending Account (FSA) Participation Among Government Employees

Increasing AHS Response Rates

Increasing TSP Enrollment among USPS Employees

Increasing SSI Uptake Among a Potentially Eligible Population

Increasing ART Adherence and Retention in Care for HIV Positive Women in Ethiopia

Preventing Malaria During Pregnancy

Identifying Students for the Education for Homeless Children and Youth Program

Increasing Pre- and Post-Natal Care Uptake Among Medicaid-Eligible Mothers

Reducing Overprescribing of Quetiapine in Medicare Part D

Matching Government Surplus Property with Interested Buyers

Testing Variations of Maternal Immunization Messages

Increasing Veteran Health Care Benefits Enrollment

Increasing FAFSA Renewal Rates

Encouraging Action Among Students At Risk to Withdraw

Increasing Voluntary Submission of Demographics Information with USAJOBS Applications

Prompting Decisions on Retirement Saving

Improving Capacity of Federal Managers through Project Management

Encouraging Microloan Applications from Women-Owned Farms

Increasing Military Patient Use of Secure Messaging through Email Reminders

Increasing Military Patient Use of Secure Messaging through Personal Appeal and Assistance

National School Lunch Program Eligibility Verification

Industrial Funding Fee Reports Update

Increasing TSP Enrollment Rates through Active Choice

Increasing Newsletter Subscription Rates of Active Duty Servicemembers

Encouraging Engagement of Military Caregivers

Increasing FAFSA Completion by HUD-Assisted Youth

Increasing Enrollment in the Small Business Administration's Learning Center

Improving Voter Participation in Local USDA Elections

Decreasing Non-responses to NSLP Income Verification Requests

Increasing Tax Filing Among Lower-Income Individuals

Increasing Health Insurance Enrollment Among Uninsured Americans

Encouraging Medicare Beneficiaries to Self-Identify as ACO Patients

Increasing Patient Use of Health IT

Increasing Student Loan Rehabilitation Rates for Defaulted Borrowers

Increasing IDR Re-certification Among Student Borrowers

Increasing IDR Applications Among Eligible Student Loan Borrowers - Scale Up

Increasing IDR Applications Among Eligible Student Loan Borrowers through Targeted Messages

Increasing Access to PSLF Benefits Among Eligible Population

Increasing Military Retiree Reactivation of Online MyPay Accounts

Encouraging Flu Vaccine Uptake among Medicare Beneficiaries

Reducing Summer Melt

Reducing Self-reporting Errors by IFF Form Users

Increasing Post-Grace Period Loan Payments by Student Borrowers

Increasing Satisfaction Survey Response Rate from Federal Tenants - Time of Day

Increasing Satisfaction Survey Response Rate from Federal Tenants - Subject Lines and Day of Week

Increasing Satisfaction Survey Response Rate from Federal Tenants - Calendar Invite

Increasing Chapter 36 Benefits Uptake by Veterans

Reducing Inappropriate Prescribing of Schedule II Substances in Medicare Part D

Encouraging Account Transfers by Securities Holders

Increasing Farmer Microloan Applications

Increasing Online TSP Enrollment by Servicemembers

Increasing Servicemember On-Base TSP Enrollment

Increasing Duplex Printing Among Federal Workforce

Increasing Health Insurance Enrollment Among Uninsured Americans