Work

Since 2015, the Office of Evaluation Sciences has completed more than 50 tests with more than a dozen agencies.

These projects reflect the work of the OES team and dedicated civil servants across the federal government.

Year Completed
- All
- 2015
- 2016
- 2017
- 2018
Domain
- All
- Communications
- Economic Opportunity
- Education
- Employment
- Government Efficiency
- Government Operations
- Health
- Justice
- Retirement Security
Agency Collaborator
- All
- Agriculture
- Census
- Defense
- Department of Labor
- Education
- General Services Administration
- Health and Human Services
- Housing and Urban Development
- Justice
- Office of Personnel Management
- Postal Service
- Small Business Administration
- Social Security Administration
- Treasury
- US Global Change Research Program
- United States Agency for International Development
- Veterans Affairs

Integrating Health Care Services in Nigeria

A feasibility pilot to increase access to voluntary family planning services.

Read more about Integrating Health Care Services in Nigeria

Increasing Survey Responses to Improve USAGov Email Content

Analysis Plan Registration

Read more about Increasing Survey Responses to Improve USAGov Email Content

Increasing Flu Vaccine Uptake Among Veterans at the New York Harbor VA

Analysis Plan Registration

Read more about Increasing Flu Vaccine Uptake Among Veterans at the New York Harbor VA

Decreasing Energy Costs in Federally Assisted Housing

Sending flyers with energy-saving tips did not change energy use.

Read more about Decreasing Energy Costs in Federally Assisted Housing

Increasing Flu Vaccine Uptake Among Veterans at the St. Cloud VA

Analysis Plan Registration

Read more about Increasing Flu Vaccine Uptake Among Veterans at the St. Cloud VA

Matching Government Surplus Property with Interested Buyers

Customized emails reduced no-bids and increased overall revenue on gsaauctions.gov.

Read more about Matching Government Surplus Property with Interested Buyers

Encouraging Uptake of the Recommended Vaccine Sequence for Seniors in Louisiana

Analysis Plan Registration

Read more about Encouraging Uptake of the Recommended Vaccine Sequence for Seniors in Louisiana

Increasing immunization compliance among schools and daycare centers in D.C.

Analysis Plan Registration

Read more about Increasing immunization compliance among schools and daycare centers in D.C.

Encouraging Flu Vaccine Uptake Among Pregnant Patients at Duke

Analysis Plan Registration

Read more about Encouraging Flu Vaccine Uptake Among Pregnant Patients at Duke

Increasing Flexible Spending Account (FSA) Participation Among Government Employees

Analysis Plan Registration

Read more about Increasing Flexible Spending Account (FSA) Participation Among Government Employees

Increasing Patient use of Electronic Health Records for Blood Glucose Monitoring

Analysis Plan Registration

Read more about Increasing Patient use of Electronic Health Records for Blood Glucose Monitoring

Increasing Veteran Health Care Benefits Enrollment

Emails to transitioning servicemembers about VA health care benefits did not affect enrollment.

Read more about Increasing Veteran Health Care Benefits Enrollment

Increasing AHS Response Rates

A second advance letter does not significantly improve outcomes.

Read more about Increasing AHS Response Rates

Increasing TSP Enrollment among USPS Employees

Analysis Plan Registration

Read more about Increasing TSP Enrollment among USPS Employees

Increasing SSI Uptake Among Newly-Eligible Population

Analysis Plan Registration

Read more about Increasing SSI Uptake Among Newly-Eligible Population

Increasing ART Adherence and Retention in Care for HIV Positive Women in Ethiopia

Analysis Plan Registration

Read more about Increasing ART Adherence and Retention in Care for HIV Positive Women in Ethiopia

Increasing FAFSA Renewal Rates

Reminder emails sent to current students led to an increase of approximately 250,000 FAFSA submissions.

Read more about Increasing FAFSA Renewal Rates

Preventing Malaria During Pregnancy

Analysis Plan Registration

Read more about Preventing Malaria During Pregnancy

Increasing Pre- and Post-Natal Care Uptake Among Medicaid-Eligible Mothers

Analysis Plan Registration

Read more about Increasing Pre- and Post-Natal Care Uptake Among Medicaid-Eligible Mothers

Reducing Overprescribing of Quetiapine in Medicare Part D

Peer comparison letters for high prescribers of quetiapine reduce prescription volume and improve guideline conformity of prescription fills.

Read more about Reducing Overprescribing of Quetiapine in Medicare Part D

Encouraging Action Among Students At Risk to Withdraw

Reminding students to reapply for financial aid or begin loan repayment decreased postsecondary enrollment by one percentage point.

Read more about Encouraging Action Among Students At Risk to Withdraw

Improving Employment Services for UI Claimants in Oregon

Analysis Plan Registration

Read more about Improving Employment Services for UI Claimants in Oregon

Increasing Voluntary Submission of Demographics Information with USAJOBS Applications

The combination of default settings and simplified language increases voluntary submission of demographics information by 19%.

Read more about Increasing Voluntary Submission of Demographics Information with USAJOBS Applications

Prompting Decisions on Retirement Saving

Encouraging higher TSP contribution rates during new employee orientation showed no detectable effect on the likelihood of contributing 5% or more.

Read more about Prompting Decisions on Retirement Saving

Improving Capacity of Federal Managers through Project Management

A 16-week training course for Federal Supervisors shows potential to improve organizational culture and performance.

Read more about Improving Capacity of Federal Managers through Project Management

Encouraging Microloan Applications from Women-Owned Farms

A single direct mailer had no statistically reliable effect on the likelihood that female farmers who received it would apply for microloans.

Read more about Encouraging Microloan Applications from Women-Owned Farms

Increasing Military Patient Use of Secure Messaging through Email Reminders

Emails sent after an appointment-based intervention had no statistically reliable impact on patient registration for secure messaging.

Read more about Increasing Military Patient Use of Secure Messaging through Email Reminders

Increasing Military Patient Use of Secure Messaging through Personal Appeal and Assistance

Provider encouragement and on-the-spot assistance increased patient registrations for secure messaging.

Read more about Increasing Military Patient Use of Secure Messaging through Personal Appeal and Assistance

Improving Re-entry to Reduce Recidivism

Empowering the re-entry population to thrive in their communities by developing a handbook that articulates concrete steps.

Read more about Improving Re-entry to Reduce Recidivism

Increasing TSP Enrollment Rates through Active Choice

Presenting TSP enrollment as an active choice during in-processing increased enrollment by 6-7%.

Read more about Increasing TSP Enrollment Rates through Active Choice

Increasing Newsletter Subscription Rates of Active Duty Servicemembers

Clear communications emphasizing active choice increase subscription rates.

Read more about Increasing Newsletter Subscription Rates of Active Duty Servicemembers

Encouraging Engagement of Military Caregivers

Emails to caregivers of ill or wounded servicemembers increased awareness of available benefits.

Read more about Encouraging Engagement of Military Caregivers

Increasing FAFSA Completion by HUD-Assisted Youth

Sending letters to HUD-assisted youth had no significant effect on FAFSA completion rates.

Read more about Increasing FAFSA Completion by HUD-Assisted Youth

Increasing Enrollment in the Small Business Administration's Learning Center

Simplifying a registration form increased learning course completion and data collection.

Read more about Increasing Enrollment in the Small Business Administration's Learning Center

Improving Voter Participation in Local USDA Elections

Sending redesigned ballot materials to eligible farmers increased voter participation by 2.9%.

Read more about Improving Voter Participation in Local USDA Elections

Decreasing Non-responses to NSLP Income Verification Requests

Simplifying the income verification letter for National School Lunch Program recipients increased response rate by 2.1%.

Read more about Decreasing Non-responses to NSLP Income Verification Requests

National School Lunch Program Eligibility Verification

Timely communication with beneficiaries has mixed effects on response rates.

Read more about National School Lunch Program Eligibility Verification

Increasing Public Understanding of Climate Change Indicators

Simplifying visual graphics increases comprehension of climate change indicators.

Read more about Increasing Public Understanding of Climate Change Indicators

Increasing Tax Filing Among Lower-Income Individuals

Sending postcards effectively increased uptake of Earned Income Tax Credit among eligible population.

Read more about Increasing Tax Filing Among Lower-Income Individuals

Increasing Health Insurance Enrollment Among Uninsured Americans

Modified emails encourage open rates about health insurance enrollment.

Read more about Increasing Health Insurance Enrollment Among Uninsured Americans

Encouraging Medicare Beneficiaries to Self-Identify as ACO Patients

Sending a letter to Medicare beneficiaries increased voluntary alignment to Accountable Care Organizations.

Read more about Encouraging Medicare Beneficiaries to Self-Identify as ACO Patients

Increasing Patient Use of Health IT

Revising patient instructions following appointments led to 9.98% increase in online health portal activation.

Read more about Increasing Patient Use of Health IT

Facilitating Individual Action to Build Stronger Community-Police Relationships

Materials enable citizens to facilitate conversations and action planning around better community policing.

Read more about Facilitating Individual Action to Build Stronger Community-Police Relationships

Increasing Student Loan Rehabilitation Rates for Defaulted Borrowers

Emphasizing the negative consequences of loan default increases entry into loan rehabilitation programs.

Read more about Increasing Student Loan Rehabilitation Rates for Defaulted Borrowers

Increasing IDR Re-certification Among Student Borrowers

Including required payment amount increased IDR recertification by 8.4%.

Read more about Increasing IDR Re-certification Among Student Borrowers

Increasing IDR Applications Among Eligible Student Loan Borrowers - Scale Up

Email scale-up resulted in more than 6,000 borrowers signing up for income driven repayment plans.

Read more about Increasing IDR Applications Among Eligible Student Loan Borrowers - Scale Up

Increasing IDR Applications Among Eligible Student Loan Borrowers through Targeted Messages

Emails increase application submissions for income driven repayment plans.

Read more about Increasing IDR Applications Among Eligible Student Loan Borrowers through Targeted Messages

Increasing Access to PSLF Benefits Among Eligible Population

Emails increased Public Service Loan Forgiveness form submissions three-fold without increasing the error rate.

Read more about Increasing Access to PSLF Benefits Among Eligible Population

Increasing Military Retiree Reactivation of Online MyPay Accounts

Emails increased myPay account reactivation by military retirees.

Read more about Increasing Military Retiree Reactivation of Online MyPay Accounts

Reducing Summer Melt

Eight personalized text messages to low-income students resulted in a 6% increase in college enrollment.

Reducing Self-reporting Errors by IFF Form Users

Moving the signature box resulted in an extra $1.59 million paid to government by vendors.

Read more about Reducing Self-reporting Errors by IFF Form Users

Industrial Funding Fee Reports Update

A confirmation prompt reduced financial self-reporting errors initially, but the effect did not persist in subsequent periods.

Read more about Industrial Funding Fee Reports Update

Increasing Post-Grace Period Loan Payments by Student Borrowers

Emails sent to student loan borrowers at risk of default increased payments.

Read more about Increasing Post-Grace Period Loan Payments by Student Borrowers

Increasing Satisfaction Survey Response Rate from Federal Tenants - Time of Day

Emails sent at lunchtime saw 1.5% more Federal employees click through to a workplace survey.

Read more about Increasing Satisfaction Survey Response Rate from Federal Tenants - Time of Day

Increasing Satisfaction Survey Response Rate from Federal Tenants - Subject Lines and Day of Week

Emails with subject lines that included the word "please" increased Federal employees responses to a workplace survey.

Read more about Increasing Satisfaction Survey Response Rate from Federal Tenants - Subject Lines and Day of Week

Increasing Satisfaction Survey Response Rate from Federal Tenants - Calendar Invite

Emails including a calendar invite reminder led to increased survey responses from Federal employees.

Read more about Increasing Satisfaction Survey Response Rate from Federal Tenants - Calendar Invite

Increasing Chapter 36 Benefits Uptake by Veterans

Emails informing veterans about education and career benefits increased applications.

Read more about Increasing Chapter 36 Benefits Uptake by Veterans

Reducing Inappropriate Prescribing of Schedule II Substances in Medicare Part D

Sending letters of potential overprescribers did not influence Schedule II prescribing activities.

Read more about Reducing Inappropriate Prescribing of Schedule II Substances in Medicare Part D

Encouraging Account Transfers by Securities Holders

Scheduling appointments to transfer securities increased call-in rates by 2.37%.

Read more about Encouraging Account Transfers by Securities Holders

Increasing Farmer Microloan Applications

A new letter increases farmers' access to credit by 22%.

Read more about Increasing Farmer Microloan Applications

Increasing Online TSP Enrollment by Servicemembers

A single email to military Servicemembers nearly doubled the rate of savings plan enrollment.

Read more about Increasing Online TSP Enrollment by Servicemembers

Increasing Servicemember On-Base TSP Enrollment

Explaining benefits of TSP during in-processing doubled the number of Servicemembers enrolling.

Read more about Increasing Servicemember On-Base TSP Enrollment

Increasing Duplex Printing Among Federal Workforce

A digital pop up significantly lowers office-wide printing costs.

Read more about Increasing Duplex Printing Among Federal Workforce

Increasing Health Insurance Enrollment Among Uninsured Americans

A letter increased health insurance enrollment by 7.15%.

Read more about Increasing Health Insurance Enrollment Among Uninsured Americans

Increasing IDR Applications Among Delinquent Student Borrowers

Sending emails to delinquent borrowers positively impacted IDR application completion.

Read more about Increasing IDR Applications Among Delinquent Student Borrowers

Increasing Servicemember Roth TSP Re-Enrollment

One email enables 22% more Servicemembers to re-enroll in their Thrift Savings Plans.

Read more about Increasing Servicemember Roth TSP Re-Enrollment

Increasing Debt Repayment by Delinquent Lenders

A modified letter sent to delinquent borrowers increased utilization of online payments.

Read more about Increasing Debt Repayment by Delinquent Lenders