Adding peer comparisons and information that registering is quick and easy to emails did not increase submission of spending reports

Small town in Alabama

Small town in Alabama

What was the challenge?

As part of the American Rescue Plan (ARP), the Department of the Treasury (“Treasury”) is administering the State and Local Fiscal Recovery Funds program (SLFRF), which provides $350 billion in funding for eligible state, local, territorial, and Tribal governments to support their response to and recovery from the COVID-19 public health emergency. Approximately 27,000 small cities and towns – referred to as non-entitlement units (NEUs) of local government – were allocated $19.5 billion of this funding.¹

NEUs must submit their Project & Expenditure reports (“spending reports”) on Treasury’s American Rescue Plan (ARP) Reporting and Compliance Portal. Treasury seeks to support NEUs to meet their reporting requirements in order to promote transparency, responsibility, and equity in the use of funds.

A major question for Treasury is how to best incentivize NEUs to comply with reporting requirements, given the sheer number of NEUs and their infrequent contact with federal agencies. We partnered with Treasury to test whether messages that encourage NEUs to conform to peers’ behaviors or provide information on the time costs of submission can influence them to submit reports in a more timely manner. These messages were easily incorporated into Treasury’s planned communications and have the potential to prevent the need to follow up with NEUs who did not submit on time.

What did we do?

We collaborated with Treasury to redesign emails that encourage timely submission of spending reports. We evaluated two email changes against the business-as-usual version: 1) including a peer comparison; and 2) including information on how submitting is quick and easy. The peer comparison message noted that 97% of SLFRF recipients with a prior reporting deadline submitted their reports on time. The quick and easy message stated that submitting should take less than 30 minutes and that there are resources available to help recipients.

What did we learn?

We find no evidence that the alternative messaging increased timely report submissions. One week after the email was sent, the estimated effect of the peer comparison treatment was small, negative, and statistically insignificant. For the quick and easy treatment, the estimated effect was negative 1.2 percentage points, which is statistically significant. Two weeks later (one day after the deadline), we found no statistically significant effect for either treatment.

Figure 1. Numbers of NEUs that submitted reports on Treasury’s ARP Reporting and Compliance Portal Line graph showing no statistically significant effect for either treatment.

Future work can investigate why the messaging treatments were not effective in getting recipients to submit their spending reports and caused recipients to delay submission.

Notes:

  1. Non-entitlement units of local government (NEUs), defined in section 603(g)(5) of the Social Security Act, as added by section 9901 of the American Rescue Plan Act of 2021, are local governments typically serving populations of less than 50,000. NEUs include cities, villages, towns, townships, or other types of local governments.

Verify the upload date of our analysis plan on GitHub.

Year

2022

Status

Complete

Project Type

Impact evaluation of program change

Agency

Treasury

Domain

American Rescue Plan, Economic Opportunity

Resources

View Analysis Plan (PDF) View Abstract (PDF) View Intervention Pack (PDF)