How does OES work?
Results from OES studies impact the lives of millions of Americans, and thus the quality of our work and reliability of our findings are of paramount importance. Our team tackles some of our nation’s toughest challenges in a complex government environment and must provide results that policymakers and program designers can act on with the highest degree of confidence.
At OES we take this responsibility very seriously, and we have developed strict practices to ensure our results and findings are reliable. OES team members follow three guiding principles:
- Bring the highest level of rigor and research integrity: OES employs research methods that are rigorous, reliable, and reproducible including using randomized evaluations whenever possible, pre-committing to publicly posted analysis plans, submitting our analyses to internal replication, and making our processes and methods publicly available for feedback.
- Act transparently and openly: We are committed to ensuring that researchers, agency collaborators, policymakers, and the public at large are able to learn from our work. We keep a public record of all evaluations fielded and publicize all of our findings (including null findings and those that run counter to our own prior expectations and goals).
- Humbly collaborate: Our collaborators, who are civil servants with years of experience working on delivering programs across the government, are the experts on how their programs work and often have the best ideas for how to improve them. Sustainable change is possible when the collaborators within partner agencies drive the process, participate in the design and implementation of an evaluation, assist in the analysis and interpretation of results, and make decisions about scale and program implications.