John Deke

Helping organizations create, interpret, and use evidence to improve decision making.

I bring more than two decades of experience designing and analyzing experimental, quasi-experimental, and descriptive evaluations for federal agencies and foundations.

With support from federal agencies, I co-led the development of BASIE (Bayesian Interpretation of Estimates), an approach now used across federal agencies to provide transparent, probability-based interpretation of both impact estimates and descriptive differences between groups or across time. BASIE empowers more useful, comprehensive, and integrated interpretation of heterogeneous research findings.

John Deke

BASIE bridges the gap from evidence to decision making

Evidence  →  BASIE  →  Decision Making

About BASIE

Decision makers need more than just a description of evidence – they need to know what the evidence means for their decisions. That is what BASIE (Bayesian Interpretation of Estimates) was designed to do. Given all the evidence, BASIE produces probability statements — how likely is it that this program truly works? how likely is the true effect to exceed a meaningful threshold? — that map directly onto your decision criteria, not an arbitrary criteria chosen by a researcher (like whether a p-value is less than 0.05). BASIE is described in detail in the resources below and has been applied across evaluations sponsored by federal agencies and foundations.

BASIE Demo

BASIE Demo is a browser-based demonstration of the BASIE framework applied to a portfolio of estimates. Explore the pre-loaded example to see how Bayesian reinterpretation changes the picture. The demo produces posterior probabilities and credible intervals for each estimate in the portfolio.

The pre-loaded example illustrates a local foundation facing a common challenge: how the standard significance-based approach to picking grant winners is systematically misleading — and how BASIE provides a better path forward.

Open BASIE Demo →
Built with Chart.js · Runs entirely in your browser · No data is uploaded or stored

Better with BASIE

BASIE has been applied across a wide range of federal evaluation portfolios — spanning health, education, and economic self-sufficiency — demonstrating that its core approach to honest uncertainty is relevant wherever rigorous evidence is used to inform decisions.

Teen Pregnancy Prevention 2022

The Impact of the Making Proud Choices! Teen Pregnancy Prevention Curriculum

Office of Population Affairs, U.S. Department of Health and Human Services
A large randomized trial of a widely implemented teen pregnancy prevention curriculum, delivered across four U.S. cities to adolescents in school settings. BASIE was used to interpret the curriculum’s impact on sexual behavior outcomes.
View Report →
Education Leadership 2019

The Effects of a Principal Professional Development Program Focused on Instructional Leadership

National Center for Education Evaluation, Institute of Education Sciences
A randomized trial of an intensive principal professional development program designed to improve instructional leadership practices and student achievement. BASIE was applied to interpret program effects on principal behavior and student outcomes.
View Report →
Maternal & Child Health 2020

Impacts of a Home Visiting Program Enhanced with Content on Healthy Birth Spacing

Zief, S., Deke, J., Burkander, P., Langan, A., and Asheer, S. — Maternal and Child Health Journal, 24(S2), 105–118
Examined the impacts of a home visiting program with an added module on healthy birth spacing for low-income mothers. BASIE was used to provide probability-based interpretation of program effects on birth spacing and related outcomes.
Adolescent Sexual Health 2023

Evaluating the Efficacy of an Online, Family-Based Intervention to Promote Adolescent Sexual Health

Guilamo-Ramos, V., Benzekri, A., and Thimm-Kaiser, M. — Trials, 24:181
A registered randomized trial protocol for Families Talking Together Plus (FTT+), an online parent-based intervention targeting adolescent sexual risk behavior among Latino and Black youth in the South Bronx. The analysis plan explicitly commits to using BASIE alongside traditional hypothesis testing.
View Protocol →
Employment & Economic Self-Sufficiency 2024

Using Bayesian Methods to Conduct Subgroup Analysis in Evaluations of Employment Programs

Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services
Applied Bayesian hierarchical models to reinterpret subgroup impact estimates from four randomized evaluations of employment coaching programs for TANF populations. Demonstrates how BASIE-style methods can extract more nuanced and decision-relevant conclusions from subgroup analyses.
View Report →
Journal Article 2023

A Strong Case for Rethinking Causal Inference

Deke, John
Journal of Research on Educational Effectiveness
doi.org/10.1080/19345747.2023.2203683 →
Journal Article 2022

Bayesian Interpretation of Cluster-Robust Subgroup Impact Estimates: The Best of Both Worlds

Lipman, Erin R., Deke, John, and Finucane, Mariel M.
Journal of Policy Analysis and Management, 41(4), 1204–1224
doi.org/10.1002/pam.22413 →
Journal Article 2021

Asymdystopia: The Threat of Small Biases in Evaluations of Education Interventions That Need to Be Powered to Detect Small Impacts

Deke, John, Thomas Wei, and Tim Kautz
Journal of Research on Educational Effectiveness, 14(1), 207–240
IES Report →
Report 2022

The BASIE (BAyeSian Interpretation of Estimates) Framework for Interpreting Findings from Impact Evaluations: A Practical Guide for Education Researchers

Deke, J., Finucane, M., & Thal, D.
National Center for Education Evaluation, Institute of Education Sciences, U.S. Department of Education
Download PDF →
Report 2019

Moving Beyond Statistical Significance: The BASIE (BAyeSian Interpretation of Estimates) Framework for Interpreting Findings from Impact Evaluations

Deke, J., and Finucane, M.
OPRE Report #2019-35. Office of Planning, Research, and Evaluation, ACF, U.S. DHHS
View Report →
Report 2023

Using Bayesian Meta-Analysis to Explore the Components of Early Literacy Interventions

Walsh, E., Deke, J., Robles, S., Streke, A., and Thal, D.
National Center for Education Evaluation, Institute of Education Sciences (WWC 2023008)
whatworks.ed.gov →
Journal Article 2017

The WWC Attrition Standard: Sensitivity to Assumptions and Opportunities for Refining and Adapting to New Contexts

Deke, John, and Hanley Chiang
Evaluation Review, 41(2), 130–154
doi.org/10.1177/0193841X16670047 →
Journal Article 2016

Design and Analysis Considerations for Cluster Randomized Controlled Trials That Have a Small Number of Clusters

Deke, John
Evaluation Review, 40(5), 444–486
doi.org/10.1177/0193841X16671680 →
Report 2015

Preview of Regression Discontinuity Designs Standards

Deke, J., Cook, T., Dragoset, L., Reardon, S., Titiunik, R., Todd, P., Van der Klaauw, W., and Waddell, G.
Institute of Education Sciences, U.S. Department of Education
Download PDF →
Journal Article 2003

Study of the Impact of Public School Spending on Postsecondary Educational Attainment Using Statewide School District Refinancing in Kansas

Deke, John
Economics of Education Review, 22(3), 275–284
doi.org/10.1016/S0272-7757(02)00025-0 →

Interested in working together?

Whether you need a one-time review, ongoing technical assistance, or a full evaluation framework built around Bayesian reasoning, I can design something that fits your team, your data, and your decisions.

Get in Touch
Signature Service

BASIE Implementation and Tools

I co-developed the BASIE (Bayesian Interpretation of Estimates) framework and can help organizations apply it to their evaluation portfolios. Services include:

  • Reinterpret existing estimates using BASIE
  • Develop empirically grounded prior distributions from existing evidence bases
  • Build tailored BASIE tools and dashboards (for example, BASIE Demo)
  • Train researchers, program staff, and funders to use BASIE
Evaluation Methodology

Evaluation Technical Assistance

I provide methodological guidance across a range of evaluation topics, including:

  • Randomized controlled trials design and analysis
  • Regression discontinuity design implementation and standards review
  • Statistical power analysis for multiple design types
  • Difference-in-differences and other longitudinal methods
  • Subgroup analysis and heterogeneity of treatment effects
  • Evidence standards meeting and exceeding
Evidence Synthesis

Bayesian Meta-Analysis and Evidence Synthesis

I bring deep expertise in synthesizing evidence across studies, including:

  • Making sense of evidence in systematic reviews for decision makers
  • Standards development for systematic reviews
  • Bayesian meta-analysis to characterize variation in effects across sites, populations, and contexts
Review and Oversight

Quality Assurance and Expert Review

I provide constructive, collegial input to improve quality, including:

  • Review design plans, analysis plans, and final reports
  • Serve on technical working groups and expert panels

Education

2000
Ph.D., Economics
University of Illinois at Urbana-Champaign
1995
B.S., Economics and Mathematics, with distinction
University of Kansas

Work Experience

2025–
Independent Consultant
Evaluation methodology, Bayesian inference, and evidence interpretation
2000–
2025
Mathematica
2021–2025
Senior Fellow
2005–2021
Senior Researcher
2000–2005
Researcher