Page | 50 federal funds to purchase an educational product or service. At the same time, school buyers have become more demanding, expecting to see sound evidence of product eCectiveness as a matter of course. Fulfilling the promise of evidence-based education means that every product and service used in schools must be supported by ESSAcompliant evidence. Educational publishers and Edtech providers have an obligation and vested interest in ensuring that their solutions are supported by ESSA-compliant evidence. Specifically, school decision-makers are looking for strong research evidence, consistent with the four tiers of ESSA evidence, ranging from "Strong Evidence" to "Demonstrates a Rationale” (USDOE, 2023). • Strong Evidence. A well-executed experimental study of the intervention, showing positive eCects on a student outcome. • Moderate Evidence. A well-executed quasi-experimental study of the intervention, showing positive eCects on a student outcome. • Promising Evidence. A well-executed correlational study of the intervention, with statistical controls for selection bias on the intervention, showing positive eCects on a student outcome. • Demonstrates a Rationale. A well-specified logic model, informed by research suggesting how the intervention is likely to improve relevant outcomes. A Level 1, 2, or 3 study of the intervention is planned or is underway elsewhere. While ESSA considers all four levels of evidence to be legitimate for supporting product eCectiveness, the USDOE (and most in the research community) have a clear preference for Level 1 or Level 2 Evidence (USDOE, 2023). Evidence based on a randomized experimental design (Level 1) or from a quasi-experimental design with statistical matching of groups (Level 2) have long been the preferred way to determine eCectiveness and for isolating product use as a cause of the observed outcomes. Level 4 evidence is a qualitative process of 1) identifying a logic or rationale linking product use with desired learning outcomes, and 2) linking the product claims associated with product use to sources of existing evidence including product components, content standards, and academic research. USDOE authorization to use Level 4 Evidence requires Level 1 or 2 study to be underway or planned.
RkJQdWJsaXNoZXIy MjUyNzA0NQ==