Page | 41 means that every product and service used in schools must be supported by ESSAcompliant evidence. Educational publishers and Edtech providers have an obligation and vested interest in ensuring that their solutions are supported by ESSA-compliant evidence. Specifically, school decision-makers are looking for strong research evidence, consistent with the four tiers of ESSA evidence, ranging from "Strong Evidence" to "Demonstrates a Rationale” (USDOE, 2023). • Strong Evidence. A well-executed experimental study of the intervention, showing positive ePects on a student outcome. • Moderate Evidence. A well-executed quasi-experimental study of the intervention, showing positive ePects on a student outcome. • Promising Evidence. A well-executed correlational study of the intervention, with statistical controls for selection bias on the intervention, showing positive ePects on a student outcome. • Demonstrates a Rationale. A well-specified logic model, informed by research suggesting how the intervention is likely to improve relevant outcomes. A Level 1, 2, or 3 study of the intervention is planned or is underway elsewhere. While ESSA considers all four levels of evidence to be legitimate for supporting product ePectiveness, the USDOE (and most in the research community) have a clear preference for Level 1 or Level 2 Evidence (USDOE, 2023). Evidence based on a randomized experimental design (Level 1) or from a quasi-experimental design with statistical matching of groups (Level 2) have long been the preferred way to determine ePectiveness and for isolating product use as a cause of the observed outcomes. Level 4 evidence is a qualitative process of 1) identifying a logic or rationale linking product use with desired learning outcomes, and 2) linking the product claims associated with product use to sources of existing evidence including product components, content standards, and academic research. USDOE authorization to use Level 4 Evidence requires Level 1 or 2 study to be underway or planned. SEG Measurement believes that Level 4 evidence plays a critical role in identifying ePectiveness, despite its fourth-place ranking on the ESSA list. It not only provides the rationale for the product and links product use to product components, content standards and existing research, it serves as an organizational and generative framework for identifying
RkJQdWJsaXNoZXIy MjUyNzA0NQ==