5 One thousand four hundred and fifty-six (1,456) first, second, and third grade students were included in the matched group analysis, which included the 278 MLs in the treatment group (from Study 1) and the remaining 1,178 district non-MLs enrolled in first, second, or third grade. One hundred and fifty-five (155) treatment-comparison pairs meeting the criteria were identified for the final analysis sample of 310 students—half treatment, and half control. Six students (2%) were lost to attrition; these students left the district before the posttest or otherwise did not have a posttest score available. The descriptive statistics for the total population from which students were sampled and the sampling protocol are described under each study question. Data Collection and Measurement The participating school district administered the MAP reading skills assessment published by NWEA at the beginning and end of the school year to all students. The beginning- and end-of-year student scores for the assessment served as the pretest and posttest scores for the study. The district provided SEG Measurement with a data file including all the grade one, two, and three students in the district. The file contained the beginning- and end-of-year MAP reading assessment results, along with a designation of whether the student received instruction incorporating the Connect solution, the student’s grade level, sex, ethnicity, an indication of whether the student was eligible for free or reduced-cost lunch as an indicator of economic status, and a unique student identifying number. MAP Assessment The MAP reading assessment is reported on a scale ranging from 100–350, covering grades K through 12. The MAP scores are vertically scaled; this means that a single scale is used across all grades to allow comparability of scores both within and across grades. NWEA reports that the reliability for the grade one, two, and three reading assessments ranges from .96 to .97. NWEA has conducted numerous studies supporting the validity of the MAP, indicating that “validity evidence for MAP Growth assessments involves multiple sources including test content, internal structure, and relations to other variables” (NWEA, 2023). The MAP reading assessment provides an overall score and several subtest scores. However, the subtests vary between grades one, two, and three. For that reason, this study used the overall language score as the outcome measure.
RkJQdWJsaXNoZXIy MjUyNzA0NQ==