18 Summary and Conclusions SEG Measurement conducted a year-long study of the effectiveness of ML instruction incorporating Connect with grade one, two, and three students in a single district during the 2022–2023 school year. Participating students were assessed using the MAP reading skills assessment published by NWEA in fall 2022 and again in spring 2023. The reading achievement of MLs receiving instruction incorporating Connect was examined to assess the reading skills growth achieved from the beginning to the end of the school year. We then compared the level of reading skills growth for this group of MLs using Connect to the level of growth achieved by a national sample of MLs using a range of instructional materials and approaches. We then compared the reading skills growth of MLs and non-MLs in the district to evaluate whether MLs achieved reading skills growth comparable to their non-ML peers. Findings We found that instruction incorporating Connect effectively increased the reading skills of the treatment group of 278 grade one, two, and three MLs. The group of 278 MLs receiving instruction incorporating the Connect intervention achieved statistically significant reading skills improvement. This was determined by comparing the beginning-of-year reading skills assessment scores to the end-of-year assessment scores (t= 28.3; df=277; p<.001); this comparison revealed a difference of about one-and-ahalf standard deviations of growth (ES=1.6). This effect size is substantial, particularly for an educational intervention. Lipsey et al. (2012) indicate that effect sizes above .25 can be considered large for an educational intervention. Kraft (2019) notes that traditional guidelines, such as those offered by Cohen and even those suggested by Lipsey et al, may be too rigid for use in evaluating educational interventions. …instruction incorporating Connect effectively increased student reading skills… …district students receiving instruction using Connect improved their reading skills substantially more than observed for the national sample of users implementing other ML instructional materials and programs.
RkJQdWJsaXNoZXIy MjUyNzA0NQ==