Evaluating the Effectiveness of Vista

19 We also examined how the reading skills growth seen for ML students receiving instruction using Connect stacked up against the level of growth seen in a broader national sample of ML students. We found that the district students receiving instruction using Connect improved their reading skills substantially more than was observed for the national sample of users implementing other ML instructional materials and programs. The district treatment group receiving instruction using Connect achieved growth consistent with an effect size of .5 to 1 when compared to the national sample of ML students. Finally, we compared the performance of the Connect treatment group to the performance of a matched sample of non-ML students of similar background, but whose first language was English. We looked to see if the ML students using Connect were able to achieve levels of growth similar to non-ML students in the district. We found that the ML students receiving instruction using Connect were able to achieve similar levels of reading skills growth as achieved by their non-ML counterparts of similar background. After adjusting for any differences in the beginning-of-year reading skills level, the ML students receiving intervention that included instruction using Connect (mean=179.85) showed no significant difference in growth in reading skills from students receiving intervention without Connect (mean=180.34). The ML students taught using Connect achieved about the same level of growth in reading skills as non-ML students receiving traditional reading instruction in the district. Conclusions The multiple sources of evidence obtained in this study strongly support the conclusion that Connect is effective in improving grade one, two, and three ML student reading skills. Positive evidence supporting the effectiveness of Connect was found for all three research questions examined. First, we found that instruction including Connect resulted in about one-and-a-half standard deviations of reading skills growth among ML students over the course of the school year. Second, we found that MLs in the district taught using Connect achieved reading skills growth exceeding the growth seen within a national sample of MLs receiving instruction using a variety of instructional practices by about four to seven points. This is about one-half to one standard deviation greater reading skills growth than found for ML students in the national sample. Third, we found that MLs in the district receiving instruction incorporating Connect grew at about the same rate as a matched group of their non-ML peers in the district; the comparability in growth was seen despite the challenges one might expect for MLs whose primary language is not English. In summary, the evidence supports the conclusion that Connect is effective in improving grade one, two, and three ML student reading skills.

RkJQdWJsaXNoZXIy MjUyNzA0NQ==