Elk Grove - Evaluating the Effectiveness of Vista

15 Figure 5 Question 3 Study Design The ANCOVA model examined the reading skills posttest scores (dependent variable) achieved by students in the treatment group and comparison group (independent variable) and Sex, race, ethnicity, and economic status (independent variables), To answer Question 3, the reading skills growth of the treatment group was compared to the growth of the comparison group using a matched groups, pre-post quasiexperimental design. Using ANCOVA, we compared the reading skills growth of district ML learners receiving Connect instruction to the reading skills growth of a matched group of district students whose first language was English but who shared a similar starting reading skill level and background. We also explored the effects of Sex, race, ethnicity, and economic status to determine if Connect was any more or less effective for students of particular backgrounds. See Figure 5. The ANCOVA model examined the reading skills posttest scores (dependent variable) achieved by students in the treatment group and comparison group (independent variable) and sex, race, ethnicity, and economic status (independent variables), adjusting for the pretest scores (covariate). Tests were conducted at the .05 level of significance. The relatively large sample sizes overall (833) and individual study group sample sizes (410 treatment group; 423 comparison group) provided reasonable levels of statistical power to detect differences between the two study groups if present. The statistical power to detect small differences (n effect size of .15) is greater than .80. Power for subgroup comparisons is lower due to smaller sample sizes. We examined the level of reading skills growth achieved by ML learners in the treatment group in comparison to the reading skills growth of the comparison group. We also examined potential differences in reading skills growth with respect to sex, race, ethnicity, and economic status to determine if Connect was more effective for any subgroups. ML Connect Treatment Group i-Ready Reading Skills Pretest Non-ML Comparison Group i-Ready Reading Skills Pretest i-Ready Reading Skills Posttest i-Ready Reading Skills Posttest Instruction Without Connect Instruction Using Connect

RkJQdWJsaXNoZXIy MjUyNzA0NQ==