Evaluating the Effectiveness of Vista

14 Figure 6 Question 3 Study Design Sample The sample used to compare the level of reading skills growth achieved by the ML treatment group using VHL Connect and a comparable group of non-ML students followinngue instruction. The treatment group used for the first part of the study served as the treatment group for this second part of the study as well. The comparison group was drawn from the remaining grades one, two, and three students in the district—those who were not categorized as ML and who were receiving reading instruction following traditional practices (i.e., not using Connect). The reading skills posttest scores (dependent variable) achieved by students in the treatment group (independent variable) and the comparison group (independent variable), adjusting for the pretest scores (covariate) were examined. Matched Groups The treatment and comparison samples were matched based on initial reading skills ability, sex, ethnicity, and economic status using propensity score matching. This procedure matches students based on multiple characteristics, in this case the initial reading skills level of the student, along with their sex, ethnicity and economic levels. A single value representing the composite status of each student with respect to the matching variables was created. For each student included in the treatment group, the procedure sought a comparable student in the comparison group. The matches were required to be within 10% of each other to be considered acceptable. One hundred fifty-five (155) matched pairs were identified, for a total analysis sample size of 310 students. The final analysis included 89 students from grade one, 123 second-grade students and 98 students from grade three. A profile including the initial reading skills ability and background (sex, ethnicity, and economic level) of the treatment and comparison group samples is provided below. The average (mean) pretest reading scores for the treatment and control groups, along MAP reading Skills Posttest gg MAP reading Skills Pretest MAP reading Skills Posttest Comparison Group Group h MAP Reading Skills Pretest Instruction Using Connect District ML Treatment Group MAP Reading Skills Posttest No Connect Use MAP Reading Skills Pretest MAP Reading Skills Pretest District Non-ML Control Group

RkJQdWJsaXNoZXIy MjUyNzA0NQ==