home about the BEE review methods sign up for updates resources


Reading / Middle and High School

Full Report pdf (197 KB) || Educator's Summary pdf (267 KB)

Review Methods

An exhaustive search considered more than 300 published and unpublished articles. It included those that met the following criteria:

  • Schools or classrooms using each program had to be compared to randomly assigned or well-matched control groups.
  • Study duration had to be at least 12 weeks.
  • Outcome measures had to be assessments of the reading content being taught in all classes. Almost all are standardized test, or state assessments.
  • The review placed particular emphasis on studies in which schools, teachers, or students were assigned at random to experimental or control groups.

Program Ratings Basis

Programs were rated according to the overall strength of the evidence supporting their effects on reading achievement. “Effect size” (ES) is the proportion of a standard deviation by which a treatment group exceeds a control group. Large studies are those involving a total of at least 10 classes or 250 students. The categories are as follows:

strong evidenceStrong Evidence of Effectiveness: At least one large randomized or randomized quasi-experimental study, plus at least one additional study of any qualifying design, with a collective sample size of 500 students and an overall weighted mean effect size of at least +.20.

moderate evidenceModerate Evidence of Effectiveness: Two large studies of any qualifying design or multiple smaller studies with a collective sample size of 500 students, with a median effect size of at least +0.20.

limited evidenceLimited Evidence of Effectiveness: At least one qualifying study with statistically significant differences and effect size of +0.10 or more.

insufficient evidenceInsufficient Evidence of Effectiveness: Studies show no significant differences.

N No Qualifying Studies: No studies met inclusion standards.

     
   

 

   
 
 
 
about CDDRE
privacy disclosure contact us site map
Back to Homepage Back to Homepage Johns Hopkins University School of Education Center for Data-Driven Reform in Education