NCLB Reading First Final Report, Final Version, Finally Released
November 19th, 2008And the final verdict is: Study of Reading Program Finds a Lack of Progress, at least not in reading comprehension of grades 1 through 3. There is a slight gain in decoding among 1st graders, and the effect size is small, 0.17. Washington Post quotes:
"It is a program that needs to be improved," said Grover J. "Russ" Whitehurst, director of the Institute of Education Sciences, the department’s research arm. "I don’t think anyone should be celebrating that the federal government has spent $6 billion on a reading program that has had no impact on reading comprehension."
And
"Reading First helps our most vulnerable students learn the fundamental elements of reading while helping teachers improve instruction," Spellings said. "Instead of reversing the progress we have made by cutting funding, we must enhance Reading First and help more students benefit from research-based instruction."
The report itself is here, which I am not sure how it differs from previous versions. Key findings are as follows:
- • Reading First produced a positive and statistically significant impact on amount of instructional time spent on the five essential components of reading instruction promoted by the program (phonemic awareness, phonics, vocabulary, fluency, and comprehension) in grades one and two. The impact was equivalent to an effect size of 0.33 standard deviations in grade one and 0.46 standard deviations in grade two.
- • Reading First produced positive and statistically significant impacts on multiple practices that are promoted by the program, including professional development in scientifically based reading instruction (SBRI), support from full-time reading coaches, amount of reading instruction, and supports available for struggling readers.
- • Reading First did not produce a statistically significant impact on student reading comprehension test scores in grades one, two or three.
In light of #3, though, I think #1 and #2 should be seen as costs rather than gain. The increased instruction time and resources on reading to come from somewhere, and it is clear they are not productive.
Additional findings:
- Reading First produced a positive and statistically significant impact on decoding among first grade students tested in one school year (spring 2007). The impact was equivalent to an effect size of 0.17 standard deviations.
- There was no consistent pattern of effects over time in the impact estimates for reading instruction in grade one or in reading comprehension in any grade. There appeared to be a systematic decline in reading instruction impacts in grade two over time.
- There was no relationship between reading comprehension and the number of years a student was exposed to RF.
- There is no statistically significant site-to-site variation in impacts, either by grade or overall, for classroom reading instruction or student reading comprehension.
- There is a positive association between time spent on the five essential components of reading instruction promoted by the program and reading comprehension measured by the SAT 10, but these findings are sensitive to both model specification and the sample used to estimate the relationship.
] 


. In fact, you can’t find me even if you turn the "face-only" thing off. My invisibility cloak fooled Google. Horay!] 

. NPR provides an interesting API for accessing their stories; this wedget is one that uses the field:date to plot a time line:





November 20th, 2008 at 10:02 am e
I videotaped some reading classes around Michigan last Spring, and was shocked to find that “Reading First” means they spend 90 minutes straight first thing in the morning doing reading (even first graders who can’t read). So I’m not surprised to find that they’ve replicated the results about massed vs. distributed practice.