Saturday, February 19, 2011

Researcher Diane Ravitch's view on "pay for test scores"

Education researcher Diane Ravitch made waves last year when she reversed course after a generation-long critique of public education and published "The Death and Life of the Great American School System: How Testing and Choice Are Undermining Education." But Ravitch's change of heart, she writes in her book, was a gradual evolution that gained speed as data from the standards-and-accountability movement demonstrated that "No Child Left Behind" didn't deliver on its promises.

For some time, Ravitch and her colleague Deborah Meier have published their ongoing dialogues on education issues at a weblog, "Bridging Differences." In one such dialogue in 2009, Ravitch took on the subject of "performance pay," and she took a decidedly negative view of the proposal. In a column titled "What's Wrong with Merit Pay," Ravitch wrote:

There are several reasons why it is a bad idea to pay teachers extra for raising student test scores:

* First, it will create an incentive for teachers to teach only what is on the tests of reading and math. This will narrow the curriculum to only the subjects tested.
* Second, it will encourage not only teaching to the test, but gaming the system (by such mechanisms as excluding low-performing students) and outright cheating.
* Third, it ignores a wealth of studies that show that student test scores are subject to statistical errors, measurement errors, and random errors, and that the “noise” in these scores is multiplied when used to make high-stakes personnel decisions.
* Fourth, it ignores the fact that most teachers in a school are not eligible for “merit” bonuses, only those who teach reading and math and only those for whom scores can be obtained in a previous year.
* It ignores the fact that many factors play a role in student test scores, including student ability, student motivation, family support (or lack thereof), the weather, distractions on testing day, etc.
* It ignores the fact that tests must be given at the beginning and the end of the year, not mid-year as is now the practice in many states. Otherwise, which teacher gets "credit," and a bonus for score gains, the one who taught the student in the spring of the previous year or the one who taught her in the fall?

I believe that our readers are right when they predict that merit pay of the stupidest kind is coming. I predict that it will do nothing to improve our schools. A few weeks ago, the conservative Manhattan Institute released a study showing that merit pay had no impact on test scores in 200 schools in New York City that are trying it. In fact, scores went down in larger schools that offered bonuses. This little experiment in schoolwide bonuses is costing taxpayers $20 million a year.

Now it is possible that scores may go up in later years; this is only the first year, after all. But what is most interesting is the subdued release of this study. When the Manhattan Institute releases a study, it often holds a press conference to announce the results. This study, however, had no fanfare; its study was quietly posted on MI's Web site; no press conference, no press release. Somehow I suspect that the study would have been released with bells and whistles if the scores had flown upward.

Here is my prediction: Merit pay of the kind I have described will not make education better, even if scores go up next year or the year after. Instead, it will make education worse, not only because some of the "gains" will be based on cheating and gaming the system, but because they will be obtained by scanting attention to history, geography, civics, the arts, science, literature, foreign languages, and all the other studies that are needed to develop smarter individuals, better citizens, and people who are prepared for the knowledge-based economy of the 21st Century. Nor will it identify better teachers; instead, it will reward those who use their time for low-level test preparation.

Is it possible to have an education system that mis-educates students while raising their test scores? Yes, I think it is. We may soon prove it.

No comments:

Post a Comment