Originally published Friday, January 6, 2012 at 12:07 PM

Gates study: Once-a-year teacher evaluations not enough

Annual evaluations aren't enough to help teachers improve, and school districts using infrequent classroom observations to determine their best and worst teachers could be making some big mistakes, according to the Bill & Melinda Gates Foundation.

The Associated Press

No comments have been posted to this article.


Once-a-year evaluations aren't enough to help teachers improve, says a report by the Bill & Melinda Gates Foundation.

And school districts using infrequent classroom observations to decide who are their best — and worst — teachers could be making some big mistakes, according to the second part of a multiyear study from the foundation.

Preliminary results were posted online Friday.

Good teacher evaluations require multiple nuanced observations by trained evaluators. Those results should be combined with other measures, such as student test scores and classroom surveys, to gather enough information to both evaluate teachers and help them improve, the researchers found after nationwide experiments involving thousands of teachers.

The most common teacher-evaluation method used by school districts today — a single classroom observation once every few years — has only a 33 percent chance of resulting in an accurate assessment of a teacher, the researchers found.

"This confirms what many teachers have been saying for years: That when high-stakes decisions are being made, school districts should allow for more than one observation," said Tom Kane, deputy director of the Seattle-based foundation's education program and leader of the research project.

Teachers across the nation are getting too little feedback and are being left alone to figure out what they need to do to improve, says Vicki Phillips, director of the foundation's education program.

For the past two years, the foundation has been working to build a system of teacher evaluation and feedback to help teachers improve their craft and assist school administrators in their personnel decisions.

This report comes amid efforts across the country to change the way teachers are evaluated. Most of the new systems are a direct result of a call by the federal government for an education overhaul, and many are finding implementation of the evaluation systems difficult.

The core of the Gates Foundation study has been a collection of digital videos of more than 13,000 lessons in classrooms of teachers who volunteered to be studied.

The classrooms are being studied in Charlotte-Mecklenburg Schools; the Dallas Independent School District; Denver Public Schools; Hillsborough County Public Schools in Tampa and St. Petersburg, Fla.; Memphis City Schools; The New York City Department of Education; and Pittsburgh Public Schools.

The report's main conclusions:

• High-quality classroom observations require clear, specific standards, well-trained and certified evaluators and multiple observations per teacher.

• Classroom evaluations should be combined with student feedback and data on improvement in student test scores. Combining the three kinds of evaluations offsets the weaknesses of each approach.

• The different evaluation methods still need to be refined, but they're better than what most districts are using now.

Memphis Public Schools used to evaluate its teachers once every five years. With financial help from the Gates Foundation, the district has switched to a system of four to six classroom visits by both principal and peer evaluators, followed by feedback meetings focused on improvement.

The new system was implemented after teachers and administrators worked together to set new districtwide standards, and teachers and principals were trained in the new system.

"This process is neither quick nor easy. And we're still working out the kinks," said Tequilla Banks, coordinator of research, evaluation and assessment for the Memphis district. She said, however, that teachers and administrators feel the effort is worth it.

The president of the teachers union in Hillsborough County Schools, which is using both teacher and principal evaluators, said teachers have embraced the new system.

"We're new in this process, but already many teachers tell us they value the conversations they're having with their peers," said Jean Clements.

Hillsborough and Memphis are also experimenting with student surveys.

Those surveys, also being piloted by the foundation in school districts around the nation, are not popularity contests, Kane said. They focus on class experiences and ask students to talk about things like whether they are being challenged and engaged.

College professors have been evaluated by their students for years. Kane, who is also a Harvard professor, said he thinks schoolteachers could learn to appreciate that feedback as well.

"One thing I've learned is once you show people the questions, much of the hesitance fades away," he said.

Districts that can't afford to overhaul their evaluation systems can take some first steps that the foundation and the school districts say would make a difference. Those ideas include:

• Better training and certification for observers, including videotaping lessons and having more than one person evaluate a teacher. • Student surveys to supplement other methods of evaluation or as a way to help teachers and their mentors work together.

• Meetings between teachers and administrators to start a collaboration on improving the evaluations.

Randi Weingarten, president of the American Federation of Teachers, expressed concern that too much emphasis is being placed on evaluating teachers and not enough on improving their performance.

"Until we make a commitment to develop evaluation systems that are first and foremost about continuous improvement and professional growth, we will continue to struggle in our efforts to provide every child with a high-quality education," she said in a written statement.

News where, when and how you want it

Email Icon