Showing posts with label testing. Show all posts
Showing posts with label testing. Show all posts

Saturday, May 25, 2013

UCLA IDEA: Standardized Tests Don't Measure Education Quality

UCLA IDEA is often quite good on issues, even though they represent an only slightly left-of-center viewpoint. UCLA as a whole sometimes does excellent work, like their study on how so-called school choice and the charter school industry have brought back Jim Crow with a vengeance. They (namely IDEA) also sometimes work with right-wing groups funded by the Broad Foundation, like ICS. Now that I've returned to UCLA, I know it's my responsibility to praise them when they get it right, and call them out when they get it wrong.

This essay, for the most part, is excellent. That is until it calls corporate core a "promising education reform." The corporate garbage that is CCSS must be resisted at every turn. That said, this piece bears reprinting precisely because it shows that even progressive liberals agree with the principled left that standardized tests are considered harmfull.


Standardized Tests Don't Measure Education Quality

By UCLA IDEA

Over 14 years ago, testing expert W. James Popham summarized what was, even then, “old news” about American policymakers’ love of standardized testing:

Educators are experiencing almost relentless pressure to show their effectiveness. Unfortunately, the chief indicator by which most communities judge a school staff's success is student performance on standardized achievement tests.

It’s a bitter irony that the same testing policies that have distracted the nation from fixing what’s wrong with our education systems are still being promoted. The medicine prescribed for ailing schools has helped make 21st century schools sicker, so we double the dose. In his piece for the 140,000-member ASCD, Popham went on to say,

Employing standardized achievement tests to ascertain educational quality is like measuring temperature with a tablespoon. Tablespoons have a different measurement mission than indicating how hot or cold something is. Standardized achievement tests have a different measurement mission than indicating how good or bad a school is.

We have years of evidence about what educators and policymakers can and cannot honestly do with test results; but this evidence, typically, is not decisive in determining school testing policy. Those who advocate expanding the use and power of standardized tests continue to capture the attention of policy leaders.

In the face of severe, indisputable, and embarrassing criticism, some high-profile testing advocates have backtracked on their unqualified support for tests; however, they appear willing to sustain what many experts and education professionals say are inevitable inequalities, wrong judgments, and other harms.

For example, promising education reforms such as the Common Core State Standards are likely to carry the burden of test misuse. The purpose of the new standards, which have been adopted by 45 states, the District of Columbia, and four territories, is to “provide a consistent, clear understanding of what students are expected to learn, so teachers and parents know what they need to do to help.” AFT President Randi Weingarten does not want testing to overwhelm Common Core before teachers have time and professional development to change curricula and adjust instruction (Education Week). Weingarten said, “These standards, which hold such potential to create deeper learning, are instead creating a serious backlash—as officials seek to make them count before they make them work.”

Even as some test advocates concede the serious shortcomings of the prevailing testing regime, they want schools to press on with the tests—just iron out the rough spots in order to preserve all the good that testing does or will do as soon as they get it right. Secretary of Education Arne Duncan appears to be in this category. Last week, Duncan’s audience at the annual American Educational Research Association conference appreciated his strong criticism of how some schools were misusing standardized tests. For example, he alluded to a Florida case where some k-2 teachers have sued because they were evaluated based on grades of students they never taught and are already years ahead. However, Duncan lost the favor of many attendees when he said, “The solution to mediocre tests is not to abandon assessment” (EdSource Today).

That sleight of hand mischaracterized testing critics who strongly favor better, proven, and responsible assessments such as formative assessments that help students and teachers identify individual strengths and needs as well as inequities within the system (EdSource TodayEducation Week). Rather, Duncan’s critics take issue with policies that require schools to use tests irresponsibly. Further, many of these tests and their uses are not just mediocre, they are actively harmful. 

Duncan’s position echoed that which has followed recent testing scandals. For example, cheating at all levels of Atlanta Public Schools and an emerging Washington, D.C. scandal are widely interpreted as the acts of a few bad apples or weak oversight and regulation. However, these incidents expose a much deeper core problem. Attaching test scores to high-stakes decisions, including judgments of individual teachers’ competence, affects careers for teachers and learning opportunities for students. The temptation is powerful to falsify or cheat or teach to the test (EdSource Today). High-level administrators and high-profile politicians such as Duncan rarely dwell on the structural flaws that are inherent in fiercely competitive, score-driven American schooling—flaws that work in concert with unfairly distributed resources.


Share/Bookmark

Sunday, July 24, 2011

How standardized testing is being expanded

Washington Post "Answer Sheet" Blog — June 27, 2011 By Lisa Guisbond, FairTest

Parents, teachers, and students: Raise your hands if you think what our schools need is more new tests and a greater emphasis on testing. If not, listen up, because this is exactly what our students and teachers face because of the reactions of Massachusetts, Maryland, Virgina, New York, North Carolina and other state policy makers to the federal Race to the Top (RTTT) program. These states have all marched to the RTTT beat, quickly passing laws that, among other things, insist that teacher evaluations must be linked to student outcomes.

Now we are seeing all the devilish details emerge, as state departments of education devise the regulations for how school districts must march to the RTTT beat.

In Maryland, for example, the Council for Educator Effectiveness voted to tie 50 percent of each assessment to student growth on standardized exams, despite vehement objections from teachers on the panel. Similar battles have erupted in New York and Charlotte, N.C., over proposed teacher evaluation systems that rely heavily on student test scores and use flawed methods to judge teacher quality.

Massachusetts’ proposed teacher evaluation system is scheduled for a vote on Tuesday by the state Board of Elementary and Secondary Education. But a group of educators and analysts assembled by the National Center for Fair & Open Testing (FairTest) examined the proposal and concluded it is deeply flawed and should not be approved.

The recently released FairTest report, "Flawed Massachusetts Teacher Evaluation Proposal Risks Further Damage to Teaching and Learning" criticizes the state" proposal for five major flaws:
  • It will require districts to use state test results (Massachusetts’ test is called the Massachussetts Comprehensive Assessment System, or MCAS) to judge educators.
  • It will require districts to evaluate every teacher in every grade and subject with two "assessments" each academic year, forcing districts to make or purchase dozens of new tests at a time of drastic cutbacks and layoffs.
  • It relies on a pseudo-scientific "growth" or "value-added" measures that are unable to distinguish good teachers from bad, according to researchers affiliated with the National Research Council of the National Academy of Sciences.
  • It will increase pressure to teach to low-level tests, drive good teachers away from working where they are most needed, and damage the learning environment by forcing teachers to "compete" for high-scoring students.

A working group of educators and analysts from the elementary, high school and university levels collaborated on the report. We wanted to be sure that parents and others understand the potential negative impact of these proposals. If adopted, our over-tested students would have to take even more narrow and low-quality standardized exams, when there are already too many tests taking time from learning.

Mitchell Chester, the Massachusetts education commissioner, says the new system will be "objective" and "scientific" — partly because they always define tests as "objective," but also because they want to claim that "value added" or "growth" models are "scientific." However, research shows these models are no better than a coin toss at sorting good teachers from bad.

This system is opposed to the approaches taken by the nations whose school systems are praised for their equity and excellence. Among the most striking features of successful nations such as Finland and Singapore are their professional recruitment, development, support and support, as well as the pay and respect given to teachers. They don’t use tests to judge schools or teachers. Sadly, this sets them apart from our own country.

A focus on tests will undermine much of the most important work that teachers do. Good teachers do not simply convey information. They identify the diverse needs of their students, engage student interests and build students’ confidence. They also help develop team interaction and cooperation, while challenging and assisting students to overcome barriers. Unfortunately, the Department" proposal is likely to rupture the essential relationships between teachers and students that make this work possible.

We need not reinvent the wheel. Comprehensive, high-quality teacher evaluation systems already exist and are used in many schools and districts. A recent story in The New York Times praises Montgomery County, Maryland" system, which does not use student scores at all. The problem is not the lack of good models, but the lack of resources, time, training, and focus needed to implement them.

Teacher evaluation should be used to provide assistance where needed, and to recognize talented teachers who can lead and mentor their peers. Where necessary, a system should play a role in removing teachers who are clearly not effective. Proposals like the one in Massachusetts fail these tests.

This was written by Lisa Guisbond, a policy analyst for the nonprofit National Center for Fair & Open Testing, known as FairTest. The report, Flawed Massachusetts Teacher Evaluation Proposal Risks Further Damage to Teaching and Learning, is available here.

Share/Bookmark