Showing posts with label testing. Show all posts
Showing posts with label testing. Show all posts

Saturday, February 5, 2011

Test Prep Twist: No Choices Over Multiple Choices by: David Ginsburg

In Teaching TO the Test vs. Teaching the Test, I wrote that there's nothing wrong with teaching to the test in terms of content as long as it's aligned to appropriate, rigorous curriculum. Yet I also wrote that it's a disservice to students to devote class after class to assignments and assessments that are knock-offs of standardized tests both in content and format. In other words, non-stop test prep.
Unfortunately, with all the pressure to raise scores, perpetual test prep prevails at many schools today. And so, if being a disservice to students isn't enough reason to rethink this, here's another reason: typical test prep tactics often fail to raise scores.
Ironically, for example, a key to preparing students for standardized multiple choice tests is to not give them multiple choice questions in class. I first heard this at a conference about 15 years ago, and my experience bears it out. (I can't recall the speaker's name or the research she cited, so please let me know if you've come across it.)
A big reason for this from what I've seen is that students develop a stronger test-taking work ethic when they're accustomed to Standardized Test Multiple Choice.jpgdigging for answers without the distraction of the right answer staring them in the face. And because wrong answers are also staring them in the face on multiple choice tests, the more conditioned kids are to working through questions thoroughly in class, the less vulnerable they are to incorrect "distractor" choices on standardized tests.
Another factor is confidence. And just as sports coaches design practices to be more grueling than games, so too should class work push students beyond where they'll need to go on high-stakes tests. The result, whether it's game time or test time, is a more confident, better prepared player or student. I'm reminded of countless kids who returned to my class after standardized tests and said, "Coach G, that test was much easier than what you give us."
I'm not suggesting you avoid multiple choice questions to the point where students stumble on standardized tests just because they're unfamiliar with the format. Yet even when I assigned multiple choice practice in college entrance test prep classes, I advised students to work through each question with the choices covered up, and then compare their answer with the choices. And again, they fell prey to distractor choices less often as a result.
This multiple choice moratorium makes even more sense when standardized tests include open-ended items in addition to multiple choice items, as is the case in my home state of Pennsylvania. The point being that whereas a steady diet of open-ended questions in class also prepares students to handle multiple choice questions on tests, it doesn't work the other way around.
So if you want students to pick the right choices on standardized tests, make the right choice when developing your tests (and assignments): questions with no choices rather than multiple ones.

http://blogs.edweek.org/teachers/coach_gs_teaching_tips/2011/02/test_prep_twist_no_choices_over_multiple_choices.html?utm_source=twitterfeed&utm_medium=twitter

Sunday, November 14, 2010

Why I Will Not Teach to the Test by: Kelly Gallagher


In the midst of controversy surrounding “value added” teacher assessment, which flared recently following the Los Angeles Times’ public teacher rankings, the real issue is often overlooked: The state tests being used to evaluate student progress—and, in turn, the effectiveness of teachers—virtually ensure mediocrity.

Consider the following California 10th-grade-history standard: “Relate the moral and ethical principles in ancient Greek and Roman philosophy, in Judaism, and in Christianity to the development of Western political thought.” How long do you think it would take to teach this standard before a classroom of 16-year-olds reached a thorough understanding? Weeks? Months? Consider another social studies standard: “Compare and contrast the Glorious Revolution of England, the American Revolution, and the French Revolution and their enduring effects worldwide on the political expectations for self-government and individual liberty.” How much time for this unit? A semester? A year? I am sure that history teachers would love to have the opportunity to delve deeply into these standards, but the state test does not permit deeper instruction. Why? Because these two standards come from a much longer list of standards that will be measured on the exam. Teachers in California know the results of this exam may now be used as a factor in their evaluations, so they are forced to accelerate their instruction into “sprint and cover” mode.

My highest priority is to design lessons that enable my kids to think critically and to give them the skills they will need to live productive lives. I want my students to grow up to be problem-solvers, not test-takers. I want them to be innovators, not automatons.

What harm comes from a sprint-and-cover approach? A studypublished in the journal Science Education in December 2008 looked at two sets of high school science students. One set “sprinted”; the other set had teachers who slowed down, went deeper, and did not cover as much material. The results? The first group of students actually scored higher on the state tests at the end of the year. This is not surprising, as their teachers covered more of the test material. I am sure it made their parents, teachers, and administrators happy. What is more interesting, however, is that the students who learned through the slower, in-depth approach actually earned higher grades once they made it to college. This, too, is not surprising. These students were taught to think critically.

In considering this study, it is important to note that the standards are not the problem. We all want standards that set high expectations for our children’s learning. The problem is that there are too many standards. If teachers were to teach all the standards at the level they need to be taught so that students would acquire meaningful understanding, one study found, we would have to change the educational system from K-12 to K-22. Because there are too many standards, and because most of these standards are assessed on the state tests, teachers are pressured to cover everything. When everything is covered, shallow teaching and thinking occur.

Any teacher worth his or her salt knows that if you really want to measure the level of student thinking, you have to have students write. Answers to multiple-choice questions can often be faked; answers to essay questions cannot. This is why it is heartening to note that on the California High School Exit Exam, students must produce an on-demand essay. But allow me to let you in on California’s dirty little secret: A student can receive a zero on the essay portion of the exam and still pass the exam. That’s right. A student can write absolute gibberish, or write nothing at all, and still pass the exam. How is this possible? It’s because the weight placed on the multiple-choice section of the exam is four times heavier than the weight placed on the essay section. The essay section counts for so little of the final score that it is possible to blow it off and still receive a diploma. Sadly, the state’s high school exit exam values shallow thinking (multiple-choice) much more than it values critical thinking (writing). When multiple-choice becomes the valued assessment, essay-writing gets placed on the back burner, and we end up with a school system that raises multiple-choice thinkers in an essay world.

I also find it odd that while many states have raised their test scores over the past few years, we as a country continue to fall in international comparisons of academic achievement. How can this be? If we are getting “better,” why are we declining internationally?

In an attempt to answer these questions, Linda Darling-Hammond of Stanford Universitystudied high-achieving countries from around the world. Her findings? School systems in high-achieving countries value higher-order thinking. They parse their standards to make them lean. They use very little, if any, multiple-choice assessments to monitor student progress. They require students to research, to inquire, to write—to think critically. They give students time to reflect upon their learning. They emphasize the skills graduates will need to be college- or career-ready in a globally competitive marketplace. They surround their students with interesting books. Because their assessments demand critical thinking, their students are moving ahead. Because our assessments demand shallow thinking, our students are falling behind.

As teachers, we want to know if we are doing a good job. We want to know our strengths and our weaknesses. We welcome accountability. Frankly, I am embarrassed by how hard teachers’ unions have fought to protect weak teachers. It is shameful. But scoring all teachers based on a system that pushes educators to produce memorizers instead of thinkers is not the answer. Worse, it actually rewards mediocre teaching.

The argument on whether “value added” should be used to assess teacher effectiveness misses the larger point. Why do we want to assess a system that is broken? Fix the system first, and then design tests that will accurately assess deeper learning and better teaching. Let’s begin to think like those educators in the highest-achieving countries. We could start by ending this false pursuit of unobtainable standards and design tests that truly value writing and critical thinking. Let’s aim for creating big thinkers, not small thinkers. And let’s recognize that critical thinking in many classrooms will not occur until the state assessment demands critical thinking in all our classrooms.

As I plunge into the school year, my highest priority is to design lessons that enable my kids to think critically and to give them the skills they will need to live productive lives. I want my students to grow up to be problem-solvers, not test-takers. I want them to be innovators, not automatons.

So, go ahead. Tell me my value-added score if you’d like. Just remember, I am not teaching to that test.


http://www.edweek.org/ew/articles/2010/11/17/12gallagher_ep.h30.html?utm_source=fb&utm_medium=rss&utm_campaign=mrss