Monday, March 17, 2014

Five myths about formative assessment

As I am involved in the planning and execution of a formative assessment system for my institution’s adult course, this is a topic that has been on my radar lately. In fact, my previous post was exactly about a formative oral assessment activity. I was also recently invited to conduct a discussion with a group of Language Arts high school teachers implementing an innovative portfolio system for the assessment of their students’ writing.
This recent and extensive contact with teachers in my institution and our partner high school, both piloting formative assessment systems, has raised my awareness of some common myths about formative assessment:

Myth # 1: Formative assessment cannot result in a numerical grade

It is common for educators to associate summative assessment with numerical grades and formative assessment with qualitative performance descriptors. Actually, it is not the grade or the lack of grade that makes the assessment summative or formative. You can have summative assessment with qualitative descriptors and formative assessment with numerical grades.
What makes an assessment tool summative, be it a test or a performance assessment, is the fact that it is administered at the end of a learning cycle. Examples of summative assessment are final exams and proficiency exams. An oral test with qualitative can-do statements, administered at the end of a course, is summative. Conversely, formative assessment is used to “evaluate students in the process of ‘forming’ their competence and skills with the goal of helping them to continue that growth process” (Brown, 2004, p. 6). A graded test aimed at gauging student’s retention of the course content, followed by re-teaching of the areas students had difficulty with and re-testing, is an example of formative assessment, even if it generated a numerical grade.

Myth # 2: Formative assessment can only be used as an informal assessment tool in more traditional settings

This second myth is the result of the first one. It is believed that because formative assessment cannot result in a numerical grade, systems that rely on numerical grades cannot use formative assessment or can only use it informally.
Some time ago I attended a talk in which the presenter showed various examples of how her institution used formative assessment in its courses. At one point during the presentation I asked her what percentage of her final grading system comprised formative assessment. None! Despite the beautiful work done with formative assessment, such as projects, at the end of the day, what really counted were the tests! Thus, the formative assessment ended up being only informal assessment, the type that “elicits performance without recording results and making fixed judgments about students’ competence” (Brown, ibid, p. 5). With well-developed scoring rubrics, though, encompassing not only the product but also the learning process, these formative assessment tools can generate a grade that can compose the general grading system.

Myth # 3: Multiple-choice and selected response tests are always summative, while performance assessments such as portfolios and projects are always formative

How an assessment tool is used  determines whether it is summative or formative, and not whether it is a test or another type of assessment. . Even a portfolio can be summative if students collect work during a period of time and only receive feedback on it at the end. The same applies to project-based learning. If grades on projects are based on the final product only, with no consideration of the process and no feedback during the execution of the project, then the assessment is only summative. Thus, the use of rubrics per se doesn’t qualify an assessment as formative. It is how the rubrics are used and what they consist of that makes the difference.
On the other hand, as mentioned above, a very traditional multiple-choice test can be formative if it is used to gauge student learning and there is opportunity to take the test again. I remember when I moved to the United States to get my Master’s Degree and had to take a driving test. I failed the theoretical test and was asked to go home, study the items I had gotten wrong, and go back the next day to re-take the test. To my surprise, it was the exact same test. What they wanted was for me to master the content, not to punish or trick me!

Myth # 4: Formative assessment isn’t rigorous enough, so it cannot compose a major part of students’ final grade

We tend to confuse rigor with punishment. Traditionally, rigorous tests and other types of assessments are those that are extremely difficult and that very few students do well on. According to traditional testing theory, a good test is one that discriminates the good and the bad students effectively.
Formative assessment is based on a different logic, or paradigm, one in which it is believed that every student can do well under the right conditions and the right amount of practice. If a student needs to retake a test again and again until he/she masters the content, why not? Formative assessment is for learning, not of learning. Thus, the rigor of formative assessment is of a different nature. Formative assessment is not a funnel that only a few get out of, but rather, it is an inverted funnel, which few may get into at first but all or most will get out of eventually.
Putting together a writing portfolio with multiple drafts of compositions, based on the teacher’s and the peers’ feedback, and writing a reflective piece explaining what one has learned from the experience and how the portfolio portrays growth requires much more critical thinking and agency, and is thus much more rigorous, than merely writing a number of one-shot compositions and receiving a meaningless grade on each one.

Myth # 5: Formative assessment is not realistic because students will have to take summative tests all their lives

Students might have to take summative tests all their school lives, before schools adopt more formative types of assessments. Other than that, how many tests do we really take in life? A university entrance exam (in the case of Brazil)? A foreign language proficiency exam? Or perhaps a public service entrance exam? How many of our students overall will actually take these types of exams, and how frequently? Of course, we do have to prepare students to face high-stakes exams and must include summative assessment in our curriculum, but does it need to be the only type of assessment we use?
With the exceptions mentioned above, most of what we learn in life is assessed formatively. We make a mistake, receive feedback on it, and have the chance to correct our path the next time. I’m in the process of learning how to make risotto. I’m not a good cook at all, so I looked up a recipe that I thought was straightforward enough for me, tried it out with my family, received feedback on it, improved my risotto, and then felt ready to invite some close friends over to try it out. Now that it seems that they, too, liked my risotto, I might be ready to invite other people over, maybe even some friends that cook very well. This sounds more real-life to me!

Reference:
Brown, H.D. (2004). Language assessment – principles and classroom practice. White Plains, NY: Longman.

photo courtesy of freedigitalphotos.net

This is a crossposting from my blog TEFLing

No comments:

Post a Comment

We´d love to hear from you.