Friday, March 15, 2013

Alternative Assessment - The Prime Experience


About two weeks ago, our colleague Lueli Ceruti wrote a really interesting blog post in the CTJConnected Blog. In short, her post described our reasons for questioning the way we assess our adult students’ EFL learning and our experimenting with what we have been calling the “alternative ass essment system.”

Basically, what is being proposed is that the assessment of our adult students’ learning be carried out in a more ongoing manner. The objective here is to make it possible for us all, teachers and students, to know how well students are learning in time for us to take action, if necessary, before the last day of class. Also, with this “alternative assessment system”, our student will hopefully get less anxious with the idea of being evaluated at the end of the module.

In Lueli’s post, she described the first assessment activity she did with her Thomas Flex group. Here is the first one my Thomas Prime 1 students and I experimented with. Thomas Prime is a Casa Thomas Jefferson upper-intermediate/advanced course designed for adult students.

The Thomas Prime 1 Experiment:

In week 2 (of 10), we covered the grammar lesson “Suggest ways to enjoy life more”, and students learned about the verbs “stop”, “remember” and “forget” followed by the infinitive and the gerund.
First, we read and discussed the text “Finding Balance”, which opens the second lesson in the book Summit, published by Pearson Longman. Next, by analyzing the examples of the focus verbs in the text, we tried to come up with the different meanings each of them had when followed by infinitives and gerunds. This information was recorded on the board, and right after that, the students compared it with the chart on page 5. They then did the exercise on the same page, and we checked their answers. I assigned an extra exercise on the focus verbs for homework, with the students being responsible for checking their own answers (They had a copy of the answer key).
At the beginning of the following class, after the students had worked cooperatively to check their answers in the fill-in-the-blanks in sentences giving advice, I told them about my sister, a girl who led a very stressful life due to her inability to find balance. The students then individually wrote five suggestions on a chart I gave them, and we agreed on the five best suggestions to give to my sister.

This is what the board looked like:



Before the end of the class, I collected the charts with the students’ sentences and assessed their work at home. I used to following rubrics as a guide.
  

Each of the sentences is worth two points.

      a)    Deduct two points if the student’s sentence does not make sense.
      b)    Deduct one point if the student makes a mistake with the target structure (verbs stop, remember, forget followed by the wrong verb form)
      c)    Deduct half a point if the student makes small mistakes (prepositions, articles, spelling).


We sent these suggestions to my sister, a Prime 3 student at the Casa, and I asked her to record a video segment to respond to the students. Here is the video:






Needless to say, the students really engaged in the activity and had lots of fun watching the response. The assessment was perfectly aligned with the learning outcomes and instructional strategies. As a result, my students didn’t even notice they were actually being assessed. Their major interest was in communicating authentically with my sister.


Wednesday, March 06, 2013

Thinking about assessment... again!

If you are a teacher, like me, then you have certainly spent countless coffee breaks discussing assessment: either criticizing or praising it, maybe questioning it, or even plain “cursing” it… no matter who we are, what or where we teach: assessment is close to our hearts… in oh so many ways! 

I have personally been working with and looking into this matter for many years, be it as a course supervisor, designing, writing and revising tests, probing into the process; be it as an examiner, participating in the final assessment of someone else’s handiwork, with cold analytical eyes, scrutinizing the final product; or even as a curious mind who wonders what it is that we do: Do we test to teach? Do we teach to test? And moreover, what it is that we should be doing? 

Anyway, back in January, when Isabela Villas Boas shared a blog post by Nick Provenzano with us, I dared ask her if we could dare… Only to discover that she was the one daring us… In his post, Nick recounts how he spent a semester without his traditional testing system, and how he witnessed high levels of commitment, as well of strong evidence of his students’ skills and knowledge through the use of alternative assignments, essays, projects, and different assessment opportunities. 

The discussion was not new to us. We had already been questioning the unquestionable… the effectiveness of our traditional system with our adult students… Why were we able to find students reaching the higher levels – passing test after test, and still not able to use the language? Why were some of our adult students discouraged? How come teachers were feeling frustrated? We decided to turn these difficulties into opportunities for development. The theoretical project had been ready – on paper – for a few months, as Isabella had taken an online program on assessment with Oregon University. All we had to do was “take the leap” and bring it to life. Right now, there are two groups – one Thomas flex 1, and one Prime 1 – being piloted with an alternative assessment system. 

This series of posts is an attempt to share what we are trying to do, inviting you into this experience-experiment, summoning your thoughts and encouraging your input. 


The THOMAS FLEX 1 Experiment: 

In week 3 (of 10), having already worked with most of Unit 1, we wanted to ascertain that the students were able to interact using the following exponents:

  • What’s your name? My name is… 
  • How are you? I’m…, and you? 
  • What’s your telephone number? It’s (numbers 0-9) 
  • Nice to meet you/Nice to meet you too. 

The lesson was designed to build on student’s recently acquired abilities, consolidate them, and finally, invite linguistic output that could be assessed. The procedure was the following: 

  1. Each pair of students received a dialogue cut up into slips. They were asked to put the slips in a logical sequence to make the dialogue. 
  2. With the correct sequence, students were asked to personalize the dialogue, by substituting names and other elements with their own personal information. 
  3. Then, the slips were collected and the teacher elicited the dialogue on the board – leaving blanks in which they would complete with their own names, etc. 
  4. After that, the students were asked to stand up and cocktail, talking to at least three different classmates, using the dialogue on the board as a model. T observed and monitored the exchanges, cleaning the board when most of the students had performed the dialogue at least once. 
  5. Finally, the T called on pairs of students and asked them to perform the dialogue out loud – no model available. As they did so, the teacher filled in an assessment sheet with the following criteria:


  • Correct greeting / response to greeting - Yes (2pts.) - Partially (1pt.) - No (0 pt.)
  • Asks name correctly - Yes (2pts.) - Partially (1pt.) - No (0 pt.)
  • Responds to question about name correctly - Yes (2pts.) - Partially (1pt.) - No (0 pt.)
  • Says and responds to “nice to meet you”  - Yes (2pts.) - Partially (1pt.) - No (0 pt.)
  • Asks and/or answers about phone number - Yes (2pts.) - Partially (1pt.) - No (0 pt.)

This was the end of their first “Oral Assessment Opportunity”. The plan is to have one of these every week, focusing on different skills-areas such as speaking, writing – in which grammar would be either intrinsically embedded, or clearly stated, and also listening and reading – for we see that one of these students’ main difficulty is understanding input, so that they can formulate their own output. 

Anyway, we are using the media with one sole purpose: hearing your thoughts. Do you have any ideas we can use in this pilot project? Are there any feelings or thoughts you would like to share? Is there anything in your experience that can add to this experiment? Let’s get this chat started… The ball in on your court!