Sunday, June 29, 2008

Teachers and Reflection

I wrote this in response to a thoughtful posting on another blog, The Speculum, where the author, Lennie Irvin, presents a draft of a pre-dissertation proposal. It's about writing and reflections, and presents interesting definitions of reflections.
-----------------
A practitioner's response:

I'm the retired (ha!) director of the Willamette University School of Education where I gave numerous assignment for student/student teachers to 'reflect' on either what they saw in a observation of another teacher or on their own practice as a student teacher. Our program was heavy in requiring reflective tasks. From that experience comes this caution - the reflective practices of your students may not be done under the same definition you are proposing. If I use hindsight to define reflection as used by the vast majority of our students, it was to describe what they saw or remembered, with a cautious evaluative conclusion.

Again in hindsight, I don't think the faculty had a clear definition of reflection, certainly not a common one, and I don't believe, based on the outcomes, that we make the task of reflection clear to the students.

As I 'reflected' on my career in teacher education (reviewing what I had done, what was effective/not effective, identifying a central theme to my practices, and what I would change were I to start over) - my post retirement definition that I wish I had used with students - I concluded that my efforts to improve their teaching skills through praise, criticism, and offering of various solutions to their teaching problems was largely ineffective. It wasn't until I took a more objective role in observation/evaluation that I found success, both in the depth of teacher reflection and in effective change in teaching practices.

I found that when I shifted from feedback in the form of anecdotal notes to providing objective data on what was happening in the classroom, the students/student teachers shifted from a defensive/deflective or accommodative response to one of independent reflection (definition above), problem solving, and change.

In my now failed retirement, and initially as a mental exercise, I developed the Data-Based Observation Method and then wrote a software program to support it. The software is not necessary, but make it much easier.

In the Data-Base Observation Method the focus of an observation is collaboratively determined between observer and observee - "What do you want to know about your classroom?". Guiding questions can be used to focus the process on categories such as content delivery, class management, student relations, etc. Once the focus has been determined, the observer will gather objective frequency and duration data on classroom behaviors of teacher and/or students.

Here's where the reflection come in. The data is provided to the teacher with these questions "Is this what you thought was happening in your classroom? Is a change needed? If so, what will you change?" When this external, objective picture of what had happened in their classroom (part one of my definition - reviewing what I had done) is presented, the teachers make the determination of whether the teaching/learning was effective/not effective (part two of the definition).

Professional level discussion ensues, based on the objective data, to determine if and/or what changes should be made (part four of the definition - part three, identifying a central theme, comes after a number of the data-based discussions).

There now has been five years of implementation of this method by me, school administrators, and peer coaches and I have found that it builds the skill of reflection in teachers, a skill I am coming to see as a critical element in becoming a long-term successful teacher. I believe that 'reflection' is shallow and surface when the person does not have the factual basis for understanding what occurred and when the reflective task is to be either self or externally evaluative in nature. The question is not "How did I do?" (Answer: good, poor, passed, a 6 out of 10, I liked it, etc), but "What happened and was it effective?"

Sunday, June 22, 2008

Teacher Evaluations From The Teacher's Viewpoint


In a May, 2008 report by the Education Sector titled Waiting To Be Won Over there is an interesting and revealing question: exactly what do teachers think of formal evaluations. The graphic here illustrates a significant problem. In this chart 41% of the teachers viewed formal observations as a 'formality'. When I look at the evaluation forms and the standards they are based on, it's quite obvious why they would think so. The language in the standards/indicators and on the forms is very frequently so vague as to be unverifiable.

Only 26% viewed the evaluations as 'useful and effective' - just 1/4 of the teachers!

But what I found most interesting was the 32% that saw formal evaluations as 'well-intentioned but not helpful'. To me that indicates that both parties - administrators and teachers - had hoped that the evaluations would serve a good purpose, but were disappointed.

The reason for these disappointing numbers is twofold: the problematic language in standards and the subjective nature of most evaluations. To illustrate, here are three standard/indicator statements taken from a large district's teacher evaluation/professional development document:

"Students initiate and take responsibility for their own learning."  Not only is this a stretch to view this as within the responsibility and power of the teacher to invoke, but this is not a behavior that is observable through the series of classroom observations nor through a paper-trail of student work.  It's a wonderful value, but unusable as a basis for teacher evaluation.

"Teachers connect new knowledge to prior learning."  This can be observed by looking for statements or assignments that directly make the connection between a students prior knowledge and the lesson at hand. Data can be collected on both the teacher's statements and the student's statements and questions.

"Teachers make the lesson objectives and learning targets clear for students in advance of the lesson."  This too can be observed by tracking statements made by the teacher; questions, statements, and errors made by the students; and the response by the teacher to student errors. However, the phrase '...in advance of the lesson' make this a bit more narrow - this is a standard to be accomplished before the lesson begins, and does not account for the changes that need to be made during the typical lesson. Of course, making the goals clear before the task begins is very important, but there will also be a need for objectives and targets to be adjusted as a result of feedback during the lesson.

The key to all this is that the language in standards/indicators were initially written as general guidelines, and are now being used as the basis for evaluations. There is a serious need to revisit the standards and rethink/rewrite them into evidence that can actually be gathered. It's not fair or reasonable for either the administrator nor the teacher when the objectives and goals of their behavior isn't clear. 

With clear standards, written in observable terms, and objective tools for collecting the data, the subjective nature of the process is diminished. When the objective data is presented to teachers, I predict the numbers in both the 'formality' and 'well-intentioned, but....' categories will significantly decrease. 

Wednesday, June 18, 2008

Aligning Tools To Standards

I've been doing extensive work aligning (and creating) eCOVE tools that align with various district and state standards for teacher performance. As I create more tools, needed to provide objective data in line with the language in the standard/indicator, I am continually amazed at the uselessness of many of the standards.

It's not that the standard lacks value as a broad guideline, but they are often worded so that the interpretation of the standard can be so broad to lack any form of reliability -- or that the standard/indicator points at some internal value such as 'caring' for the students or 'believing' in the students.

An example from Danielson's latest version of Framework for Teaching: "Teacher's plans and practice reflect accurate understanding of prerequisite relationships among topics and concepts." What would one observe, in print or in a live situation, that would serve as evidence that the teacher understood a prerequisite relationship? And what knowledge and skills would the observer need to adequately judge this indicator for a variety of content areas? Nonetheless, I am sure that there are many evaluation sheets being checked on the basis of  'a feeling' or a vague interpretation of this language. No wonder 40% of teachers view observations as a formality.

The solution is not to rely (solely) on eCOVE to identify ways to gather data that might be conceived as supporting this indicator, but to REVISE the standards language. In fact, I'm setting a high priority for myself and eCOVE to create a set of standards that have observable behavior indicators attached. If you'd like to help, let me know. Stop by the website - www.ecove.net - and email or call me. If you have a set of standards that have been revised and have observable indicators, PLEASE contact me -- you'll be doing the profession a big service.

If we can't identify the evidence that would support the achievement of a standard, then the standard is useless at best, and frequently dangerous and misleading. When the standard lacks the possibility of a clear line of evidence, it can be interpreted and applied by each observer - and thus is no standard at all.