Saturday, February 18, 2017

Teacher Evaluation Systems



by: Mery Tellez

Teacher evaluations are determining for many teachers around the world. The process behind them, has been designed and re-designed many times to fit many different realities.

I believe that the way in which we as teachers are evaluated should mirror our beliefs around evaluation of our students. In that sense, and as it was presented in previous posts, I am a firm believer in evaluation and assessment as communication tools that allow teachers and students to track progress and observe aspects that can improve. Translating this to the teacher evaluations, I believe these should be framed in the same way; as communication tool between teachers and evaluators/administrators/mentors.

The person observing my teaching, should aim to provide me with feedback on the current status of my teaching techniques and with steps and suggestions that can take me towards progress in the areas in which improvement is required.

In my first year as a teacher I was lucky enough to be evaluated and observed by an inspiring principal who made the process easy, gratifying and productive for me and in extension for the school. The 3 key components that I was able to identify as successful in both his technique and feedback were:

1. He was a human being first of all: He understood it was my first year, and he understood how difficult it is to have an "intruder" in your classroom. Therefore, he was kind and understanding during pre, observation and post-observation, he showed a smile and interacted with me and the students helping us all to see that his was a visit and that he was interested in learning about our dynamic and our interactions, more than in judging them.

2. He framed the post-observation as a mentor-mentee session and not as the moment of the verdict. He started by pointing out the parts of the observation that were impressive or simply positive from his perspective. Then he moved to provide me with strategies, suggestions, actionable items that I was able to immediately apply in order to improve.



3. He helped me to set goals for myself and my class, he was interested not in telling me how good or bad I was, but in telling me where the next step was for me to improve. My evaluation and observation were linked to my professional development plan and he made it clear throughout the process. His feedback was supportive and accompanied by literature and/or resources aimed to help me improve.

The components of my first evaluation allowed me to grow as a teacher and benefit my students and the goals of the school.

Teacher evaluation systems come in all shapes and forms. Normally, their components are mainly determined by the objectives a specific school or district has for the process, or in a wider range to governmental policies and requirements. Working in the international school area, provides to some extend a flexibility for a school to pick and choose some of the best pieces of different system.

The following two models are very different in their approach and components, and therefore I believe is worth to look at them and compare their differences and similarities.

The first one is the one proposed by the Ohio Department of Education. Under this framework, teacher evaluation are determined by a 50-50 division in which half of the teacher evaluation is determined by students' performance as given by different types of growth measures. While the remaining 50% of the evaluation is determined by the teacher performance as measured by his/her professional growth plan, formal observations and completion of performance rubrics.



The framework claims to have recognition of excellence as one of their first objectives, moving to improvement of the quality offered to students, and professional development of educators, among others.

Additionally, the framework provides the instruments for teachers to be evaluated under each one of the suggested components.

There is also another alternative for school, if they want to select having a third component in their evaluations, in which schools can opt for having a 15% taken out of the student performance component for an "optional component" that can be filled with: student feedback, student portfolios, teachers' self or peer reflections.

A second model known as the Empowerment Evaluation; first introduced by Fetterman in 1993, offers what I believe to be a much more comprehensive framework for teacher evaluation, but most importantly, for teacher growth. Contrary to what is stated in the prior Ohio model, in this case, the rationale behind the model is to use the tools of evaluation and measuring to foster improvement. That translates, to the main goal of the entire evaluation system to be the growth and improvement of teachers, by means of evaluation, not as a consequence of it.

The main difference from the empowerment evaluation from other models, is the movement of the responsibility of the evaluation from the administration and towards the teacher; empowering them to build their own process, determine goals, and decide and collect good evidence pieces of their own growth.

The framework is composed by 10 guiding principles that are aimed to help the community to set goals for growth and progress as a community. The first of these principles is improvement: the common goal of the entire process is aimed towards this; improvement, not measuring or evaluating, but progressing. The remaining ones are community ownership, inclusion (participation of the community at large), democratic participation, social justice, community knowledge, evidence-based strategies, capacity building, organisational learning and accountability
So, which components should be determining of a comprehensive teacher evaluation? Several studies in the US indicate that teacher evaluation systems, are in fact ineffective at differentiating or judging the quality of teachers, and dramatically fail at being a supportive system for the progress and learning of teachers. (Bill and Melinda Gates Foundation, 2013; U.S. Department of Education, 2009).
With this knowledge in mind, and with a clear understanding of the importance of the role of the teacher in ensuring quality education for the students, I believe that government agencies are failing to recognise that when it comes to evaluation, one size does not fit all, and every school should be able to add components to their evaluation processes that relate and emphasise with the culture of the school.

Observing the different frameworks and approaches available, there are some common components that stand out as particularly important from my perspective as member of an educational community. This are some of the aspects that I consider important to be included in a custom made teacher evaluation.

Student engagement: Certainly this constitutes an elusive, yet fundamental aspect of a successful classroom. Engagement of the students is something very difficult to identify during an observation, as it is very dependant on the topic covered in a certain specific lesson and in many other emotional aspects that cannot be controlled by any teacher in a 100% of the cases. Nonetheless, triangulation of the measures can provide a better picture of the level of engagement a students is achieving with her/his students, by adding components of students evaluations, and quality of teacher-student interactions, a better picture of this important aspect could be included as a fundamental piece of an ideal teacher evaluation system.

Student feedback: An aspect that I personally consider absolutely necessary, as a component by itself, or as a piece of evidence of teacher goals and evaluation. Students are the only real observants of our teaching practices on a daily basis, and even though some teachers fear the lack of objectivity from their behalf, there are many studies that have proven otherwise, and that have proven how student provided information, actually is a clear indicator of teachers' performance.

Sources:


Bill and Melinda Gates Foundation. (2013). Ensuring fair and reliable measures of effective teaching: Culminating findings from the MET Project’s three year study. Bellevue, WA: MET Project. Retrieved from http://metproject.org/downloads/MET_Ensuring_Fair_and_Reliable_Measures_Practitio ner_Brief.pdf

Fetterman, D. M. (1994). Steps of empowerment evaluation: From California to Cape Town. Evaluation and Program Planning, 17(3), 305–313. Retrieved from http://www.sciencedirect.com/science/article/pii/0149718994900108

Ohio State Board of Education. (2012, October 9). Teacher Evaluations. Retrieved February 18, 2017, from http://education.ohio.gov/Topics/Teaching/Educator-Evaluation-System/Ohio-s-Teacher-Evaluation-System  

Evaluation Systems

Loading...
Loading...


Friday, February 17, 2017

Pre-assessment and Differentiation

by: Mery Tellez

Pre-assessments are one of the many strategies used by teachers in their daily planning.  This type of assessment is normally used as a tool to assist teachers in their planning, and its results are mainly used to guide instruction and not necessarily to evaluate students per se.
Given this definition, is pretty clear how providing students with a pre-assessment tool on an specific subject or topic, should naturally lead into the possibility for differentiation based on the readiness of each student.

Prior knowledge is normally very varied in a Computer Science classroom, students' understanding on many computing related topics varies dramatically based in their prior opportunities and interest in the area.  For this reason, pre-assessments take an important role on the Computer Science classroom planning.  For the unit on the Fetch-execute cycle, I have provided a pre-assessment quiz on Kahoot to students on their first class on the topic, as a warm-up activity to the unit.  Students were informed about the quiz NOT being evaluated, and the results will be used to plan for the differentiation based on the readiness determined by the quiz.

Although the class is taught at a computer lab and sufficient devices are available, a paper based equivalent will be ready for students struggling with the mobile/online version.
A preview of the quiz offered to students can be found at:

https://play.kahoot.it/#/k/a377d1a9-ee55-437a-b74f-0ae25be38af2 



The results of the pre-assessment informed of a division of student readiness as follows:

Group A: 5 students who answered most (90% of higher), including the most difficult, of the pre-assessment questions correctly.
Group B: 12 students who have some knowledge about the topic as shown in their score (between 60%-89%), but need to develop higher order thinking skills.
Group C: 5 students who appear to have limited knowledge about the topic (Less than 60%).

The activity was designed as a concept inventory on the topic, with only multiple-choice questions in an effort to make it as fast, and easily graded as possible, as well as still interesting and intriguing for students as an starter/opening activity.  Students were provided with an "I don't know" option for each question, and requested to use it instead of guessing.  This also allows to separate misconceptions from simple lack of prior exposure to the topic.  Which is important to determine the depth of instruction needed in many cases, given than it is very different to address a concept misunderstood, or not clear, than to address one that is completely new to the target audience.  Additionally, the "I don't know" option helps to avoid misinterpretation of the results based on lucky guesses.

After completing the quiz, and thanks to the use of the online tool, I have the results available and I am easily able to divide the students and the activities and learning experiences they will be given according to their results as explained above.    The strategies to be applied are explained in the following mind map:




For Group A (Higher) the following strategies and assessment techniques will be applied:
PBL methodology: The results from the pre-assessment show that these students have a certain level of mastery of the topic. In their case, they will be asked to work on applying their knowledge in the area into the solution of a problem.
Students will be provided with a reading on the reasoning behind the fetch-execute cycle, and asked to present an alternative model for a computing system considering the new developments in technology of storage and memory that had happen in the last 50 years.
The development of the project will be guided to allow for students to clarify the few misunderstandings that they might have remaining.

Assessment:  For the project will be laid out as follows:
Observation: Of the process of developing the solution for the problem proposed.
Written report: Students will be asked to keep a written reflection on the progress of the developing of their project.
Performance assessment: The project itself will be evaluated as a summative assignment.
Presentation: Students will be asked to either present, or publish online the results of their projects.

For Group B (Middle) the following strategies and assessment techniques will be applied:
Technology Assisted: This group of students have a foundation on the topic and at least at a certain level they already have an understanding of the concepts that needs to be cleared of misunderstandings.
A video will be provided for them that explains and illustrate the key concepts related to the fetch-execute cycle. Students can follow the video at their own pace, allowing them to stop at the parts that are unclear for them. They will be asked to complete Cornell notes for the video and to submit a document with 3 take aways from it.
Students will also be provided with lab exercises that they will need to complete with programming and that require understanding of the fetch-execute cycle.

Assessment: Students in this group will be evaluated as follows:
Writing task: Submitting their take aways and notes on the video.
Performance task: Students will submit their programs and the accompanying lab report for the fetch-execute exercises.
Unit Exam: This students will take an exam similar to the initial pre-assessment to demonstrate their progress during the unit.

For Group C (Lower) the following strategies and assessment techniques will be applied: 
Small group instructions and role play:
This particular group of students will began by being part of a small lecture in which the students will be introduced to the topic. Graphics, text and spoken word will be used to introduce the topic using different alternatives for different types of learners.
As the vocabulary required will be new for them, students will be given strategies for preparing "one pagers" with the key vocabulary that they will display in the classroom.
After the explanation, students will create a simulation/role play of the fetch-execute cycle, in which they will take roles and transfer data accordingly. They will be performing some of the same exercises required by the next group, but in order to understand the concepts.
Students will be given a guided version of the same programming lab, and will be grouped with students from the second and third group to complete some of the exercises together.

Assessment: Students in this group will be provided with a lot of formative assessment techniques to help them and myself identify their progress throughout the execution of the proposed learning activities.
Vocabulary Quiz: Students will be tested on the vocabulary pieces during the second day.
Observation and conversation with students: Students will be provided with verbal feedback on their responses to questions during class lecture and simulation/role play.
Performance task: Students will submit their lab results and accompanying report.
Unit exam: Students will complete and exam similar to the pre-assessment activity to measure their growth after the unit.


Sources:

Pendergrass, E. (2014, January). Differentiation: It Starts with Pre-Assessment. Retrieved February 05, 2017, from http://www.ascd.org/publications/educational_leadership/dec13/vol71/num04/Differentiation@_It_Starts_with_Pre-Assessment.aspx

Trina. (n.d.). 5. Pre-assessment Ideas - Differentiation & LR Information for SAS Teachers. Retrieved February 05, 2017, from https://sites.google.com/site/lrtsas/differentiation/5-preassessment-ideas

University, C. M. (n.d.). Assessing Prior Knowledge-Teaching Excellence & Educational Innovation - Carnegie Mellon University. Retrieved February 05, 2017, from https://www.cmu.edu/teaching/designteach/teach/priorknowledge.html


Sunday, February 5, 2017

Developing Smart Objectives


Loading...
Loading...

How to unpack a standard


Positive Behavior Intervention and Support


Loading...
Loading...

De-escalating Aggressive Behavior