Saturday, February 18, 2017

Teacher Evaluation Systems



by: Mery Tellez

Teacher evaluations are determining for many teachers around the world. The process behind them, has been designed and re-designed many times to fit many different realities.

I believe that the way in which we as teachers are evaluated should mirror our beliefs around evaluation of our students. In that sense, and as it was presented in previous posts, I am a firm believer in evaluation and assessment as communication tools that allow teachers and students to track progress and observe aspects that can improve. Translating this to the teacher evaluations, I believe these should be framed in the same way; as communication tool between teachers and evaluators/administrators/mentors.

The person observing my teaching, should aim to provide me with feedback on the current status of my teaching techniques and with steps and suggestions that can take me towards progress in the areas in which improvement is required.

In my first year as a teacher I was lucky enough to be evaluated and observed by an inspiring principal who made the process easy, gratifying and productive for me and in extension for the school. The 3 key components that I was able to identify as successful in both his technique and feedback were:

1. He was a human being first of all: He understood it was my first year, and he understood how difficult it is to have an "intruder" in your classroom. Therefore, he was kind and understanding during pre, observation and post-observation, he showed a smile and interacted with me and the students helping us all to see that his was a visit and that he was interested in learning about our dynamic and our interactions, more than in judging them.

2. He framed the post-observation as a mentor-mentee session and not as the moment of the verdict. He started by pointing out the parts of the observation that were impressive or simply positive from his perspective. Then he moved to provide me with strategies, suggestions, actionable items that I was able to immediately apply in order to improve.



3. He helped me to set goals for myself and my class, he was interested not in telling me how good or bad I was, but in telling me where the next step was for me to improve. My evaluation and observation were linked to my professional development plan and he made it clear throughout the process. His feedback was supportive and accompanied by literature and/or resources aimed to help me improve.

The components of my first evaluation allowed me to grow as a teacher and benefit my students and the goals of the school.

Teacher evaluation systems come in all shapes and forms. Normally, their components are mainly determined by the objectives a specific school or district has for the process, or in a wider range to governmental policies and requirements. Working in the international school area, provides to some extend a flexibility for a school to pick and choose some of the best pieces of different system.

The following two models are very different in their approach and components, and therefore I believe is worth to look at them and compare their differences and similarities.

The first one is the one proposed by the Ohio Department of Education. Under this framework, teacher evaluation are determined by a 50-50 division in which half of the teacher evaluation is determined by students' performance as given by different types of growth measures. While the remaining 50% of the evaluation is determined by the teacher performance as measured by his/her professional growth plan, formal observations and completion of performance rubrics.



The framework claims to have recognition of excellence as one of their first objectives, moving to improvement of the quality offered to students, and professional development of educators, among others.

Additionally, the framework provides the instruments for teachers to be evaluated under each one of the suggested components.

There is also another alternative for school, if they want to select having a third component in their evaluations, in which schools can opt for having a 15% taken out of the student performance component for an "optional component" that can be filled with: student feedback, student portfolios, teachers' self or peer reflections.

A second model known as the Empowerment Evaluation; first introduced by Fetterman in 1993, offers what I believe to be a much more comprehensive framework for teacher evaluation, but most importantly, for teacher growth. Contrary to what is stated in the prior Ohio model, in this case, the rationale behind the model is to use the tools of evaluation and measuring to foster improvement. That translates, to the main goal of the entire evaluation system to be the growth and improvement of teachers, by means of evaluation, not as a consequence of it.

The main difference from the empowerment evaluation from other models, is the movement of the responsibility of the evaluation from the administration and towards the teacher; empowering them to build their own process, determine goals, and decide and collect good evidence pieces of their own growth.

The framework is composed by 10 guiding principles that are aimed to help the community to set goals for growth and progress as a community. The first of these principles is improvement: the common goal of the entire process is aimed towards this; improvement, not measuring or evaluating, but progressing. The remaining ones are community ownership, inclusion (participation of the community at large), democratic participation, social justice, community knowledge, evidence-based strategies, capacity building, organisational learning and accountability
So, which components should be determining of a comprehensive teacher evaluation? Several studies in the US indicate that teacher evaluation systems, are in fact ineffective at differentiating or judging the quality of teachers, and dramatically fail at being a supportive system for the progress and learning of teachers. (Bill and Melinda Gates Foundation, 2013; U.S. Department of Education, 2009).
With this knowledge in mind, and with a clear understanding of the importance of the role of the teacher in ensuring quality education for the students, I believe that government agencies are failing to recognise that when it comes to evaluation, one size does not fit all, and every school should be able to add components to their evaluation processes that relate and emphasise with the culture of the school.

Observing the different frameworks and approaches available, there are some common components that stand out as particularly important from my perspective as member of an educational community. This are some of the aspects that I consider important to be included in a custom made teacher evaluation.

Student engagement: Certainly this constitutes an elusive, yet fundamental aspect of a successful classroom. Engagement of the students is something very difficult to identify during an observation, as it is very dependant on the topic covered in a certain specific lesson and in many other emotional aspects that cannot be controlled by any teacher in a 100% of the cases. Nonetheless, triangulation of the measures can provide a better picture of the level of engagement a students is achieving with her/his students, by adding components of students evaluations, and quality of teacher-student interactions, a better picture of this important aspect could be included as a fundamental piece of an ideal teacher evaluation system.

Student feedback: An aspect that I personally consider absolutely necessary, as a component by itself, or as a piece of evidence of teacher goals and evaluation. Students are the only real observants of our teaching practices on a daily basis, and even though some teachers fear the lack of objectivity from their behalf, there are many studies that have proven otherwise, and that have proven how student provided information, actually is a clear indicator of teachers' performance.

Sources:


Bill and Melinda Gates Foundation. (2013). Ensuring fair and reliable measures of effective teaching: Culminating findings from the MET Project’s three year study. Bellevue, WA: MET Project. Retrieved from http://metproject.org/downloads/MET_Ensuring_Fair_and_Reliable_Measures_Practitio ner_Brief.pdf

Fetterman, D. M. (1994). Steps of empowerment evaluation: From California to Cape Town. Evaluation and Program Planning, 17(3), 305–313. Retrieved from http://www.sciencedirect.com/science/article/pii/0149718994900108

Ohio State Board of Education. (2012, October 9). Teacher Evaluations. Retrieved February 18, 2017, from http://education.ohio.gov/Topics/Teaching/Educator-Evaluation-System/Ohio-s-Teacher-Evaluation-System  

Evaluation Systems

Loading...
Loading...


Friday, February 17, 2017

Pre-assessment and Differentiation

by: Mery Tellez

Pre-assessments are one of the many strategies used by teachers in their daily planning.  This type of assessment is normally used as a tool to assist teachers in their planning, and its results are mainly used to guide instruction and not necessarily to evaluate students per se.
Given this definition, is pretty clear how providing students with a pre-assessment tool on an specific subject or topic, should naturally lead into the possibility for differentiation based on the readiness of each student.

Prior knowledge is normally very varied in a Computer Science classroom, students' understanding on many computing related topics varies dramatically based in their prior opportunities and interest in the area.  For this reason, pre-assessments take an important role on the Computer Science classroom planning.  For the unit on the Fetch-execute cycle, I have provided a pre-assessment quiz on Kahoot to students on their first class on the topic, as a warm-up activity to the unit.  Students were informed about the quiz NOT being evaluated, and the results will be used to plan for the differentiation based on the readiness determined by the quiz.

Although the class is taught at a computer lab and sufficient devices are available, a paper based equivalent will be ready for students struggling with the mobile/online version.
A preview of the quiz offered to students can be found at:

https://play.kahoot.it/#/k/a377d1a9-ee55-437a-b74f-0ae25be38af2 



The results of the pre-assessment informed of a division of student readiness as follows:

Group A: 5 students who answered most (90% of higher), including the most difficult, of the pre-assessment questions correctly.
Group B: 12 students who have some knowledge about the topic as shown in their score (between 60%-89%), but need to develop higher order thinking skills.
Group C: 5 students who appear to have limited knowledge about the topic (Less than 60%).

The activity was designed as a concept inventory on the topic, with only multiple-choice questions in an effort to make it as fast, and easily graded as possible, as well as still interesting and intriguing for students as an starter/opening activity.  Students were provided with an "I don't know" option for each question, and requested to use it instead of guessing.  This also allows to separate misconceptions from simple lack of prior exposure to the topic.  Which is important to determine the depth of instruction needed in many cases, given than it is very different to address a concept misunderstood, or not clear, than to address one that is completely new to the target audience.  Additionally, the "I don't know" option helps to avoid misinterpretation of the results based on lucky guesses.

After completing the quiz, and thanks to the use of the online tool, I have the results available and I am easily able to divide the students and the activities and learning experiences they will be given according to their results as explained above.    The strategies to be applied are explained in the following mind map:




For Group A (Higher) the following strategies and assessment techniques will be applied:
PBL methodology: The results from the pre-assessment show that these students have a certain level of mastery of the topic. In their case, they will be asked to work on applying their knowledge in the area into the solution of a problem.
Students will be provided with a reading on the reasoning behind the fetch-execute cycle, and asked to present an alternative model for a computing system considering the new developments in technology of storage and memory that had happen in the last 50 years.
The development of the project will be guided to allow for students to clarify the few misunderstandings that they might have remaining.

Assessment:  For the project will be laid out as follows:
Observation: Of the process of developing the solution for the problem proposed.
Written report: Students will be asked to keep a written reflection on the progress of the developing of their project.
Performance assessment: The project itself will be evaluated as a summative assignment.
Presentation: Students will be asked to either present, or publish online the results of their projects.

For Group B (Middle) the following strategies and assessment techniques will be applied:
Technology Assisted: This group of students have a foundation on the topic and at least at a certain level they already have an understanding of the concepts that needs to be cleared of misunderstandings.
A video will be provided for them that explains and illustrate the key concepts related to the fetch-execute cycle. Students can follow the video at their own pace, allowing them to stop at the parts that are unclear for them. They will be asked to complete Cornell notes for the video and to submit a document with 3 take aways from it.
Students will also be provided with lab exercises that they will need to complete with programming and that require understanding of the fetch-execute cycle.

Assessment: Students in this group will be evaluated as follows:
Writing task: Submitting their take aways and notes on the video.
Performance task: Students will submit their programs and the accompanying lab report for the fetch-execute exercises.
Unit Exam: This students will take an exam similar to the initial pre-assessment to demonstrate their progress during the unit.

For Group C (Lower) the following strategies and assessment techniques will be applied: 
Small group instructions and role play:
This particular group of students will began by being part of a small lecture in which the students will be introduced to the topic. Graphics, text and spoken word will be used to introduce the topic using different alternatives for different types of learners.
As the vocabulary required will be new for them, students will be given strategies for preparing "one pagers" with the key vocabulary that they will display in the classroom.
After the explanation, students will create a simulation/role play of the fetch-execute cycle, in which they will take roles and transfer data accordingly. They will be performing some of the same exercises required by the next group, but in order to understand the concepts.
Students will be given a guided version of the same programming lab, and will be grouped with students from the second and third group to complete some of the exercises together.

Assessment: Students in this group will be provided with a lot of formative assessment techniques to help them and myself identify their progress throughout the execution of the proposed learning activities.
Vocabulary Quiz: Students will be tested on the vocabulary pieces during the second day.
Observation and conversation with students: Students will be provided with verbal feedback on their responses to questions during class lecture and simulation/role play.
Performance task: Students will submit their lab results and accompanying report.
Unit exam: Students will complete and exam similar to the pre-assessment activity to measure their growth after the unit.


Sources:

Pendergrass, E. (2014, January). Differentiation: It Starts with Pre-Assessment. Retrieved February 05, 2017, from http://www.ascd.org/publications/educational_leadership/dec13/vol71/num04/Differentiation@_It_Starts_with_Pre-Assessment.aspx

Trina. (n.d.). 5. Pre-assessment Ideas - Differentiation & LR Information for SAS Teachers. Retrieved February 05, 2017, from https://sites.google.com/site/lrtsas/differentiation/5-preassessment-ideas

University, C. M. (n.d.). Assessing Prior Knowledge-Teaching Excellence & Educational Innovation - Carnegie Mellon University. Retrieved February 05, 2017, from https://www.cmu.edu/teaching/designteach/teach/priorknowledge.html


Sunday, February 5, 2017

Developing Smart Objectives


Loading...
Loading...

How to unpack a standard


Positive Behavior Intervention and Support


Loading...
Loading...

De-escalating Aggressive Behavior


Setting High Academic Expectations

Gradual Release of Responsibility Application


Establishing Norms, Rules and Procedures


Lesson Plan Mobile Activity - Part 2


Mobile Learning in the IBDP CS Classroom.

Workshop Date and Time: Wednesday and Friday, October the 12th and 14th.
Location: Private Bilingual International School, Beijing, China.
No. of Students: 7
Audience Description: The lesson was designed and taught to 7 students from ages 16 to 18, taking the IBDP Computer Science course in their 11th grade year.  This particular group of students even though small, comes from very different backgrounds and bring an interesting multicultural experience into the classroom.  Among the 7 students there are 5 nationalities and 3 continents represented, various socio economic situations, and learning styles and capabilities. 4 out of the 7 students are new to the school, and have been sharing with each other for less than 2 months to the date of the lesson.

Preparation:

For the activity I researched about Mobile Learning first as part of the previous unit for this module.  After that, I looked into my planning for a learning objective that was suitable for being taught utilizing a mobile learning experience.  From there, I started the design and preparation of the lesson as described in the following documents:

Procedure:

1.           Previous to the lesson:  I tested the app myself initially and prepare the materials (examples and ppt) that I was going to use with my students.  I distribute the groups based on English language abilities and devices capacities of the students to try to ensure a positive work environment as one of mi side objectives for this activity was to build relationship among my students, particularly the new ones.  I prepare all the required materials as described in my lesson plan.  I also requested the students to download the Aurasma app on their cellphones and send them the link on our chat group.
2.           Lesson 1:  The activity was developed in 2 sessions, during the first one, I introduced the topic, and the 5 terms my students needed to review or learn for this objective.  I created 3 playing cards per word; one with a picture, one with a definition and one with the word, and asked them to play by placing an initial card and asking the others to try to place the cards that should go together.  At the end of the lesson, each student had a clear understanding of the definitions.  For the second part of this class, students were shown an example video of the purpose of the Aurasma app, and were explained about the virtues of the augmented reality technologies.  They were then asked to play with the app, and to try to create their own Aurasmas in preparation for the real project they were going to develop on the next class.   Minutes 9:39 to 10:35 of the video provided in the evidence part below, show moments from this playing experience.
3.           Lesson 2:  The following class, students had a review session on the concepts covered, and were introduced to the specifics of the project they were going to develop.  This part of the activity was then recorded as shown in the first 9:39 minutes of the evidence video.  Students then had the remaining 40 minutes of the lesson to work on their Aurasma project.  The time wasn’t sufficient for the reflection section, which was then assigned as HW to the students.

Key Take Away Points:

·             The lessons were successful on its objective of covering the concepts with the students.  The students are effectively able to define and explain the concepts at the end of the experience.  This reminded me the importance of providing an opportunity for the students to own the terminology they need to learn.  CS is a subject with a vast amount of new and complex terminology, that is sometimes neglected simply because it is assumed to be obvious.  People tend to believe digital natives such as our students don’t need to be explained the concept of software, the reality is far from that.
·             Timing is everything.  My planning was extremely positive in the use of time, most of the feedback provided by students tells me they feel rushed into the lesson.
·             Digital gap is a reality everywhere and not only on third world countries or lower classes.  I have been assuming that my students were all privileged because they all have a cellphone and access to technology, but with this activity I experienced (unintended of course) the digital gap in my class when one of my student feel behind because he was the only non IPhone user.  I didn’t see that as a problem, until I read his reflection.  The app was slightly different, and he had trouble completing the activity due to this.  He wanted to use the IPad, but I insisted his cellphone was ok.  I felt terrible after I realized what had happened.
·             Planning goes a long way when it comes to improvising.  A structured planning, is the best way to be prepared for how different our lessons end up looking from what we were expecting in our heads.

Feedback:

Students used a standard reflection form that they have used in the past as a way to reflect on pieces of work that will then become part of their portfolio.  I asked students to include this project on their portfolios and to complete the form and submit it.  The following are some highlights from their reflections:
“I really enjoyed to use new technology and devices to create something fun and a part of our class as well. I have seen the connection between computer sciences and the real life application. Our teacher gave us this assignment to show the bridge between playing and studying in order to motivate our strong interest in this subject.”
“This was for me a challenging piece. Not because it was hard to do, but because I had so little time and I had to figure out what to do while I had low-battery, low wi-fi connection.  I haven’t worked with this app before, and I was the only one in the room that had an android OS so it didn’t work the same way as it did with my classmates. So I couldn’t just mimic their work.”
“This task helped me to learn to work with a partner. That means that we have to communicate with each other and make a good relationship with each other”
“I would choose it as an enjoyable [piece or activity] simply because different from any other courses’ homework I actually enjoyed doing the work. It was fun.”

Evidence:

The following link shows the lesson that was taught and scenes from my students working on the project as well as parts from the finalized products of their work.



PBL Lesson for ICT


Gamifying the TOK classroom


Lesson Plan - Mobile Activities.

Lesson Plan:  Aurasma Experiences on HW, SW and Network classification.

Topic: 
Students in grade 11 will create an Aurasma experience to show their knowledge about Software, Hardware and Network in computing systems for their IBDP Computer Science course. 

Objectives:

IBDP CS Assessment Statement: Define the term hardware, software, peripheral, network and human resource.

SMART Objective:
Each group of 3 students will create a virtual experience of three Auras using Aurasma and augmented reality for others to learn about the different types of HW, SW and networks in computing systems.


Specific:  To create an Aurasma experience (Augmented reality) to show the concepts covered by the unit.  The final product will be the specific result.
Measurable:  Quantity expectations.  Each student will be asked to create at least one Aura for HW, one for SW and one for Network.
Achievable: The students will learn and install the tool ahead of time, and they will have a specific set of material to be able to achieve the previously set goal of three auras per group.
Relevant:  Students will be able to define appropriately the concepts of HW, SW and Network at the end of the activity, which is the learning goal of the lesson.
Time-Oriented:  The activity is designed to be completed in the 2 class periods space.

Tools:
Students’ cellphones
Additional IPads
Students’ Laptops
Backup Computers
Color Printer
Other external HW (part of the computer lab)
Internet availability

Materials:
Broken Computer to Open Up.
Paper for printing

Resources:
Aurasma app installed in all devices.
Presentation or photo and video editing software in laptops or computers.

Preparation: 
Before the lesson day, students will be instructed to install the Aurasma app in their cellphones and bring them to class fully charged.  They will also be given access to material (reading) related to the classification of HW, SW and Networks in computer systems.  Students will be required to take notes prior to the class.
Teacher will prepare and example Aurasma experience for the students to see, and will create accounts for them as a backup for any issues they might encounter creating their own.
Backup IPads will be loaded with the App and registered with the accounts created.


Activities

1.          Students will be presented with the objectives for the lesson.
2.          Students will be presented with an example of the use of Aurasma and asked to create groups for working in teams of 2 or 3 people to create an Aurasma experience* that they will prepare in one of the classroom bulletin boards.
3.          Students will be asked to create 3 different Auras: 1 for HW classification, one for SW classification and one for network connectivity definition.
4.          Students will have access to an old laptop opened for access to internal pieces, and different external devices such us speakers, printer, etc. They will use pictures of the different part to create the Aura about hardware.
5.          Students can use Internet and video and image software editing to create the different images or links they will overlap in their auras.  The layers that will appear on top of the target are images explaining the different classifications of HW and SW and/or videos providing extra information in these topics.
6.          Students will print the target pictures created for their Auras and will organize them in a section of the classroom bulleting board, together with instructions for others to scan them using Aurasma.

* Aurasma is an augmented reality website and app that allows you to create augmented reality experiences.  This is, images, pictures or spaces than when looked through the camera of your cellphone and using the Aurasma app will have additional content popping up, that is not part of the physical picture being scanned (this is called a target picture). 

Backup plan: 
In case of device failure, sufficient additional IPads will be prepared.
In case of Internet failure, downloaded research resources will be provided, and students will be asked to create their layers, and putting together on Aurasma from home, or on a later date.

Evaluation and extension:
Students will use an evaluation rubric to provide peer feedback to the other 2 groups.



Sources (For mobile learning and smart objectives)

Smith, T. (2014). Writing Measurable Learning Objectives - TeachOnline. Retrieved October 02, 2016, from https://teachonline.asu.edu/2012/07/writing-measurable-learning-objectives/

Prensky, M. (2005). Shaping Tech for the Classroom. Retrieved October 02, 2016, from http://www.edutopia.org/adopt-and-adapt-shaping-tech-for-classroom

W. (2016). M-learning. Retrieved October 02, 2016, from https://en.wikipedia.org/wiki/M-learning