A Self-Assessment of this Semester

This summer has been spent thinking about assessment and more importantly, how to assess my students in a way that benefits their overall learning the most. I started this summer by posting three thoughts about assessment, and I have returned to those thoughts every couple of weeks. Now, as the summer draws to a close and I am preparing for the start of a new year I have an updated, reworked, perspective on assessment. If you would like to read that first blog post you can find it here.

Having completed the work focused on assessment I have three new ideas. First, my feedback should result in students understanding their learning more deeply. Second, it is critical that I allow my students to assess their own work and the work of their peers. And third, the assessments I give should work together to give an overview of how student learning has developed over time. Some of these ideas are similar to my original three beliefs, but I feel my assessments in this new year will be more beneficial to my students than they have been previously. 

In the first iteration of my beliefs about assessment I stated that “assessment should not be final,” but I have adjusted that thought to look more at how my feedback affects students’ overall learning. This allows for the possibility that an assessment can be final, but still emphasizes the importance of my feedback, specifically emphasizing that my feedback leads to the next possible learning step (Hattie & Temperly, 2007). Nicol and Macfarlane-Dick (2006) explain how critical it is for both the student and the teacher to have a shared understanding of the objective and how the student’s work is aligned with that objective. My feedback is an opportunity to align the objective and the student’s work when a student does not perform well, and then provide an opportunity for that student to make a new attempt at demonstrating their learning. But just providing feedback is not enough; after students receive feedback and additional instruction, they need an opportunity to demonstrate their new learning. Sams and Bergmann (2013) give students multiple opportunities to retake an assessment if they are unhappy about their performance. With quality feedback, and multiple opportunities to demonstrate new learning assessment is not punitive, and ultimately supports overall student learning. While I still agree that assessment should not be final my work this semester has proven how critical it is that my feedback supports, encourages, and guides student learning so that when they are given the chance to retake an assessment they understand what they got wrong the first time, why they got it wrong, and how to fix it next time. Just giving students a chance to retake an assessment is not enough, my feedback has to serve as a support for their ongoing learning.

My second belief is that a student’s self-assessment is critical. This is the evolution of my prior belief that students should be involved. I think the root of each of these statements is the same, but I feel it is necessary that my focus shift from thinking the student only needs to be involved in the outcome of their assessment to the student being responsible for the assessment itself. This self-assessment begins by students being able to explain what they are doing, why they are doing it, how their work will help them, and ultimately how they will show they have learned the intended lesson (Wiggins & McTighe, 2005). If students are not able to explain those elements of their work then they will not be able to assess that work. To support their understanding of why they are doing work and how it will help them adding reflective journals and self-reflection is important to the overall body of assessment as Shepard (2000) argues, and supports as simply being good teaching practice. Reflective journaling gives students the chance to think through the work they are doing and demonstrates to me their understanding of the work. It provides additional context for my assessment and extends the data I am able to collect about their overall learning. As a starting point, students need to learn how to assess the work they are doing, but starting with self-assessment might not be the most effective introduction to this process. Nicol and Macfarlane-Dick suggest introducing students to self-assessment by allowing them to assess their peers’ work first. This provides some separation from the work itself and begins to teach the students to be objective about the quality of the work. 

My third belief about assessment is a complete departure from the first draft of these three beliefs. Previously I explained that assessment should inform me as much about my performance as a teacher as my students’ performance on the assessment. And while I should still consider how well I explained and taught the material, that is not one of the most important considerations of assessment as a whole. It is more important that the assessments I give fit together as a larger body of work to demonstrate student learning. One assessment is not enough to demonstrate a student’s successful mastery of new content or to determine their failure to master that content. However, taking diverse work samples, like a student portfolio that allows for larger reflections about a student’s growth and their strengths is a better assessment of their performance (Niguidula, 2005). And there are great benefits for students when their work is a part of a portfolio as well. Black and Wiliam (1998) explain how students can be more motivated when their work is a part of a portfolio that emphasizes growth rather than singular summative assessments. A portfolio supports student learning and encourages more meaningful feedback because student growth is the focus rather than a grade at the end of an assessment. Additionally, when students work to create a collection of work it can provide a context for their learning. I remember cramming for tests in high school and college then quickly forgetting everything I committed to short term memory. I had no context for the learning and spent my time simply memorizing facts that meant very little to me. It is important that students understand the context of their learning, especially as they move from my elementary classroom to middle and high school classrooms. Reading assessments so often focuses on answering questions about the words in a story without considering the context of those words. Gee (2003) uses the example of a basketball player dribbling up the court with two fingers raised. While a reader might be able to answer a question about what the player is doing, or how many fingers he raised, if the reader does not understand basketball and the strategy that is involved in calling a play then the actual meaning of that sentence is lost. Building a portfolio of work over time, and reviewing that portfolio periodically can give more context to the assessments students complete.

The biggest change came in my third belief. Throughout the semester the readings I completed, and the work that went along with them, did not support the idea that assessment should serve as an indicator of my performance as a teacher. While I think I should consider my role in student performance, that is not one of the most important parts of assessment as a whole. I have not used portfolios consistently enough through my career for them to come to mind as I created the first list of beliefs, but after reading multiple authors talk about how beneficial they can be, and reflecting on the few times I have successfully created portfolios of student work, I think this is an important addition. The focus on growth is my favorite part of portfolios. Encouraging students to continue working to improve their previous scores has always felt like an uphill struggle, but I think implementing a primarily summative assessment method made that work feel defeating to students. If the assessment method encouraged growth then my additional encouragement would support the purpose of the assessment (this idea has been growing from early this summer). Additionally, I am more convinced of the importance of students having the time to reflect on their learning. Last year my principal pushed for more reflective writing as an ordinary part of student’s daily work. I tried to build it in periodically, but I did not see the benefit and frequently pushed that part of my lesson plan to provide more time for in class practice. After seeing the research that supports having students reflect on their learning I regret not devoting more time to student reflection, even in a math classroom. My work this summer has convinced me that students will retain their learning more after reflective assessments, and I will have a better understanding of my student’s learning when I read those reflections. And my work on a formative assessment has helped me implement some of the benefits that technology allows for when providing feedback. In that Twitter thread I talk about the importance of students being able to read and write in order to make effective use of some of the affordances in Google Docs, but using Flipgrid makes it so much easier for an elementary student because both the student and I can record our message without having to type it out and then read it. 

I am sure it is not a coincidence that the two most influential assignments this semester were designed to be completed in three iterations with feedback provided frequently. The Assessment Design Checklist has helped to solidify these three beliefs about assessment. While an assessment may not hit all five of my questions, it is a good guide to help determine how effective an assessment I am planning to use might be. And if an assessment does not most of those questions the ADC serves as a guide to determine what additions or alterations might be needed to make an assessment more meaningful. As I prepare for the start of a new school year I am excited about introducing numberless word problems through the Formative Assessment Design I created. This ongoing assessment is an ongoing body of work designed to demonstrate student growth over the course of the semester and respond to student needs as they are apparent through their work. Each day students record a quick assessment of their own work, and compare it to the assessment of a peer’s work, and it allows me to provide feedback to students then give them a chance to demonstrate their learning after receiving that feedback. The development of these three beliefs informed the creation of my FAD. Recently, I worked on creating a game that could be used to assess my students focused on the events leading up to the American Revolution. That assessment is still very much a work in progress, but as I designed the game I tried to link the frames so that an “incorrect” response would lead the player to a screen with feedback attempting to point them back in the right direction. I am still working on how I might better incorporate student self-assessment and reflections, but for now, having a tight feedback loop is a good start. 

This course was a great course for me this summer. I needed the space to really think about assessment and work through so many different iterations of my own work to come to a more solid understanding of what assessment is. That would have been more challenging during a semester. I would have tried to implement ideas that were not fully formed and the eventual undesirable outcomes would have been disheartening for me. Having the time and space to really work through what I think about assessment and how I can alter my practice has been good for me, and more importantly, it will benefit my students this year.

 

References:

Black, P. & Wiliam, D. (1998). Assessment and Classroom Learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7-74.

Gee, J. P. (2003). What video games have to teach us about learning and literacy. New York, NY: Palgrave Macmillan.

Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112.

Nicol, D., & Macfarlane-Dick, D. (2006). Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education, 31(2), 199–218.

Niguidula, D. (2005). Documenting learning with digital portfolios. Educational Leadership, 63(3), 44-47.

Sams, A., & Bergmann, J. (2013). Flip your students’ learning. Educational Leadership, 70(6), 16-20.

Shepard, Lorrie A. (2000). The role of assessment in a learning culture. Educational Researcher 29(7), p. 4-14.

Wiggins, G. P. & McTighe, J. (2005). Understanding by design. Alexandria, VA: Association for Supervision and Curriculum Development.

 

(Re)Refining the Numberless Word Problems Assessment

At the start of every school year, I struggle to understand why so many of my students’ first thought when solving word problems is to simply pick a mathematical process and plug in the numbers provided in a word problem. I have tried to reason, beg, implore, and bribe my students into reading each word problem then stop to actually think about what that problem means. I’ve tried to encourage them to draw a picture or act it out, and as long as we focus on one isolated problem they successfully figure out what process the problem requires. However, that does not translate to a more formal assessment or even a problem they work independently just moments later! They slide back into the old habit of picking a process and plugging in the numbers. Then, I stumbled across numberless word problems.

The Purpose of this Assessment

When students are presented with a word problem without numbers they more naturally begin thinking about the events in the problem as though they were taking place in the real world. More simply, students have an easier time imagining the actions in the word problem when the numbers are absent, and when students can imagine the actions actually taking place they have an easier time understanding what mathematical function works best for that problem. Once students have a solid image of the actions in the word problem the numbers can be added back into that problem. My experiences with word problems lead me to believe that the numbers are the primary focus when students begin reading a problem. My goal is to shift their focus from the numbers to the situation being presented. 

The basic layout of the numberless word problem is broken down into four different slides (you can view this assessment here):

  1. The word problem with no numbers,
  2. The word problem with one number added in,
  3. The word problem with all of the numbers,
  4. And the complete word problem including the question.

Before students see any of the numbers in the problem (slide 1) I ask them to sketch a picture of the problem. This process helps students visualize the problem and talk about their thinking more effectively. After students sketch the problem each slide adds additional information (slides 2 and 3) to the problem slowly to give a more complete picture of the scenario. Initially, this protects students from being overwhelmed by too much new information at once; it gives them time to continue their thinking by checking how reasonable their first idea of the problem was. When students reach the final slide (slide 4) they should be prepared to solve the problem and justify their answer.

These assessments slow down student’s work and guides them into actually thinking about the math presented in each word problem. I believe most students struggle with word problems because they cannot imagine the problem in a concrete way, so they cannot set up the problem correctly,  rather than not being able to actually solve the problem itself. The numberless word problem is intended to teach students how to read a word problem and accurately set up math work. It assumes they are already able to solve the problem once it is set up.

Assessment Instructions for Learners

To help keep my thoughts organized I wrote out a full set of student instructions here.

Students will be divided into three groups with each group having five members. This will allow each student to work on one new problem each day of the week so that every member solves all five problems by Friday, and responds to the first video post for each of the five-word problems. 

For the first few weeks of this assessment, I will demonstrate how to record a Flipgrid video, title it correctly, and respond to the correct video until students understand how the process works. In time they will be able to do this naturally, but until they have worked through the process a few times I will guide them through each step.

The Links between Assessment and Instruction

Before students begin this five-day assessment cycle, I will introduce numberless word problems and the process I expect them to follow when solving them. The week before they are assigned the first full assessment I will solve two problems a day as a whole group where I work the problem with the class one step at a time and explain my thinking as I go. Based on my previous experiences students only need to see a few examples before they are ready to work a numberless word problem on their own. After two days of working problems together students are ready to solve these problems independently, so the following week will be the beginning of the full assessment.

The content of the first two or three cycles of these problems will be fairly basic (addition and subtraction in fifth grade should not cause any problems for my students), so I do not anticipate teaching any content through these problems. The first few weeks are targeted at teaching students to think through the process of solving word problems. After seeing student work on Monday, by observing their work moving around the room and watching their Flipgrid videos, I will be able to respond to common mistakes in my instruction the next day. Before students begin working on their numberless word problem on Tuesday, my instruction will be targeted at reviewing the process students should follow by working an example on the board. My work will include some of the mistakes I observed on Monday, and I will ask students to correct my mistakes as I work the problem on the board. And if there are students that seem to need more help than that I will meet with them in a small group before they begin working on their assigned problem, or even work the problem out with them to provide more support if that is what they need. 

After completing three weeks of this assessment cycle my focus will shift from the process of solving the problem to the content. The five assigned word problems will contain an assortment of content (addition, subtraction, multiplication, division, etc.) so I will respond to my students’ work at the start of the following week. Throughout the week I will record students’ responses to each problem so that I can collect data about each student’s understanding of the processes being assessed. At the beginning of the next week, I will design my instruction to respond to that data. If the majority of the class missed a division problem my instruction will be with the whole group to review word problems that require division to solve it. However, if only a small group of students needs that instruction I will plan to meet with only the students who solved the problems incorrectly. And after providing instruction in response to the data I collect the groups for the new week will be arranged based on the data I collected. For example, groups A and B might move onto a new set of problems focused on adding fractions, while group C reviews division word problems after receiving additional instruction in a small group.

Providing Feedback to Students

Ultimately, giving feedback to students that leads to them better understand the content is foundational to any assessment. I will be able to provide feedback in two ways, by responding to their Flipgrid posts and in-person meetings in the classroom. I think both methods of feedback are effective, but for different situations. A Flipgrid response seems to be the best option for responding to students who seem to get it. I will be able to quickly affirm a student’s correct work through a video response, and by uploading a screencast where I speak about a student’s work I can ask questions that introduce new ideas. This method of feedback leads students to “greater possibilities of learning” (Hattie and Temperly, 2007). When students demonstrate that they understand the process and the content of the questions my feedback can begin leading them to the next thing. Responding to their work through a Flipgrid response will be ideal as it is individualized based on their level of understanding. 

Meeting with students in-person, whether individually or in a small group, is best saved for responding to incorrect student work. Nicol and Macfarlane-Dick (2006) explain that feedback intended to help students understand their mistakes and then troubleshoot their own work is a critical component of meaningful feedback. Responding to the students either individually or in small groups based on common mistakes allows me to provide that sort of feedback. Gathering data through observation and viewing Flipgrid videos will give me the data I need to determine which method of feedback is best for each student, and then plan instruction based on those needs. 

Integrating Technology

Using Flipgrid for these lessons might be a time-consuming process, but it serves a couple different purposes. First, it supports students’ conversations about their work with each other. I will have to teach this process at first, but after the first few weeks where the process of this assessment is the primary focus, students should begin to understand how to explain their own work and respond to their peers’ work. Flipgrid allows students to review their videos and redo anything they are not satisfied with. And because they can rewatch videos that are already posted they have a chance to really understand how other students solved the problem they just worked on. Additionally, if two students solve the same problem in a different way I can take their videos and use them as an example of how a problem might have two different, but equally correct, solutions.

I also benefit from using Flipgrid in these lessons. It is difficult to speak with each student often enough to really understand their thinking in the time I have with them each day, but using Flipgrid extends that conversation beyond the scheduled school day. I can review student’s posts to get a better understanding of how they are thinking about their work and I can group them more accurately because my data goes beyond correct and incorrect answers. My feedback can be targeted at how they are thinking about their work so address different thinking which might result in the same incorrect response.

Resources:

Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112.

Nicol, D., & Macfarlane-Dick, D. (2006). Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education, 31(2), 199–218.

 

Lost in France

I am getting ready to play through a classmate’s Twine game. His game is designed for use in an introductory French class, and after reading through his description of the game I am preparing myself to “lose” this particular game. It may not be designed to be a game with a winner and a loser, but I’m likely going to lose anyway with only the most basic understanding of the French language. 

Throughout the game there is a solid mixture of English only answer choices and french only answer choices, I was able to work my way through the game with the English answer choices pretty successfully. The most surprising thing about this game is how quickly I found myself picturing my high school language classroom as though this game were actually being played out in my reality (though I took Spanish in high school). I expected to feel completely lost playing this game, and only make progress after narrowing down incorrect answers, but the design of the game provides feedback in a way that makes it easy for the student to understand their mistake as they play. The slide following an incorrect answer gives feedback to the player explaining the mistake made and supports the correct answer without overtly answering the question for the player, so I was able to correct my mistakes even with no previous instruction. 

The game does require the player to have a basic understanding of the french language to really feel confident playing through. I guessed and used as much of the context as I could to work through each slide, but with previous instruction, the review of this game seems to be intended for would be great. It is pretty easy to understand if you got the answer correct or not based on the slide following your answer. If the previous answer choice was correct the game continued with a new action, and if you were incorrect the player found themselves looking at the rest of the class doing something different or a slide giving a more detailed explanation of what should have been done before. The primary consequence of not understanding a slide was being redirected back to that slide after getting a little more information. It seemed that extra information was at most two slides, so the player was back at the question quickly.

I really enjoyed this game, and the use of gifs was an enjoyable part of each slide, even if they were just there to make the gameplay more enjoyable. I was surprised by the amount of environment I was able to pull from the game, but that might be the product of playing language-based games where it is my responsibility to image the environment as a player. 

Based on the Assessment Design Checklist I created early this summer, this would be an effective assessment in a classroom. It is clear the game is aligned to the curriculum, and by adding a question on a Google Form like the author indicated in his original blog it would be easy to determine if the students understood the purpose of the game as an assessment. Teacher feedback is complicated with a Twine game because you are not able to easily track a student’s progress through the game. However, I think adding the Google Forms would help the teacher understand how a student is progressing and where they are having difficulty. It might be as easy as having a student answer a single question after an incorrect response to indicate which slide gave them the most trouble. The last two points in my ADC look at how an assessment fits into the larger framework of a student’s work over the year as well as material outside of that classroom’s curriculum. Adding something from French history would allow for cross-curricular connections to be made in the game, and it seems that the introductory vocabulary could still be built into the game. Perhaps the player could be a member of a military advisory panel for Napoleon and they would stand and raise their hand in salute when he entered the room. Then the slides could progress to explain a historical event while students practice with the vocabulary. 

As it is, I think this game is designed very well, and it is easy to understand how to play even with a very limited understanding of the language. If anything were to be adjusted, I might suggest giving less help following an incorrect answer so that the student has a chance to really think about why their answer was incorrect, but that might not be helpful in the long run. Having never taught a language it might be better for the student to know right away what their answer should have been.

This french lesson felt like a great way to experience high school language all over again. I cannot claim to understand any french, but this game was designed to support the student and there is feedback built into the basic design. Well done.

 

Spinning up a Twine

Some of my favorite lessons over the last few years were built around a role playing campaign similar to role playing games like Dungeons and Dragons. One of these lessons focused on elements of fictional stories. Students worked in small groups to create a character that played a role in the story, and as we played the game as a class, we could have a discussion about the features of a fictional story. Because students were actively engaged in the story they felt the tension of rising action and the relief that comes with the conflict’s resolution.

Teaching history to elementary students is challenging, in part because they have such a limited ability to relate personally to lessons that should be learned from the historical stories they are told. For example, they might be able to explain what happened at the Boston Tea Party, but would not be able to explain why a national government might expect strong opposition if it were to heavily tax an item consumed by a small portion of its population. These lessons are more easily understood through a game where students assume the character in the historical story and “experience” that story so that the lesson is more relatable.

To build on the idea of using games as a form of assessment, I am looking at the events that led up to the American Revolution and how I might teach that portion of history to my fifth-grade class next year. This is the context of my game (or the Semiotic Domain I am working within) where students will demonstrate an understanding of the internal and external grammar related to this context. For students to be successful in this game they will need to understand the events that led to the American Revolution (the internal grammar) and then apply those ideas to the situation they face in the game. After completing the game students will complete an open ended reflection where they report on the events of the game as though they were a historian. They will be asked to explain the situation that the miners faced as they moved from their home, the dangers of living in a new area, and the pressure placed on the mining community because of those dangers. Students will explain why the mining community requested help from the leader of their home community, as well as the frustration the miners felt at being forced to pay for that help. This work will imitate the work of historians who explained the events that led to the American Revolution. The final question on this assessment will ask students to compare their experience in the game to the events that caused such frustration for the colonists.

 

The Game

The game will be set in a fantasy world where people are ruled by a distant leader (Elder Gregor) and work jobs like cutting wood, mining, and farming. The character is a miner who has just received news that he, and his fellow miners, will be moved to a distant part of the kingdom to continue mining. In order to support the farmers and woodsmen, the mining community will be forced to pay a “distance” tax due to the increased cost of transporting the stone and metal they mine, as well as the food and building materials they will require. Here the characters will begin making choices about how to respond.

The decisions they make will be similar to those of the original colonists. They might begin by accepting the taxes and continue working until the financial pressures become too much for them to tolerate, or they might rebel and refuse to pay the tax from the beginning. Their choices will have an impact on the kingdom and the king will respond. The conclusion of the game will allow the character to make a series of demands of the king to work out a compromise that each side can live with. These compromises will be based more on the external grammar of how a government and its people relate to each other.

This game is not the entire assessment of the events that led up to the American Revolution, but only a part of it. Leading into the game students will have been assessed on their knowledge of the actual events in American History and the results of those events. And following the game, they will respond through a reflective assessment to the similarities and differences of the Colonists with the miners. The game provides an experience aimed at helping students understand the context of the events that preceded the American Revolution. 

Earlier this summer I worked to create this five question assessment checklist to determine how effective my assessments are. As an assessment, this game addresses, at least in part, all five of the questions on the checklist. The purpose of the game is tied to a real world situation, and the objective should be clear as it will be explained in the context of the lessons focused on the events that led to the American Revolution. Allowing for each player to make choices based on their understanding of those events checks for student’s understanding of the objectives I taught in the previous lessons, and since each of those choices leads to a new “event” in the game I am able to provide feedback based on what happens in the game. As this game does not allow students to fully explain the details of this historical period it will have to be a portion of a larger collection of work, that together demonstrates student’s complete understanding. And in order for students to complete this game successfully, they will have to transfer their prior learning into the decisions they make within the game.

Students are faced with a few decisions, but the game really begins to imitate the events the colonists faced when the student asks for aid from Elder Gregor. The player has to decide if they will take the aid and the increased financial pressure that comes with it, or try to protect themselves. The game tells students that the miners will have to pay, house, and feed the army. This is just like the quartering act the colonists faced. And in their reflection students will explain the pressure this would put on the miners and compare that to the colonists. 

After players view the video of the voice mail the colonists left King George, the game would continue by having them decide what their frustration is in order to send a letter to Elder Gregor. They are faced with four choices of what might be frustrating the miners, only one of those choices is similar to the frustrations the colonists felt. This section of the game acts as a quick assessment  with the three incorrect answers leading back to the assessment question, and having the student raise their hand so that I can speak with them. This lets me know what the student is thinking and have a quick conversation with them, so that I can provide immediate feedback and correct any misunderstanding that student might have before moving on. Additionally, if I notice a large section of my class missing the same question I can make a note of the question giving them the most trouble and discuss it at the conclusion of the game. Though I am not able to pull data from my students’ responses as though it were a Google Form, I can observe and give feedback to their responses in the in-game assessment.

As students continue they will be faced with more choices set up similarly to this one, so that I can assess their understanding while they are playing the game. One benefit of this format is that a wrong answer is redirected back to the original question, and the student is given another opportunity to answer correctly after receiving feedback from me. Before students complete their reflection of the game I have the chance to speak with them about their choices as a mining community. The reflection continues this assessment by asking them to transfer their experience in the game to explain their understanding of the events the American Colonists experienced. 

The information I gather through these assessment points will give me the data I need to direct future lessons. In the days following the game I will be able to either group students based on the questions they responded incorrectly to, or lead a whole group lesson focused on a question that most of the class missed. And when combined with the reflection questions completed at the conclusion of the game I will have a clear picture of what students understood, and where they still need instruction.