John Hattie calls on teachers to ‘know thy impact’. But what does this really mean?
Two of the most potent things you can do to improve student learning are to:
Or, in John Hattie’s words, to know thy impact.
When you know how far each of your students has progressed, you also know the impact your teaching has had.
How To Measure Impact
To know thy impact involves measuring progress, not A-E achievement. To do this, you need to use the basic pre-test/post-test format. You can use this format with any measurable assessment tasks. For example:
A student may:
The length of time between the pre and post assessments will vary with the nature of the learning.
How To Know If Thy Impact Is Enough
In the above examples, it is easy to see progress – the harder question to answer is whether that progress is enough. This is where the statistical measure of effect sizes is handy.
Effect sizes range from 0 to infinity, but most range between 0 and 1. After reviewing thousands of research articles, John Hattie found that the typical effect size of teaching is 0.4. That is, after teaching a unit on fractions, a pre-test/post-test should show progress of at least 0.4. If it doesn’t, the strategies being used by the teacher are not effective.
Effect sizes help you to know thy impact. Yet, there are limitations to using effect sizes, such as:
The next question is how do you work out effect sizes, especially when you are a busy teacher. There are statistical formulas you can use. Thankfully, there is also an Excel spreadsheet called the Progress vs Achievement tool that does it all for you. It only works though if you punch in data for a whole class or at least a group. Open it up and type in some dummy data get the idea – note just enter their score, not their score out of (e.g. 8 not 8/12).
The tool measures both achievement (think bell curve) and progress. I am only recommending the progress part.
Know Thy Impact & Adjust Teaching As Necessary
So, you now have data on your students’ progress. In other words, you know thy impact. What next?
What you do with your knowledge of your impact is what matters most.
If the effect size for the whole class is lower than 0.4 you need to think about why.
If you think it’s option 2, then explore options with a trusted colleague.
You then repeat the exercise for any individual students who have progressed less than 0.4.
Every time the effect is higher than 0.4 is a time for congratulations and celebration, as your approaches to teaching are working.
Shaun Killian is an experienced teacher and principal with a passion for helping students to excel. He believes that assisting teachers to adopt evidence-based education is the best way to make this happen. Shaun is committed to bringing you practical advice based on solid research.