--- title: Understanding Effect Size description: What is effect size, and how is it used in schools for learning analysis? image: https://blog.trackonestudio.com/hubfs/analytics-1.png --- [![TrackOne Studio logo](https://blog.trackonestudio.com/hubfs/Group%207997%20(1).svg "TrackOne Studio logo")](https://www.trackonestudio.com/) - [Features](https://www.trackonestudio.com/features) - [Integrations](https://www.trackonestudio.com/integrations) - Resources - About Us [![Book a Demo](https://no-cache.hubspot.com/cta/default/20965311/3a4f7c15-483e-4f28-9ebc-ae29a23a3c75.png)](https://cta-redirect.hubspot.com/cta/redirect/20965311/3a4f7c15-483e-4f28-9ebc-ae29a23a3c75) [![Trial Now](https://no-cache.hubspot.com/cta/default/20965311/858df546-7789-4163-8b1d-68e8beac3f42.png)](https://cta-redirect.hubspot.com/cta/redirect/20965311/858df546-7789-4163-8b1d-68e8beac3f42) [![Book a Demo](https://no-cache.hubspot.com/cta/default/20965311/3a4f7c15-483e-4f28-9ebc-ae29a23a3c75.png)](https://cta-redirect.hubspot.com/cta/redirect/20965311/3a4f7c15-483e-4f28-9ebc-ae29a23a3c75) [![Trial Now](https://no-cache.hubspot.com/cta/default/20965311/858df546-7789-4163-8b1d-68e8beac3f42.png)](https://cta-redirect.hubspot.com/cta/redirect/20965311/858df546-7789-4163-8b1d-68e8beac3f42) ![Group 7999](https://blog.trackonestudio.com/hubfs/Group%207999.svg) [View All Features](https://www.trackonestudio.com/features) ![Group 8003](https://blog.trackonestudio.com/hubfs/Group%208003.svg) ##### [Student Dashboards](https://www.trackonestudio.com/features#student-dashboards) View a holistic summary of an individual student. ![Group 8028](https://blog.trackonestudio.com/hubfs/Group%208028.svg) ##### [Class Summary](https://www.trackonestudio.com/features#class-summary) Give teachers access to an overview of all students in each of their classes. ![Group 8031](https://blog.trackonestudio.com/hubfs/Group%208031.svg) ##### [School Data Analysis](https://www.trackonestudio.com/features#cohort-analysis) Make more informed decisions using reports on year level, subject, or department data. ![Group 8019](https://blog.trackonestudio.com/hubfs/Group%208019.svg) ##### [Trend Analysis & Notifications](https://www.trackonestudio.com/features#trend-analysis) Identify at-risk students and automatically notify relevant staff using configurable rules. ![Group 8029](https://blog.trackonestudio.com/hubfs/Group%208029.svg) ##### [External Results](https://www.trackonestudio.com/features#external-results) Store, analyse and publish academic data from external providers such as NAPLAN and ACER. ![Group 8032](https://blog.trackonestudio.com/hubfs/Group%208032.svg) ##### [Attendance & Behaviour](https://www.trackonestudio.com/features#attendance-behaviour) Monitor attendance and behaviour to identify any trends or changes over time. ![Group 7999](https://blog.trackonestudio.com/hubfs/Group%207999.svg) ##### [Student Wellbeing Surveys](https://www.trackonestudio.com/features#student-wellbeing) Visualise wellbeing data and track how students are feeling over time. ![Group 8030](https://blog.trackonestudio.com/hubfs/Group%208030.svg) ##### [Student Goal Setting](https://www.trackonestudio.com/features#student-goalsetting) Provide a customised goal setting structure for students to create and track individual goals. ![Group 8033](https://blog.trackonestudio.com/hubfs/Group%208033.svg) ##### [Extra-curricular & Soft Skills](https://www.trackonestudio.com/features#extra-curricular) Record, track and evaluate skills gained from extra-curricular activities. ![Group 8021](https://blog.trackonestudio.com/hubfs/Group%208021.svg) ##### [Student Awards](https://www.trackonestudio.com/features#student-awards) Digitise your awards process, replicating your school’s existing award rules and parameters. ##### [Academic Blind Spots](https://info.trackonestudio.com/academic-blind-spots) How aware are you of your academic blind spots? Explore how fragmented, delayed, or inconsistent data may be holding you back! ##### [Attendance](https://info.trackonestudio.com/attendance-analysis) Analyse your attendance data with context-rich insights that support early intervention and help students achieve their goals. ##### [Blog](https://blog.trackonestudio.com) Stay up to date with industry news and best practices. ##### [Readiness Check](https://info.trackonestudio.com/readiness-check) Assess your school's readiness for TrackOne Studio with this handy checklist. ##### [Streamline External Results](https://info.trackonestudio.com/streamline-external-results) See how the Learning Analytics Suite brings your external results data in one place. ##### [Learning Analytics Mythbusters Quiz](https://info.trackonestudio.com/learning-analytics-mythbusters-quiz) Discover the truth about K–12 learning analytics through this interactive quiz! ##### [Contact Us](https://www.trackonestudio.com/contact-us) We love to chat! Get in touch with a team member here. ##### [Services & Support](https://www.trackonestudio.com/services) Access support, view available training sessions or contact the team. ##### [Frequently Asked Questions](https://www.trackonestudio.com/faq) Do you have questions about TrackOne Studio? We have the answers! # Understanding Effect Size What is effect size, and how is it used in schools for learning analysis? ![https://20965311.fs1.hubspotusercontent-na1.net/hubfs/20965311/analytics-1.png](https://blog.trackonestudio.com/hubfs/analytics-1.png) ### [Phillip Budd](https://blog.trackonestudio.com/author/phillip-budd) Published Aug 29, 2022 11:20:51 AM What is Effect Size? Effect size is a simple measure for quantifying the difference between two groups, or the same group over time, on a common scale. In an educational setting, effect size is one way to measure the effectiveness of an intervention. Effect size enables us to measure both the improvement in learner achievement for a group of learners AND the variation of student performances expressed on a standardised scale.  By considering both improvement and variation, it provides information about which interventions are worth having.       How can we use effect size? There are many ways to use effect sizes, including investigating the effectiveness of an intervention for a defined group of students, comparing the effectiveness of different interventions, and evaluating growth over time. **Example**:  A curriculum leader is using effect size to understand and estimate the impact of an approach to reading comprehension. To do this, they are comparing achievement scores using PAT R Comprehension (or equivalent assessment) for the same students over a year. In reviewing the school’s PAT R effect size results for the same cohort of students from Term 3 one year, to Term 3 the next year, an effect size of 0.49 is recorded, but effect sizes for individual classes are 0.86, 0.42 and 0.18 respectively. This indicates that more than the expected average progress is being made, and raises questions such as: - How well is what I am doing working for different groups of students each year and why? - What possible reasons could there be for some student or groups progressing more or less? - How does student progress compare with their achievement levels?   ### How is Effect Size calculated? Effect size is calculated by taking the difference in two mean scores and then dividing this figure by the average spread of student scores (i.e. average standard deviation\*). To be valid, the spread of scores should be approximately distributed in a ‘normal’ bell curve shape. See formula below: | Effect Size (ES) =  | Average of the post test scores – Average of the pre test scores | | --- | --- | | Average Standard Deviation\* | | *\*The average standard deviation in the above formula refers to the standard deviation for the pre-test and post-test data calculated individually, then averaged.*   ### How can Effect Size be used reliably? **Multiple measures are still required:** Effect size is only a single measure of progress and educators are encouraged to use multiple measures to reliably understand and replicate evidence of what works. It is difficult to draw any conclusions that an intervention is effective or ineffective using a single measure.   **Caution for all small sample sizes and at the individual student level:** Effect size for cohorts smaller than thirty are often not suitable for reliably estimating the impact of an intervention. John Hattie, author of *Visible Learning for Teachers: Maximising Impact on Learning,* suggests that care should be taken in the interpretation of any findings for small sample sizes, as outliers in student scores can skew the effect sizes and may require special consideration. Effect sizes derived from small sample sizes and individual student effect sizes should only be used indicatively by the teacher to answer questions such as: - What possible reasons could there be for why that group of students recorded these estimated effect sizes? - What will we do for students who are achieving at expected achievement levels but not the expected growth effect size? Interpretation of effect sizes for individual students is to be used with caution because we would expect larger errors in effect size at this level (refer to Appendix 1). Therefore individual level effects must always be used in addition with other reliable information and teacher professional judgement.   **Accuracy is enhanced when comparing the exact same group of students:** When comparing pre-test and post-test scores, it is most useful to ensure that all students are tested and that scores from the same group of students are compared. This enhances the accuracy and interpretation of the results.   **NAPLAN effect sizes cannot be compared equally:** NAPLAN effect sizes calculated for the Year 3-5 cohort should not be compared with Year 5-7 and Year 7-9 cohort effect sizes using the 0.4 average effect size interpretation. There are larger effect sizes for Year 3-5 than in Year 5-7 and Year 7-9. In addition, students at lower proficiency bands will tend to show greater gains than students in higher proficiency bands and care is needed for students that attain maximum or near maximum scores as it is difficult to show growth (due to this ceiling effect). It is recommended that NAPLAN effect size values only be compared over time for equivalent groups in the same school (e.g. Year 3-5), across statistically similar/like schools or with the corresponding state level effect size. Previous Post ###### [Ensuring Buy-in, Commitment and Trust with a Data Group](https://blog.trackonestudio.com/ensuring-buy-in-commitment-and-trust-with-a-data-group) Next Post ###### [How St Patrick’s College is Transforming Student Engagement](https://blog.trackonestudio.com/how-st-patricks-college-is-transforming-student-engagement) ### Similar Blog Posts [![](https://blog.trackonestudio.com/hs-fs/hubfs/Graphic%20Illustrations/training%20study.png?width=352&name=training%20study.png)](https://blog.trackonestudio.com/z-scores-and-stanines) #### [Z-Scores and Stanines](https://blog.trackonestudio.com/z-scores-and-stanines) [![data](https://blog.trackonestudio.com/hs-fs/hubfs/Data%20Detective-01.png?width=352&name=Data%20Detective-01.png)](https://blog.trackonestudio.com/becoming-a-data-detective-assessing-data-literacy-at-your-school) #### [Becoming a Data Detective: Assessing Data Literacy at your School](https://blog.trackonestudio.com/becoming-a-data-detective-assessing-data-literacy-at-your-school) [![](https://blog.trackonestudio.com/hs-fs/hubfs/connected-team.png?width=352&name=connected-team.png)](https://blog.trackonestudio.com/questions-to-ask-schools-in-your-network-about-how-they-use-data) #### [5 questions to ask schools in your network about how they use data](https://blog.trackonestudio.com/questions-to-ask-schools-in-your-network-about-how-they-use-data) Discover what **the Learning Analytics Suite** can unlock at your school. [Book a Demo](https://www.trackonestudio.com/book-a-demo) [Trial Now](https://www.trackonestudio.com/contact-us) [![TrackOne Studio](https://blog.trackonestudio.com/hubfs/Group%207997.svg "TrackOne Studio")](https://www.trackonestudio.com/) - ![ISO27001-2026-ROUND-CORNER](https://blog.trackonestudio.com/hs-fs/hubfs/ISO27001-2026-ROUND-CORNER.png?width=93&height=207&name=ISO27001-2026-ROUND-CORNER.png)   - - [tel:+61738316590](tel:+61738316590) [+61 7 3831 6590](tel:+61738316590) ###### [Features](https://www.trackonestudio.com/features) - [Academic Results](https://www.trackonestudio.com/features#academic-results) - [Data Analysis & Trends](https://www.trackonestudio.com/features#data-analysis-trends) - [Holistic Data](https://www.trackonestudio.com/features#holistic-data) - [Outside the Classroom](https://www.trackonestudio.com/features#outside-the-classroom) ###### [Integrations](https://www.trackonestudio.com/integrations) ###### Resources - [Academic Blind Spots](https://info.trackonestudio.com/academic-blind-spots) - [Attendance](https://info.trackonestudio.com/attendance-analysis) - [Blog](https://blog.trackonestudio.com/) - [Readiness Check](https://info.trackonestudio.com/readiness-check) - [Streamline External Results](https://info.trackonestudio.com/streamline-external-results) ###### About Us - [Contact Us](https://www.trackonestudio.com/contact-us) - [Services & Support](https://www.trackonestudio.com/services) © 2026The Alpha School System PTY LTD [Policy](https://www.trackonestudio.com/policy)