Helping MATs make sense of their data

James Pembroke is the founder of the school data company, Sig+, and he’s written this very handy article to help Multi Academy Trusts make sense of their data.  

What are the benefits and risks of data collection in MATs?

Due to the nature of MATs, there’s a wide range of expertise that can be utilised to develop effective, common approaches to assessment. Decision makers are more well informed, so they can direct resources to where they’re most needed, and large numbers of pupils mean more reliable, meaningful data. The risk of data collection, though, is that it might lead to a top down, accountability-focused system of assessment that increases workload but doesn’t have much of an impact on learning. So, how can we make sense of all this data, and put it to good use?

Ofsted’s approach to measuring progress

Ofsted does not expect schools to predict progress scores – this is because they are aware that this information will not be possible to produce, due to the way that progress measures at both KS2 and KS4 are calculated.

The Ofsted Handbook states that “Ofsted does not expect performance and pupil-tracking information to be presented in a particular format. Such information should be provided to inspectors in the format that the school would ordinarily use to monitor the progress of pupils in that school.”

How can school leaders support the effective use of data to promote learning above tracking?

6 golden rules of tracking:

  1. Do not recreate levels
  2. Ensure that your tracking system is a tool for teaching and learning, not accountability
  3. Separate teacher assessment from performance management
  4. Do not compromise to fit the rules of a system
  5. Use systems to reduce workload, not increase it
  6. Measure progress, but don’t obsess over it

Reviewing workload

The performance of MATs is monitored, and senior leaders need to know how schools in the trust are doing. So that MAT leaders can spot areas of weakness and effectively direct resources, they must track attainment and progress of pupils, groups and cohorts in core subjects. To do so, they need quick access to robust data without increasing workload.

  • Be ruthless: only collect what is needed to support outcomes for children. Always ask why data is needed
  • The recent removal of ‘levels’ should be a positive step in terms of data management; schools should not feel any pressure to create elaborate tracking systems

In light of this article, what are the benefits of standardised tests?

Remember that Standardised scores are not the same as scaled scores.

  • Question level analysis
  • Benchmark against other pupils nationally
  • Validate teacher assessment
  • Provide a more robust progress measure
  • Give an idea of VA in advance
  • Test practice
  • Compare standards within and between schools
  • Reveal attainment gaps between groups

What should my trust level reporting system do?

  • Aggregate standardised test scores (and comparative judgement data)
  • Show progress of cohorts and key groups year-on-year
  • Track attainment gaps between groups, particularly disadvantaged/non-disadvantaged pupils
  • Compare schools within the trust
  • Provide changes in percentile rank (i.e. IDSR-style measures)
  • Take advantage of MAT numbers to calculate statistically significant shifts in data
  • Standardise non-standardised test data

What 3 questions should I ask before collecting data?

  • Who is it for and why is it needed?
  • What impact will it have on learning (and workload)?
  • Is it reliable and comparable?

 

If you’d like to receive all of our assessment blogs direct to your inbox each month, select “Assessment” as your preference in your My Rising Stars account. Not signed up for a My Rising Stars account yet? It’s free (no card details required), quick and easy and you’ll gain access to hundreds of free curriculum units and assessments to use with your class.

Looking for termly, standardised reading, maths and GPS tests with free reporting? 
Take a look at our PiRA, PUMA and GAPS tests.

Reception baseline assessment: What schools need to know

On 6th June 2018, the DfE released information about the introduction of the new reception baseline assessment in autumn 2020.

Why is the reception baseline assessment being introduced?

The new assessment will provide a snapshot of where pupils begin when they arrive at school, which will then be used to measure the progress they make by the end of Year 6.

Continue reading →

2018 Key Stage 1 Scaled Score Conversion Tables

On 1st June 2018, the DfE released the scaled score conversion tables for the 2018 KS1 national tests.

Range of scaled scores

The range of scaled scores available is the same as set in 2016.  Pupils scoring at least 100 will have met the expected standard and a pupil awarded a score of 99 or fewer has not met the expected standard.

  • The lowest scaled score that can be awarded is 85
  • The highest scaled score that can be awarded is 115

Continue reading →

Key Stage 1 National Test materials

On 1st June 2018, the DfE publicly released the test materials from this year’s Key Stage 1 National Tests.

The test papers and mark schemes for all subjects can be found here:

The Year 6 SATs are over, so what next for Year 5?

Thanks to Ruth Duckworth, Year 6 Teacher/Writing Lead at Christ Church C of E Primary School, for this really insightful piece full of handy hints and tips for transitioning your Year 5s into Year 6.

The Year 6 SATs are over for another year; writing pieces will soon complete the end of Key Stage 2 assessments and many staff will breathe more easily for a few weeks – until ‘data day’ in early July. So, many of you will be thinking about the next cohort to come into Year 6.

Transitioning from Year 5 into Year 6

Current good practice in many schools sees Year 5 pupils starting to work with their soon-to-be Year 6 teachers before the summer break. There may not be much of a break for teachers fresh from SATs cramming in the core subjects, but when the Year 6 teaching year is not ‘a year’ (with SATs in May), making accurate teacher assessments this summer term is vital.  Also, the building of close working relationships with pupils now, ready for September, can certainly be of great benefit for staff and pupils alike. In our case, Year 5 is a much more challenging cohort of pupils than the one we taught this year, both in terms of academics and behaviour. For the first time, we feel it necessary to greatly extend our usual ‘move-up day’ plans.  We scheduled end of Year 5 summer term assessment tests in late May, so we are now able to have a six-week block of consistent teaching and gap filling for Year 5 pupils in June and July. Our strong Year 6 staff team will be largely based in Year 5 in the mornings, from immediately after the half-term break.

Continue reading →

Key Stage 2 National Test Materials

On 29th May 2018, the DfE publicly released the test materials from this year’s Key Stage 2 National Tests.

The test papers and mark schemes for all subjects can be found here:

 

SATs 2018 Round-up: surprises, challenges and lessons-learnt

Thanks to Tennyson Road, Christ Church CE Primary, and Medmerry Primary school for sharing their reactions to the 2018 SATs. 

How did you find the SATs this year?  Tweet us your thoughts on this year’s tests @RSAssessment

Tennyson Road Primary School

“Thanks to Rising Stars resources, our children were well prepared and took on the challenge with enthusiasm” – Carla Gotch, Tennyson Road Primary School

‘I really enjoyed that Miss!’ was the cry from Kestrel class after closing their final paper on Thursday Morning. A smile creeping across my face. If nothing else I had done my job right! 30 happy children all confident and enjoying SATs! Or maybe that was just the SATs breakfast they had each day… Continue reading →

Interim Pre-Key Stage 2 standards

On 24th May 2018, the DfE released the 2018/2019 Pre-Key Stage 2 standards teacher assessment frameworks.

From the 2018/2019 academic year onwards these pre-key stage standards must be used to make statutory teacher assessment judgements for children working below the national curriculum tests at the end of KS2.

Continue reading →

What does active assessment look like in Primary schools?

Far too often, assessment is divorced from teaching and learning because it is a relatively passive experience. 

Thanks to John Dabell, trained teacher and former Ofsted inspector, for the following article.

Assessment makes a significant difference to learning, especially when children are actively involved in their own learning, when assessment is an essential part of the learning experience and when assessment boosts self-esteem and motivation.

The first and most important principle of learning is that children are engaged in the process. Assessment isn’t done to children but with them as an active process.

Continue reading →

What does effective assessment look like in primary maths?

A good test isn’t just a summative experience – it is also packed with rich formative opportunities.

Thanks to John Dabell, trained teacher and former Ofsted inspector, for the following article.

Effective assessment in maths is all about team-work and joined-up thinking. It doesn’t stand alone or parade data like a pedagogical peacock.  Instead, it links together teaching, learning and assessment in a creative and integrated fashion, so that teaching promotes learning, learning enables assessment to take place and assessment acts as a stimulus to both teaching and learning. Continue reading →