Nasty NAPLAN results: what should parents do next?

The latest NAPLAN results have arrived, and soon enough thousands of Australian parents will tear open the envelope containing their child’s NAPLAN results. They will be faced with a series of graphs that look a bit like mercury thermometers, with the health of their child in reading, writing, language…

Rr8hx756-1347593223
Bad NAPLAN results can lead parents to seek help, but which learning programs can they trust? Test image from www.shutterstock.com

The latest NAPLAN results have arrived, and soon enough thousands of Australian parents will tear open the envelope containing their child’s NAPLAN results.

They will be faced with a series of graphs that look a bit like mercury thermometers, with the health of their child in reading, writing, language conventions and numeracy represented by hovering black dots.

According to the results around 92% of Australian students are at or above national minimum standards. Their parents will be pleased to see their child’s dots sitting at the top of the thermometers, confirming that they are performing well. They can then relax and bask in the minutae of their son or daughter’s accomplishments.

But what about those parents that get a shock? What about those that see dots indicating that their child is performing below expectations for their year level in reading, and maybe even below the national minimum standard? What will these parents do?

Searching for answers

Most will probably get in touch with their child’s school. They will make an appointment with the classroom or learning support teacher. But many will also do some investigating of their own.

They might search the internet for: “How can I treat my child’s reading problem?” or “Is there a cure for reading difficulties?” And when they do, they will be bombarded with information and an enormous number of different reading treatment programs. All, of course, claim to be effective, at least for some children.

Many of the programs will explain how they are effective by using language that is heavy in scientific and technical terminology. Some may point to the “principles of neuroplasticity” that need to be understood in order to develop the “physical mechanism of learning”. While others claim to use computer science to “synchronise information and deliver it directly where it is needed”

One program called the Irlen Method states that it “corrects reading problems that are a result of a processing problem called Irlen Syndrome… This type of reading problem is result of the brain’s inability to accurately understand and process visual information.”

Another called the DORE program states it “has found the key to improving cerebellum efficiency is through our unique exercise programme… designed to kick-start the cerebellum and train the brain to speed up and automate the information flow.”

Evidence base

Some of the treatment programs will be supported by solid scientific evidence, with their efficacy established by controlled clinical trials. However, given the cost and difficulty involved in carrying out such trials, these treatments will be in the minority.

Others will not necessarily have been subject to a controlled treatment study, but their methods will be based on sound science. They may be quite similar to other treatments that have been subject to controlled trials and, as such, there might be some cause for confidence in their methods.

But others will have no scientific credibility at all.

The problem is: how can parents, or indeed teachers tell the difference between programs that are credible or effective, and those that aren’t?

Even well-educated people will find this extremely difficult to assess. I find it difficult and I have been working in the field for many years! Aside from the technical language, many of the sites provide lists of scientific articles to support the claims they make for efficacy. But only expert researchers are likely to have the background to assess whether these articles do in fact provide such support.

The average parent or teacher is left in a confused, frustrated muddle. I know because we receive calls from people like this to our research centre every week.

Reading regulation

What is needed, in my view, is some form of regulation. In some ways, the issues here are similar to those relating to complementary medicines such homoeopathic and aromatherapy products. The Therapeutic Goods Administration (TGA) regulates these kinds of products via the Australian Register of Therapeutic Goods (ARTG).

Complementary medicines may be either listed or registered with the ARTG, depending on the ingredients they contain and the claims that are made for them. Registered medicines pose potentially higher risk (for example containing ingredients known to be harmful to humans in certain circumstances) and are individually evaluated by the TGA. Listed medicines are of low risk.

But for both registered and listed medicines, it is a requirement that sponsors hold information to substantiate all of their product’s claims.

Regulation of reading treatment programs, and indeed of programs for other conditions such as autism and Attention Deficit Disorder, could work in a similar way. As most reading treatments, like complementary medicines, would be considered “low risk”, the regulation might be in the form of a voluntary listing process.

What’s needed

Developers of treatment programs could, if they chose, submit their programs to be included on a publicly-available register. This would involve providing details of the program and how it is administered, as well as any relevant scientific evidence or controlled trials.

The evidence would be evaluated by a panel of experts in the field. The Commonwealth Department of Health and Ageing has already set up eight Advisory Committees whose job is to advise the TGA. It would be relatively straightforward to set up an extra committee to advise on treatments for cognitive disabilities.

There could also be levels of listing to reflect different levels of confidence in the efficacy of a program. An A-Listed program would have been found effective in a controlled trial. A B-Listed program might not, itself, have been subject to a controlled trial, but it might be deemed similar enough in its methods to one that has been to be considered likely to be effective by the committee. Finally, a C-Listed program might be based on sound science, leading the committee to affirm that it has the potential to be effective.

Public guidance

If a parent or teacher looked up a program and found that it was not listed, they could conclude that either the developers of that program had chosen not to submit it for evaluation, or that they had submitted it but it had not been approved for listing as either A, B or C.

In time, I would hope that a register like this would promote the success of effective programs and hasten the decline of ineffective ones. It might encourage developers of such programs to be proactive in having their treatments externally evaluated.

But, most importantly, the next time a parent had a nasty NAPLAN moment, they would know where to turn.

You can follow @annecastles on Twitter.

Articles also by This Author

Sign in to Favourite

Want to follow The Conversation?

Sign up to our free newsletter to get the day's top stories in your inbox each morning, with a special wrap on Saturday.

Spinner
Become a friend of The Conversation and donate

Join the conversation

21 Comments sorted by

  1. James Jenkin

    EFL Teacher Trainer

    In my area of education and training there are some dodgy private training providers. And it's tempting to say we need more regulation to fix the problem.

    However, I'm not sure what goes on in the classroom in well-known, highly regulated schools is much better. (Or rather, I'm not sure what goes on in the classroom in unknown, less-regulated schools is much worse.)

    From my experience, good teaching is largely about recruitment and luck - basically, a school happens to find a great head of department, who in turn employs and mentors great teachers.

    Regulation and external quality assurance, on the other hand, seem to have little influence over teaching quality.

    report
    1. Anne Castles

      Deputy Director, ARC Centre of Excellence in Cognition and its Disorders at Macquarie University

      In reply to James Jenkin

      Dear James, I certainly agree that the kind of thing I am suggesting is no substitute for good teaching and good classroom practice. But, when things go wrong, parents go looking and it would be useful if they had more guidance. I also agree that heavy regulation isn't the answer - what I'm proposing here is something more like a voluntary register.

      report
  2. Kerry Ryan

    Postgraduate Student at Swinburne University of Technology

    There is an assumption here that the NAPLAN results themselves are an accurate account of a what a child knows (or can do) and that they actually mean something.
    Pity the child who had a headache on the day of the test(s) or didn't get enough sleep, or skipped breakfast, or flipped out during the test, and who on the strength of what's in the envelope is now subjected to a 'search for answers' from his/her obsessed parent(s).
    Perhaps when it comes to NAPLAN results parents should go with Rudyard Kipling and treat both Triumph and Disaster as the imposters that they undoubtedly are.

    report
    1. Anne Castles

      Deputy Director, ARC Centre of Excellence in Cognition and its Disorders at Macquarie University

      In reply to Kerry Ryan

      Kerry, I agree NAPLAN certainly shouldn't be the only indicator here. I used it as the basis for my piece because we always get a big spike in enquiries to our centre after NAPLAN results come out. But the problem of trying to sort out what reading intervention to trust exists no matter how the reading problem is identified.

      report
    2. Riddley Walker

      .

      In reply to Kerry Ryan

      My advice to parents is to take that envelope, unopened, directly from the mailbox to the recycling bin, where it belongs.

      report
  3. Anne Castles

    Deputy Director, ARC Centre of Excellence in Cognition and its Disorders at Macquarie University

    Dear James, I certainly agree that the kind of thing I am suggesting is no substitute for good teaching and good classroom practice. But, when things go wrong, parents go looking and it would be useful if they had more guidance. I also agree that heavy regulation isn't the answer - what I'm proposing here is something more like a voluntary register.

    report
  4. Linus Bowden

    management consultant

    There is a lot in this, but I'll stick to one point. At least since NAPLAN, parents actually have the knowledge to decide whether they need to do anything next, or to be comforted that all seems very well with their kids school and progress. In my experience, NAPLAN results are overwhelmingly used as diagnostic tools by parents, largely to validate suspicions they had about either particular issues with one aspect of their child's progress (for example, can't read, but seems comfortable and confident with Arithmetic or vice versa), or concerns (often only 'hunches') that a group of parents have developed about a particular teacher or school. I know of one Primary School, which was forced to put a broom through its Numeracy teaching, after parents' concerns were validated by NAPLAN results.

    If the schools don't respond, we already know what many parents will do. Transfer their kids out of the government schools to private schools.

    report
    1. David Zyngier

      Senior Lecturer Faculty of Education at Monash University

      In reply to Anne Castles

      Instead of taking their children out of public schools parents should be banging on the doors of the premiers and ministers of state education Australia wide who have cut funding to our government schools, ripped out the language and numeracy support staff and refuse to provide the necessary professional support to our public schools while continuing to siphon off money to the already privileged. Remember that 80% of children from low SES families attend public schools, of course these schools are going to have lower NAPLAN results unless they get the support needed.

      report
    2. mark mc dougall

      educator

      In reply to David Zyngier

      the parents might do better to sit down and try to read a story or measure out and build a shed with their under performing children--cultivate a feeling for value in learning- rather than bang down the ministers doors-teaching their children to pass the blame- teachers, ministers, anything other than trying to make the best of whats available..?
      The difference in finland is just this--a culture not of blame, but of free (and moral) industry, resulting in fruitfulness

      report
  5. Nada Makki

    Biomedical Scientist & Postgraduate student (Speech Pathology)

    Hi Anne,
    As a mum of 3, I couldn't agree with you more! My eldest son goes to a reputable independent private school where the quality of teaching and the classroom environment is excellent. However, I have sought various programs to help with his receptive and expressive language, and I know all too well how difficult it can be to gauge what works and what doesn't. I have tried FastForward, The Listening Program and now Lumosity. They are all programs that promise significant success, and are both time-consuming and expensive. I believe they have been beneficial but it is extremely difficult to know to what extent. Your idea on regulation would be a welcome 'one-stop shop' to help anxious, worried parents who shouldn't need to decipher all the scientific jargon alone, nor decide the efficacy of a program.

    report
  6. Tracy Heiss

    logged in via Facebook

    I applaud the concept of regulation. Perhaps even a website that is government endorsed, and lists programs that have passed rigorous trials would be a good start.

    Ultimately, though, when people have their first visits to the ante natal clinics they should be informed that they need to read to their babies, and continue to do so throughout their baby's childhood. It always amazes me that so many people believe that learning to read is a school based activity. Most learning occurs at home.

    report
    1. Anne Castles

      Deputy Director, ARC Centre of Excellence in Cognition and its Disorders at Macquarie University

      In reply to Tracy Heiss

      Thanks Tracy. Reading to children is very important of course, for a whole range of reasons. However, many children who have been read to all their lives by very committed parents still struggle to learn to read.

      report
  7. David Hardie

    logged in via Facebook

    Every day there is someone in the media bashing NAPLAN. In a lot of cases this is warranted. This is because it is being used for a purpose for which it was not designed or intended, specifically, to compare, states, schools, teachers etc. It was designed being a diagnostic assessment for students in relation to basic skills. It is used in this way every year by teachers and schools to guide syllabus and pedagogy in relation to individual students, groups of students or even whole schools.

    Just because bashing NAPLAN has become a habit because its systematic miss-use, this is not a reason to dismiss its validity for its intended purpose.

    report
    1. Linus Bowden

      management consultant

      In reply to David Hardie

      David, what evidence is there os this "misuse"? My own experience is that parents use NAPLAN almost exclusively as a diagnostic tool, and even then to buttress other data they have gathered.

      report
    2. Anne Castles

      Deputy Director, ARC Centre of Excellence in Cognition and its Disorders at Macquarie University

      In reply to David Hardie

      Dear David,

      No bashing of NAPLAN was intended in this article. The release of NAPLAN results is a time when many parents get feedback on their children's progress, along with when they receive report cards, have parent-teacher interviews etc. A concerning result at any of these points can lead them to look at options for reading treatment programs, which was the focus of this article.

      report
    3. David Hardie

      logged in via Facebook

      In reply to David Hardie

      For evidence of misuse:
      "Students go backwards in national test scores" Sydney Morning Herald - ‎Sep 14, 2012‎.
      "NSW students proving their worth" NEWS.com.au - ‎Sep 14, 2012‎
      (Try and reconcile those two stories)
      I could rattle off another dozen stories in the mainstream press over the last two weeks that make comparisons at various levels, none of which actually acknowledge the value of NAPLAN as a diagnostic assessment.
      Dr Castles - It wasn't a jibe aimed at your article. Even in schools I see qualified, experienced teachers getting conned by the educational equivalent of 'snake oil'. What you are advocating makes basic sense.

      report
    4. Linus Bowden

      management consultant

      In reply to David Hardie

      Hi David

      Fair enough, yes I agree with you about the media. I had forgotten the media when I posted, as I was more focused on parents. But we are in agreement on the media. However, as I have posted elsewhere on this site, spectacular innumeracy is like a cancer riddled through every crevice of the Australian media - both the ABC and the commercials. And even though I first detected this in newspaper reporting of education issues, I soon discovered it is just as dire in reporting on health, crime, indigenous issues, demography, science, you name it.

      report