Are we headed for an educational disaster? Hardly

The recent release of Australia’s performance in the TIMMS (2011) and PIRLS (2011) test results has sparked much media comment about what this means for the quality of Australian education. The focus so far has been on the rankings in maths, science and reading and where Australian students fit on the…

27764xzn-1355293842
Two new international reports on school performance should be put into perspective. Education image from www.shutterstock.com

The recent release of Australia’s performance in the TIMMS (2011) and PIRLS (2011) test results has sparked much media comment about what this means for the quality of Australian education.

The focus so far has been on the rankings in maths, science and reading and where Australian students fit on the ladder, but this is only part of the story.

Before we make dire predictions about what these rankings mean and what needs changing, some perspective is needed. We need to take a closer look at what these measures can really tell us about our school system – what’s useful data and what’s not.

Apples and oranges

First of all, rankings like these can be problematic if you’re only comparing apples with oranges. There is not much point comparing Australia with countries such as Singapore, Finland, Japan and Korea for example.

All these countries value different things in their education systems and all are also quite mono-cultural in makeup. For some countries, like Korea, these test scores influence educational policy. This has meant that essentially these education systems have grown to support students achieving high test scores.

As a consequence, Korea has had to legislate for a maximum number of hours students can spend in “cram school” – extracurricular schools that focus on tests.

This is the path Australian education has not taken and it shouldn’t. To follow these counties, and allow test results to impact on education policy would be a mistake.

We must remember, that these tests, which focus on content and associated skills that are common across different countries are quite narrow in their focus.

What they can tell us

But these tests can, of course, provide us with some useful information. In the most recent report, rankings have gotten all the attention, but in fact there was other valuable research done about what factors can influence student achievement, like family background.

Rankings, too, can tell us about how our students are faring in these areas, and what we may have emphasised or not since the last series of test.

One thing that has remained consistent in all of these international tests is the low percentage of students achieving at the highest level. These students are important as they not only start to achieve at their potential, but they are also an influential group in bringing the rest of their cohort along with them.

This trend of under-performing high achievers has been evident in the Australian data for some time.

Reading, writing and arithmetic

For the PIRLS reading test, this is the first time Australia has participated, so it’s not very helpful to look at Australia’s ranking. It is the first snapshot of this type that we have.

But this is not the case in Mathematics and Science, where we have participated for some time. The results show that some trends persist in Mathematics and Science. The profile of student achievement in Mathematics has shifted slightly and this may reflect different emphasis on different aspects of the curriculum over time.

In Science, achievement in physical sciences remains less than in Biology, with Earth Science a little more variable.

But once again, the context matters here. The focus on different disciplines in Science does not begin for many Australian students until Year 3. So results for Year 4 students in this study need to be regarded cautiously. Although, it does appear to improve by Year 8.

Bigger picture

The other focus of the report was a study of other factors in student achievement. This vaulable data looks at issues of gender, the resources at home, the resources at school, the background qualifications of teachers (which in Australia is quite high given that teachers must either have a 4 year undergraduate degree or a postgraduate qualification on top of an undergraduate degree), the years experience of teachers, the satisfaction of teachers and so on.

But nowhere is there a report on the quality of teachers as none of these measures can directly account for quality.

Interestingly for the Year 4 teachers in PIRLS testing, those with less than 5 years experience had students who achieved marginally better that any of the more experienced teachers. This is not the case for Science and a different scenario exists again for Mathematics.

Gender difference still exist throughout this data, as does resources at home and at school.

One of the take home messages from these reports is for Australia to unpack what does it indicate about our own students. What lessons can we learn about the highly individual students from very diverse backgrounds that make up our schools.

Such information is far more important than comparing us with countries who have different priorities for the students in their educational systems.

Articles also by This Author

Sign in to Favourite

Want to follow The Conversation?

Sign up to our free newsletter to get the day's top stories in your inbox each morning, with a special wrap on Saturday.

Donate and become a friend of The Conversation

Join the conversation

25 Comments sorted by

  1. Bruno De Villenoisy

    logged in via Facebook

    The most interesting definition of education I've come across is how a society chooses to reproduce itself. Do we want to be reproduced by numbers, I don't think so.I can't help think this debate about educational ranking is becoming obsolete. Students learn valuable knowledge and skills from the internet, games and other means and this won't show up on these formulaic tests.

    report
  2. Sue Thomson

    logged in via Facebook

    I don't disagree with some of what you've written here, but to write off results of these studies as comparing apples with oranges is not correct. Whilst we can look at what some other participating countries do and agree that we don't share the same values, it's a little difficult to dismiss countries such as England, Ireland, Canada and the United States as being oranges to our apples. These countries all performed significantly better than Australia. Similarly, when you talk about monoculturalism…

    Read more
  3. Chris Gillham

    Journalist

    This article sounds similar to the excuses I've heard in other media coverage of the disastrous international test results ... "it's the parents' fault" and "it's because we don't pay teachers enough".

    I'm 52 and have been sub-editing newspapers and magazines since my teens. I'm at the coalface of Australia's literacy crisis, so to speak, because I have to correct it just about every day to make a living.

    Examples I've seen trickle and then flood out of our education system over the past few…

    Read more
  4. Greg Boyles

    Lanscaper and former medical scientist

    "and all are also quite mono-cultural in makeup"

    Well clearly declining average education levels are a social cost of high immigration levels due to reduction in average english profficiency, with all the flow on education impacts that this causes.

    Clearly lower average emglish pfofficiency then imposes and economic cost on us in having to provide more education resources to compensate for this. And let us remember that our former mining boom is receding along with the revenue windfall that the current federal labour government was counting on.

    This has to be considered carefully when setting immigration policy across the board, INCLUDING what we do about illegal boat arrivals.

    report
  5. Comment removed by moderator.

  6. Ranmalee Mendis

    -

    Interesting response to Australia's performance. However I would like to point out that Singapore is not mono-cultural in its make up. On the contrary, it has major ethnic groups comprising the Chinese, Malays, Indians, Peranakans and Eurasians. Most students grow up bilingual from an early age.

    report
  7. Charles Driver

    logged in via email @gmail.com

    If you're going to base your claims / thoughts on a notion that the test in question is not a useful, broadly applicable indicator of knowledge and competence across different areas, it would be good to know why. Testing can be done well without needing to be tailored to specific contexts...

    report
  8. Michael Leonard Furtado

    Doctor at University of Queensland

    Interesting argument, Deborah, with which I substantially agree from the standpoint that testing does very little other than to reconcile participants to their international ranking. A few determined teachers and the infusion of more resources in some schools will probably on current evidence not make as much of a difference compared with the shift testing generates towards a reproductive 'back-to-basics' curriculum with the loss of much else that is of value, especially in employing a varied pedagogy…

    Read more
  9. Greg Boyles

    Lanscaper and former medical scientist

    "I can assure both Chris Gilham and Greg Boyles that the quality and standard of my written and spoken English is consistently more variegated and expressive than - and arguably superior to - that of most native-born Australians."

    Even if you do say so yourself Michael.....

    I don't doubt there are some developing world migrants whose english profficiency is as good or better than native speakers.

    But nor do I doubt that there is also great many developing world migrants whose english profficiency is far from equal to native speakers. And nor do I doubt that this lack of english proficiency effects their education outcomes and therfore the average education outcomes of the nation as revealed in this test.

    report
  10. Michael Leonard Furtado

    Doctor at University of Queensland

    Nothing in Professor Corrigan's original piece, nor for that matter in the Report, alludes to the negative impact of teaching children from a Non-English-speaking background.

    Indeed, and to iterate, Lo Bianco's research demonstrates that that the quality of teaching and curriculum offerings are the key determinants of not just successful outcomes in literacy performativity but also results that are consistently better than for native-Australian English speakers without a second language…

    Read more
  11. Greg Boyles

    Lanscaper and former medical scientist

    Michael regardless of what is in or what is not in Corrigan's original piece the fact remains that it is harder for english speaking teachers to teach students who do not have a good grasp of the english language.

    Therefore regardless of what is in or what is not in Corrigan's original piece the fact remains that the increased number of less than perfect english speaking pupils must have SOME effect on average education out comes.

    Perhaps some one should specifically address this issue and gauge exactly what effects they ARE having on education outcomes and if education resources need to be specifically targeted at this area.

    report
  12. Michael Leonard Furtado

    Doctor at University of Queensland

    Dear Greg

    (And sorry to digress from your article, Deborah).

    The research that you recommend has already been done. The acknowledged scholar in the field is Joseph Lo Bianco, who is professor of Language and Literacy Education at the University of Melbourne. Lo Bianco is also the President of the Australian Academy of the Humanities.

    There are several others of equal eminence in the field, who contribute to a complexity of other strands that comprise the overall field of literacy studies…

    Read more
    1. Greg Boyles

      Lanscaper and former medical scientist

      In reply to Michael Leonard Furtado

      Puting it bluntly Michael, this sounds like academic bull$hit to me.

      This would suggest then that the Chinese and Japanese, with their relative lack of ethnic, cultural and language diversity, are backward, illiterate and poorly educated people who have difficulty comprehending their own language!

      Clearly not the case!

      report
  13. Greg Boyles

    Lanscaper and former medical scientist

    "China's literacy rates lag well behind Australia's."

    That has nothing what so ever to do with the levels of multiculturalism or multilingualism in China. That has to do with the education system alone and income levels.

    I would be interested in hearing what real scientists would say about the papers like this that seem to me stretech credibility.

    report
    1. Michael Leonard Furtado

      Doctor at University of Queensland

      In reply to Greg Boyles

      Mr Boyles, the issue at stake is, regrettably, your limited understanding and use of the English language. The Conversation record show that you chose more than once to try to argue a case for altering the dictionary definition of 'zenophobia', which is clearly a case in point. And there are numerous other gaffes of yours that litter these pages and which are an embarrassment for me to point out.

      All advanced societies, especially those at the top of the test results table in question, have, without…

      Read more
  14. Greg Boyles

    Lanscaper and former medical scientist

    Also regrettably Michael Leonard Furtado, a proportion of you academics are full of your own importance and like to complicate and confuse issues that would otherwise be fairly straightforward, presumably to justify your own academic positions and increase their perceived importance!

    And regarding the definition of xenophobia, it is you pal who are attempting to re-interpret the literal definition of this term to suit your own political agenda.

    Most definitions, in dictionaries and most internet…

    Read more
  15. Greg Boyles

    Lanscaper and former medical scientist

    I have no doubt that being able to speak another language is a great skill if you wish to be able to interact fully with another culture and conduct business etc. And I have no doubt that it fosters understanding and cooperation between nations.

    But what I find self evidently rediculous is that speaking a foreign language is necessary for an english speaking Australian to fully understand the english language and be able to interact fully with other Australians.

    I don't speak any other languages Michael. Are you having trouble interacting with me in discussing our political differences? Perhaps apart from my bad habit of not checking for typos properly which seems to distract you at times.

    report
  16. Greg Boyles

    Lanscaper and former medical scientist

    The economic sciences are well known, in physical science circles, for ignoring the fact that the economy is contained within a finite global ecosystem when they formulate their economic therories.

    I reckon than the social sciences are suffering from a similar problem in ignoring neurophysiology and human biology, while focusing on superficial human politics, in formulating their social theories.

    I think both these sciences, which are relatively recent when compared to the physical sciences, still have some way to go in acheiving the same discipline and methodologies that the physical sciences have developed over the millennia.

    There has been more than one example in here where social 'scientists' of one flabour or another seem to be 'out there' when it comes to their 'theories'.

    report
    1. Michael Leonard Furtado

      Doctor at University of Queensland

      In reply to Greg Boyles

      To reply to your several posts, Mr Boyles:

      My first point refers to the etymology of xenophobia, which is commonly defined as 'fear of the foreign'. My second point addresses your speculation that it is of entirely neurophysiological origin (which I do not dispute) but suggesting that it cannot be cured (which, as an ethicist and an educator, I do). My third point offers more suitable scope for you to test out your ideas, without risk of being regarded as a troll.

      1. Dictionary definitions…

      Read more
  17. Greg Boyles

    Lanscaper and former medical scientist

    Michael all your definitions list stranger or strange AS WELL as foreign or foreigner.

    Strange or stranger IS NOT the same thing as foreign or foreigner.

    Therefore it is perfectly legitimate to describe the tension between Collingwood supporters and Carlton supporters, between small rural town folks and a new city resident and between New Guinea highland tribes as xenophobia.

    Even though your political biases mean you prefer not to use the term xenophobia in these contexts.

    report
    1. Greg Boyles

      Lanscaper and former medical scientist

      In reply to Greg Boyles

      strangers OR foreigners

      fear of people from other countries or of that which is perceived to be FOREIGN OR STRANGE

      . A person unduly fearful or contemptuous of that which is foreign, especially of STRANGERS OR FOREIGN peoples

      for·eign/ˈfɔr ɪn, ˈfɒr-/ Show Spelled [fawr-in, for-] Show IPA
      adjective
      1. of, pertaining to, or derived from another country or nation; not native: foreign cars.
      2. of or pertaining to contact or dealings with other countries; connected with foreign affairs…

      Read more
  18. Michael Leonard Furtado

    Doctor at University of Queensland

    I profusely apologise to Deborah Corrigan for ill-advisedly and inadvertently colluding with Greg Boyles in his successful attempt to drive the issue of global standardised school testing off these columns.

    I wish further to conceed that he is a brilliant strategist, preventing at one and the same time The Conversation's readership from considering the complexity of the various 'takes' on the topic, including David Zyngier's passionate plea to use the issue to highlight the failure of Gonski in…

    Read more
    1. Greg Boyles

      Lanscaper and former medical scientist

      In reply to Michael Leonard Furtado

      Michael I could say much the same thing about you. You have displayed a high level of academic arrogance on this in totally ignoring my valid point about the definition of xenophobia in that it always states foreign OR strange and strange DOES NOT necessarily mean foreign.

      And the defintion of foreign that I provided DOES NOT exclusively mean 'from another country'. It could also mean from another province or district. Which again you arrogantly ignored.

      And if you are so adamant that xenophobia exclusively means fear of people from another country then I suggest you level your criticisms at Proff Tim Flannery. Because he uses xenophobia to describe the tension between tribes in the New Guinea highlands in his book The Future Eaters.

      Are you prepared to say in public that Tim Flannery is a fool Michael? Because according to you he is making the same folly as me!

      report