Skip to content
 

65% of principals say that at least 30% of students . . . wha??

Alan Sloane writes:

The OECD put out a report drawing on their PISA and TALIS data:
http://oecdeducationtoday.blogspot.ie/2014/07/poverty-and-perception-of-poverty-how.html
I notice that it’s already attracted a NY Times op-ed by David Leonhart:
http://www.nytimes.com/2014/07/23/upshot/principals-in-us-are-more-likely-to-consider-their-students-poor.html
There are a number of things I find strange in its analysis and interpretation but, for starters, there’s the horizontal axis in the chart that’s reproduced in both the original and the NYT piece. As best I can tell the data is actually drawn from Table 2.4A here:
http://www.keepeek.com/Digital-Asset-Management/oecd/education/talis-2013-results_9789264196261-en#page43
So what’s actually being measured for each country is “the percentage of teachers working in schools whose principals estimated that 30% or more of their pupils came from socioeconomically disadvantaged homes”. Then what’s initially interesting in the discussion is how the measures on the vertical axis (a supposedly “objective” measure of disadvantage used in the PISA survey) differ from those on the horizontal, i.e. looking at points that lie significantly above or below the diagonal. So Brazil and the US are obvious outliers, although Singapore, Serbia and Croatia are by a proportional measure also fairly notable. So what caught me first is that this measure is obviously affected by the distribution of disadvantage across schools, e.g. if disadvantage (PISA-measure) is concentrated spatially then you can get a high score on the horizontal axis without having a correspondingly high score on the vertical axis. A highly skewed distribution of school size will also affect things (as I guess will a skewed distribution of teachers, but presumably that’s highly correlated with school size).

The discussion on the third dimension, shown in the bubbles, also seems to me to be dubious, but that’s more complicated.

I don’t really have anything to say on this except that I agree these numbers are hard to interpret.

5 Comments

  1. Anonymous says:

    “60% of the time it works every time”

    http://www.youtube.com/watch?v=pjvQFtlNQ-M

  2. Corey says:

    It’s perfectly clear to me — the pellet with the poison is in the flagon with the dragon and the vessel with the pestle has the brew that is true. What’s so hard about that?

  3. mpledger says:

    “the percentage of teachers working in schools whose principals estimated that 30% or more of their pupils came from socioeconomically disadvantaged homes”

    I suspect France, England and Australia fund schools more as the students’ disadvantage goes up. Typically this is spent on more teachers so you would actually expect to see a higher proportion of teachers in disadvantaged schools than the proportion of disadvantaged kids.

  4. Elin says:

    This was linked in the thread on ivy league schools http://www.act.org/research/researchers/reports/pdf/ACT_RR2013-3.pdf and Table 1 shows that pretty consistently 31% of US students qualify for free lunch. Of course that isn’t evenly distributed but I’m thinking that in the meaning that it has for them, using the measure that they have available, principals are pretty accurate.

Leave a Reply