Data Digging

IMG_0021This article, found in the December 5, 2017 New York Times and titled How Effective Is Your School District, should trigger some more in-depth thought about test results and effective schools. The assumed narrative hyped by press and edu-crats, is that urban school systems, more particularly public urban schools systems, are failing to educate students.

My experience with standardized testing and assessment of children based solely on such measurements has not been all that informative or enlightening. As an example, the last class of fourth grade students I taught before retiring regularly wrote reflective responses to their reading. Their writing was (developmentally) appropriate and most were meeting grade level standards based on the rubrics and inter-rater discussions my colleagues and I used as an assessment guide. Yet the results of their state standardized testing did not reflect that.

One could certainly make the case that, in knowing my students, there could have been a layer of subjectivity which I applied during my assessment, but I don’t think that was true very often. In fact, when my grade level colleagues and I looked at student work, my assessments were most often in alignment with theirs.

So what does this anecdote have to do with school effectiveness?

For most if not all of the years when I was teaching in urban and high poverty schools, I felt as if there were more factors influencing students’ tests and my school’s educational effectiveness. And, as Emily Badger and Kevin Quealy point out in the Times article, by looking more deeply at test results and tracking student growth over time, the rest of the universe just may discover what educators have known in their gut: that when students begin education from trauma and poverty, it may take a bit of time – years actually – to catch up and many students do.

Badger and Quealy refer to third grade students in Chicago Public Schools. Collectively those students are a year or more behind when tested in Grade 3; however, by Grade 8, many of these same children have grown 6 years and are nearly at Eighth Grade performance expectation. To me, that shows a school system that despite being nearly starved to death financially, is able to provide effective education to students, many of whom come from situations of poverty and trauma.

Looking more analytically at standardized test results over time might actually show urban (and southern) schools are actually working. Using a measurement of student growth alongside those performance results shows some remarkable results. Be sure to utilize the graphic further into the article where a reader can add the name of a local district to view that district’s result on the scatter plot.


Could it be that our urban districts are models for effective education?  Here’s some solid data that shows that effective schools are not only found in wealthier communities. And it’s a good place to ask how our urban schools are effectively fostering student growth in educational achievement.