Rushton Hurley on Data-driven Deception

Does educational research data tell us anything? Can it prompt us to improve what we do? The important question for me is whether research of any kind prompts me as an educator to think about ways to improve my teaching.

Robert Marzano, CEO of the Marzano Research Laboratory once said, "All research is equivocal, particularly in education. And here's why: You can never account for all the factors in the classroom that impinge upon the strategy, the technology, etc. You cannot take the human being out of it. It's always going to be that way."1

I like the word "equivocal" in this context, meaning ambiguous or questionable, and it fits my thinking perfectly about most discussions of "data" I hear as an educator.

Often data is given to us as a way to suggest that a particular product or technique is valuable for the work we do in our classrooms. But are we prepared to question what is presented to us as an opportunity to make a "data-driven" decision? Are the variables in the study genuinely related? If so, what is the basis for the contention that one variable causes the other? Can the conclusions be generalized such that the data are in any way useful for my students and me?2

Less abstractly, the data may have to do with students who have an entirely different set of challenges and opportunities than my students have. They may reflect the use of the tool or technique in a way that I could or would not replicate. Most importantly, the research may not account for important variables in such a way that there is any reason to apply it at all. Put simply, you may be looking at a set of numbers that doesn't mean squat.

Given the difficulty of isolating variables, not to mention coming up with a genuine control group in order to make any real comparisons, are we to assume that all educational research is bovine excrement? No, and certainly not if such dismissal leaves us complacent about the work we do, but we have to be able to ask good questions of data that is presented to us.

The important question for me is whether research of any kind prompts me as an educator to think about ways to improve my teaching. Knowing whatever it is the research tells me, can I present something more clearly? Can I reach more kids than I have in the past?  If I am reaching everyone, can I add more depth or breadth to what I cover?

"No sensible educator should deliberately make decisions without basing them as much as possible on the findings of educational research," said Edward Vockell, an education professor at Purdue University, "but a familiarity with the findings and methods of educational research will enable that educator to evaluate the relevance of the information [presented]."3

So how do we figure out how to use data to make a difference for our students? I believe this starts with an honest appraisal of our own effectiveness and a willingness to work with colleagues to figure out how to improve.

The best example I know of this is the work of Eric Mazur, a professor of physics at Harvard University. His work on peer instruction underlies much of what we talk about today as being effective in flipped teaching, but it is more compelling to me that he tells the story of his own experience in a way that is as personal as it is statistical.

"I thought I was a good teacher until I discovered my students were just memorizing information rather than learning to understand the material," Mazur told a group at the University of Maryland-Baltimore in 2009. "Who was to blame? The students? The material? I came to the agonizing conclusion that the culprit was neither of these. It was my teaching that caused students to fail." 4

Good tools, open resources, examined techniques, professional discussions about results, and meaningful sharing of ideas allow teachers to move from complacency and cynicism to professional exploration of their work and its effectiveness. This is about much more than data: Making this move improves the personal satisfaction of the teachers, and creates opportunities in their work settings.

In other words, the higher the percentage of teachers on campus who are focusing on ways to improve what they do, the better the school, and the happier its teachers will be.5


Footnotes:

1 CUE 2009 Keynote, Dr. Robert Marzano

2 syllabus for Introduction to Measurement and Statistics, Linda Woolf; Webster University; no date given

3 Educational Research, Edward Vockell; Purdue University; no date given

4 Confessions of a Converted Lecturer, Eric Mazur speaking at University of Maryland, Baltimore County

5 My guess based on personal experience and no data. Always read the footnotes.

About the Author

Rushton Hurley is executive director, lead speaker, and lead trainer for Next Vista for Learning and a presenter at FETC.

Featured

  •  classroom scene with students gathered around a laptop showing a virtual tour interface

    Discovery Education Announces Spring Lineup of Free Virtual Field Trips

    This Spring, Discovery Education is collaborating with partners such as Warner Bros., DC Comics, National Science Foundation, NBA, and more to present a series of free virtual field trips for K-12 students.

  • glowing padlock shape integrated into a network of interconnected neon-blue lines and digital nodes, set against a soft, blurred geometric background

    3 in 4 Administrators Expect a Security Incident to Impact Their School This Year

    In an annual survey from education identity platform Clever, 74% of administrators admitted that they believe a security incident is likely to impact their school system in the coming year. That's up from 71% who said the same last year.

  • horizontal stack of U.S. dollar bills breaking in half

    ED Abruptly Cancels ESSER Funding Extensions

    The Department of Education has moved to close the door on COVID relief funding for schools, declaring that "extending deadlines for COVID-related grants, which are in fact taxpayer funds, years after the COVID pandemic ended is not consistent with the Department’s priorities and thus not a worthwhile exercise of its discretion."

  • pattern of icons for math and reading, including a pi symbol, calculator, and open book

    HMH Launches Personalized Path Solution

    Adaptive learning company HMH has introduced HMH Personalized Path, a K-8 ELA and math product that combines intervention curriculum, adaptive practice, and assessment for students of all achievement levels.