Understanding the Limitations of Data and Research in Educational Research

The thing about research is that it doesn’t prove anything, at least not in the social sciences. There is no single research that conclusively proves anything once and for all about reading instruction. Research may support a hypothesis. It may provide evidence for something, show something, indicate something, or demonstrate something, but in the social sciences, research doesn’t prove things. The results may indicate, implicate, or illustrate, but educational research doesn’t prove things.

SoR advocates often claim that there is a “proven science” of reading. But when working with variable human beings interacting in variable social situations there are simply too many variables to say that something proves something else conclusively. Instead, research provides evidence for things. A lot of research provides strong evidence. A little research provides weak evidence. There are evidence-based practices (see Chapter *) but there is no “proven science” of reading. But even saying something is evidence-based says nothing about the quality of the evidence or the validity of the evidence.