How to Avoid Misunderstanding, Misinterpreting and Distorting Data
Menu
Keep Learning … Measure Smarter … Interpret Better
Here you’ll find ideas to advance your mastery of analytic savvy and measurement skills. As we discover more resources, we’ll share them with you here.
When principals’ and superintendents’ views of progress differ
This short video is based on a real dialogue between a principal and superintendent over the meaning of annual test results. The principal’s view of school level results led her to care more about the distribution of students’ scores. The superintendent’s view of district level results led him to care about the boundary measure: what percentage of students scored proficient or higher. (Audience: teachers, site leaders, district leaders) (Complexity: introductory)
Simulation of effects of uncertainty and imprecision on test results
This is a simulation of how much students’ test scores in one classroom might vary, based on random factors that have no bearing on students’ mastery of subject matter. Imprecision is inherent in all tests of knowledge. Uncertain outcomes will always result. This spreadsheet model enables educators to trigger multiple test events, and note the degree to which a class of 26 students’ results will wander. (Audience: teachers, principals, instructional leaders) (Complexity: moderate)
Here are the national standards for data use
Under the auspices of the Institute for Education Science, several dozen educators from many states developed these master standards for data use. You will see three versions, each role-based. One is for teachers. Another for leadership. And yet another for data leads. District leaders can use this to shape job descriptions, guide professional development of current staff, and more. Download them from by clicking on the covers above. (Audience: district leaders and data specialists) (Complexity: moderate).
