Chapter 6

Mistaken ways of measuring money, buildings and people

Table of Contents

Chapter 6 Overview

This chapter examines mistaken ways of measuring money, buildings, and people. Budget thinking dominates the view of money in most districts. This is necessary, of course, but not sufficient. Cost-per-student measures are needed when thinking about how fairly resources are shared. Revenue-per-student is needed to gauge the different costs of educating students with varied needs. Cost-benefit thinking is needed to relate the result of spending to its cost, a key issue for planners. Cost-effectiveness thinking is needed to identify waste, and to see if a district is getting a reasonable “bang-per-buck.” But the flawed evaluation of teachers is perhaps the most damaging blind spot of most districts. Teacher evaluations fail to account for the natural variation in teaching effectiveness that students see. The chapter closes with suggestions of internal metrics districts can create, including analysis of retention and attrition, and investment in professional development and return on that investment.

Chapter 6 Excerpt

In 2019, Mark Schneider, the director of the Institute of Education Sciences, fired a flare of caution into the sky warning of leaders’ lack of clarity and candor about the cost of educating kids. “As a field, we have been way, way behind the curve in terms of telling people how much things cost.” One test of Mr. Schneider’s assertion is to look at some of the best authors’ writing about school improvement and examine the place of economic analysis in their works. Let’s look at two: the Carnegie Foundation team that has championed continuous improvement, and John Hattie who has advanced the cause of making learning visible through comparative measures of impact. If there’s one book that is the bible of continuous improvement for K–12 educators, it is Learning to Improve: How America’s Schools Can Get Better at Getting Better. It ranks 12th in Amazon’s ranking of education administration books, a notable achievement. All four of its authors—Anthony S. Bryk, Louis M. Gomez, Alicia Grunow and Paul G. LeMahieu—are leaders within the Carnegie Foundation for the Advancement of Teaching. Certainly, in a book this influential, written by four people as highly esteemed, you’d expect to see economic analysis used somewhere in its pages. Yet nowhere could I find even a reference to economic analysis. Not in the index. Not in the glossary. Not in the body of the book and its ample real-world examples. This is a book I’ve read and value highly. It has advanced the cause of smarter management. Some of our clients have gone through the Carnegie Foundation training in California and praise Learning to Improve highly. Yet what does it say about the profession of education management when a book this highly regarded disregards the cost-consequences of improvements? Rather than rush to judgment, I looked at another book that is on the “must read” list for those studying school improvement: Visible Learning by John Hattie. He dared to do what no one had done before: compare the relative effect of over a hundred different approaches to improving student learning. He found over 800 studies and used meta-analysis methods to find a common denominator of effect size to estimate the impact of each. Since the book came out in 2008, Hattie has written well over a dozen spin-off books, each of them applying his comparative effectiveness method to specific domains within K–12 (e.g., early literacy, math, special education, etc.). Visible Learning soared in popularity and now ranks 188th on Amazon’s education administration best-seller list. But does the cost of achieving gains appear in this book? In its 392 pages, it appears only in passing. Yet it is central to the decision-making that faces every education leader. It is an obvious constraint. What’s the “bang” that they’ll obtain for every “buck” they spend? This is a universal and unavoidable question….

Chapter 6 Resources

Caruso, Vincent, “Chicago Teachers Can No Longer Save 40 Sick Days for Retirement: Now It’s 244,” November 19, 2019, website of Illinois Policy. Accessed on 12/8/2020 from https://www.illinoispolicy.org/chicago-teachers-no-longer-can-save-40-sick-days-for-retirement-now-its-244/

Costello, R., Elson, P., & Schacter, J. (2008). An Introduction to Value-Added Analysis. Journal of

Catholic Education, 12 (2). Retrieved from http://digitalcommons.lmu.edu/ce/vol12/iss2/7 on December 10, 2020.

Cowan, James, Dan Goldhaber, Zeyu Jin, Roddy Theobald (2020). “Teacher Licensure Tests: Barrier or Predictive Tool?” CALDER Working Paper No. 245-1020. https://caldercenter.org/sites/default/files/WP%20245-1020_0.pdf

Levin, Henry M., Belfield, Clive R., McEwan, Patrick J., Shand, Robert D., Bowden, A. Brooks. Economic Evaluation in Education: Cost-Effectiveness and Benefit-Cost Analysis. United States: SAGE Publications, 3rd edition, 2017.

“New GASB Pension Statements to Bring about Major Improvements in Financial Reporting,” Governmental Accounting Standards Board, December 2013. Accessed on 12/7/2020 at https://gasb.org/cs/ContentServer?c=Document_C&cid=1176160140567&d=&pagename=GASB%2FDocument_C%2FDocumentPage

Njuguna, Wangui, “Value-added model could improve teacher assignments,” Education Daily,March 4, 2009, page 2.

Roza, Marguerite, Educational Economics: Where Do [$]chool Funds Go?, Urban Institute Press, 2011.

Schacter, John, “The Research on Teacher Effects,” a slide deck presented at the California Education Research Association conference, 2008. Provided by John Schacter to the author.

Walsh, Kate, “Are We Done With Teacher Licensing Tests?” National Council on Teacher Quality, November 23, 2020. Accessed from https://www.nctq.org/blog/Are-we-done-with-teacher-licensing-tests on December 10, 2020

Photo of Ellen Mandinach
“A timely book about the importance of the use of data, facts, and evidence in education. It raised thoughtful questions about how data should be used for what purposes and the ensuing interpretations.”

Ellen Mandinach – Associate director for research of EDC’s Center for Children and Technology and director for research of the Northeast and Islands Regional Education Laboratory (NEIREL)