The Role of Data in School Decision-Making

Analyzing student and faculty data has added a critical new dimension to discussions of specific dynamics in our school. Teacher observations, administrator experience, and student anecdotes are all essential for the continual improvement of our school program. In addition, the trends, correlations, and distributions within our data have made our decision-making conversations more specific and helped resolve conflicts among competing, anecdotal points of view.

We have recently had success analyzing student and faculty data to better understand specific dynamics in our school. Many of these analyses become more clear through data visualization. Key questions include:

How often do we grant students’ top course requests?

Will our course offerings continue to accommodate a growing student body?

Are the foundational skills of our students changing over time?

Do standardized test scores predict academic performance?

What elective courses should we offer next year?

Do electronic textbooks save families money?

Our analyses of standardized test scores were the most rigorous. We created longitudinal charts of score means and medians, examined subscore trends as well, and calculated correlations among different scores. To confirm validity, three different groups performed the tests: myself, our statistics students, and a psychometrician from ERB. The fascinating, consistent result? The gut feelings of our community members have consistently had some truth to them, but anecdotal opinion has a tendency to exaggerate and oversimplify. Our data studies have both validated and identified the limits of anecdotal opinion. They have clarified the multiple facets of issues that people have reduced to simple statements.

Here are some examples of our data visualizations. Most are created in Excel using countif() and sumif() functions and chart tools. I apologize for obscuring much of the content for the sake of privacy. Instead of publishing it all publicly, I am presenting the full studies to the appropriate constituencies in our school community.

35 years of standardized test and GPA means

Screen Shot 2014-11-21 at 8.28.45 AM

 
Students’ initial thoughts about new elective courses

Screen Shot 2014-11-21 at 8.25.42 AM

 
Correlations among different standardized tests and GPA

Screen Shot 2014-11-21 at 8.31.46 AM

 
Longitudinal subscore analysis

Screen Shot 2014-11-21 at 8.30.02 AM
Print vs. Electronic Textbooks: Total Cost per Student

Screen Shot 2014-11-21 at 8.42.01 AM

Elective section enrollments

Screen Shot 2014-11-21 at 8.24.15 AM

3 comments