Skip to main content

Mobile Navigation

  • National
    • Policy
      • High Expectations
      • Quality Choices
      • Personalized Pathways
    • Research
    • Commentary
      • Gadfly Newsletter
      • Flypaper Blog
      • Events
    • Scholars Program
  • Ohio
    • Policy
      • Priorities
      • Media & Testimony
    • Research
    • Commentary
      • Ohio Education Gadfly Biweekly
      • Ohio Gadfly Daily
  • Charter Authorizing
    • Application
    • Sponsored Schools
    • Resources
    • Our Work in Dayton
  • About
    • Mission
    • Board
    • Staff
    • Career
Home
Home
Advancing Educational Excellence

Main Navigation

  • National
  • Ohio
  • Charter Authorizing
  • About

Ohio Menu

  • Topics
    • Accountability & Testing
    • Career & Technical Education
    • Charter Schools
    • Curriculum & Instruction
    • ESSA
    • Evidence-Based Learning
    • Governance
    • High Achievers
    • Personalized Learning
    • Private School Choice
    • School Finance
    • Standards
    • Teachers & School Leaders
  • Research
  • Policy
  • Commentary
    • Ohio Gadfly Newsletter
    • Ohio Gadfly Blog
    • Events
Ohio Gadfly Daily

Despite steady gains, much work remains on Ohio’s academic recovery

Vladimir Kogan
9.5.2023
Vlad Kogan guest blog on test scores image
Getty Images/Tevarak

NOTE: The Thomas B. Fordham Institute occasionally publishes guest commentaries on its blogs. The views expressed by guest authors do not necessarily reflect those of Fordham.

Although the worst of the pandemic has passed, and the political social media chatter remains focused on the latest culture wars, the academic impacts of the unprecedented interruption to American schooling continue to be felt by Ohio students. That’s the message from the latest round of state exams taken by students this spring, according to my new report prepared for the Ohio Department of Education.

The analysis is based on preliminary results from the exams (the official results will be released later this month) and is the latest in my series of data deep dives designed to track the impact of the pandemic on the state’s students and their subsequent recovery.

To preview, the latest numbers underline how far Ohio students have come from the academic low point recorded in the first year of the pandemic—reflecting the dedication of our educators, the additional resources provided to local districts to support the recovery, and the determined focus of state and local policymakers. However, the tests also reveal how much work remains to be done—especially in mathematics, among older students, and in school districts hit hardest by the pandemic learning disruptions.

On the positive side, student achievement continued to improve over the past year, with average English/language arts (ELA) scores largely returning to pre-pandemic levels in most tested grades (or nearly so). In third grade, when students take the same ELA exam in both fall and spring, students learned 10 percent more during the 2022–23 school year than was typical before the pandemic and a big improvement on the previous year. This represents nearly double the rate of learning acceleration seen last year on national assessments and is a tremendous accomplishment that should rightly be cheered and recognized.

The news is more mixed in mathematics, where the test score declines were considerably larger. While elementary school students posted some catch-up growth over the past year, middle and high school students continue to perform well below pre-pandemic cohorts. And in both ELA and math, the recovery has been uneven, with Black, Hispanic and economically disadvantaged students still facing the largest shortfalls in most grades. These subgroups already lagged their peers before 2020. The gaps widened during the first year of the pandemic and remain bigger than before.

Changes in standardized scaled scores compared to pre-pandemic years, by grade and subject

Vlad Kogan guest blog on test scores figure 1

Vlad Kogan guest blog on test scores figure 2
Note: The figure presents the average differences in normalized test scores in standard deviation units compared to the pre-pandemic period (spring 2018 and 2019). Changes in test scores are estimated using statistical models that control for students’ demographic characteristics and school district “fixed effects.” The scaled scores are converted to Z-scores, so that effect sizes are comparable to those in other studies. The differences in normalized scaled scores can be interpreted as the change in student achievement in standard deviations. Grade 10 scores are based on the ELA II and Geometry end-of-course exams, which are not taken by all tenth graders. Grade 9 math scores are based on Algebra end-of-course exams, which some students may also take in other grades. Scores from students who took these exams in other grades are excluded from these estimates (see tables in Appendix for full results that include students in all grades for the high school exams).

My latest report contains several other new insights. First, it goes beyond math and ELA to examine both science and social studies in the grades these exams are taken. Achievement in these subjects suffered substantial declines post-Covid and has also experienced partial recovery since then. Second, in addition to describing the trend in statewide average scores, the analysis examines variation across school districts. And it is these numbers that are perhaps the most sobering.

Overall, more than 90 percent of Ohio school districts have seen their achievement improve since spring 2021, the pandemic low. However, the pace of the recovery has varied considerably across different communities. Areas that showed the largest academic declines have not posted faster growth over the past two years—if anything, they seem to be recovering more slowly. This can be seen in the figure below, with districts arranged in order based on the magnitude of their initial losses. The groups on the bottom left of each panel represent districts with the largest test score declines in the first year of the pandemic. As the figures show, they have actually experienced somewhat slower learning acceleration over the past two academic years (tracked on the y-axis) than the rest, a worrying trend since they have the greatest ground to make up. In addition, districts that received the most federal pandemic aid per student have not experienced substantially faster achievement growth. (The districts whose achievement declined the most were also, in general, many of the same districts that received the largest infusion of federal funds.)

Relationship between initial achievement declines and learning acceleration since spring 2021 at the district level

Vlad Kogan guest blog on test scores figure 3
Note: The figures present binned scatter plots showing the relationship between achievement declines recorded in spring 2021 by each district on the x-axes and the cumulative learning acceleration in each subject since then on the y-axes. Learning acceleration is defined as the increase in one-year growth rates relative to each district’s pre-pandemic benchmark. Both test score changes and one-year growth estimates are averaged pooling grades four through eight. The one-year acceleration estimates from spring 2022 and spring 2023 are added together to calculate the “cumulative” gains over the two-year period. The dashed line represents the ordinary least squares regression fit on the raw (unbinned) district data.

That does not mean that federal dollars have not played an important role in Ohio’s academic recovery. But the data do suggest that federal aid—the last of which must be committed by September 2024—is unlikely to be enough to close the academic gaps. It is important for policymakers to plan for the next phase of the recovery—with strategic emphasis on the subjects, grades, student subgroups, and school districts where achievement continues to show the largest shortfalls.

Over the past three years, Ohio has served as a national model in the transparency policymakers have brought to this issue. No state has kept such a close eye on the trajectory of student achievement and publicized the results in such detail, even when they have not made for pleasant reading. Willingness to track the data and confront bad news head on may explain the impressive improvement in ELA scores over this period. With continued focus from policymakers, we can continue to make further progress in preparing Ohio students for long-term success.

Vladimir Kogan is a Professor in The Ohio State University’s Department of Political Science and (by courtesy) the John Glenn College of Public Affairs. The opinions and recommendations presented in this editorial are those of the author and do not necessarily represent policy positions or views of the John Glenn College of Public Affairs, the Department of Political Science, or The Ohio State University.

Policy Priority:
Standards & Accountability
Topics:
Accountability & Testing

Vladimir Kogan is an associate professor at the Ohio State University Department of Political Science and (by courtesy) the John Glenn College of Public Affairs. The opinions and recommendations presented in this editorial are…

View Full Bio

Related Content

view
Chronic absenteeism is making academic recovery harder in Ohio blog image
Standards & Accountability

Chronic absenteeism is making academic recovery harder in Ohio

Aaron Churchill 9.25.2023
OhioOhio Gadfly Daily
view
Gadfly Bites logo 2023
School Funding

Gadfly Bites 9/25/23—Antepenultimate

Jeff Murray 9.25.2023
OhioOhio Gadfly Daily
view
Ohio charter news logo
School Choice

Ohio Charter News Weekly – 9.22.23

Jeff Murray 9.22.2023
OhioOhio Gadfly Daily
Fordham Logo

© 2020 The Thomas B. Fordham Institute
Privacy Policy
Usage Agreement

National

1015 18th St NW, Suite 902 
Washington, DC 20036

202.223.5452

[email protected]

  • <
Ohio

P.O. Box 82291
Columbus, OH 43202

614.223.1580

[email protected]

Sponsorship

130 West Second Street, Suite 410
Dayton, Ohio 45402

937.227.3368

[email protected]