Myles Mayfield, Allen Schirm, and Ruria Rodriguez-Planas, Mathematica Policy Research August 2003
Myles Maxfield and two colleagues at Mathematica Policy Research (MPR) authored this 24-page evaluation of a six-year, seven site, after-school demonstration program for 600 high-risk high-school age youth, underwritten by the Labor Department and Ford Foundation. Surveys of participating youths and a matched control group sought to determine the program's effects on high school performance and graduation, postsecondary ed, and "risky behaviors." Evaluators also looked at how well the various sites implemented the program model. The findings are mixed. Implementation (particularly of education components such as tutoring) was spotty. Participation rates were low. Per-participant costs were high. Impacts varied hugely from site to site. "Risky behaviors" may have worsened for participants in several sites. Grades and achievement test scores did not improve. On the other hand, high-school graduation prospects brightened a bit (7 percent), as did the likelihood of engaging in post-high school education or training. Longer-term impacts have yet to be evaluated. What is to be concluded at this stage? It's mighty hard to mount successful interventions at the high school level for young people whose lives have already gone off-track. If you'd like to see for yourself, surf to http://wdr.doleta.gov/owsdrr/papers/QOP_synthesis.pdf.