To make high-quality research more accessible and easier to explore.

Fields:
2 results ✕ Clear filters

Leveraging Lotteries for School Value-Added: Testing and Estimation*

Quarterly Journal of Economics 2017 132(2), 871-919 open access
Conventional value-added models (VAMs) compare average test scores across schools after regression-adjusting for students’ demographic characteristics and previous scores. This article tests for VAM bias using a procedure that asks whether VAM estimates accurately predict the achievement consequences of random assignment to specific schools. Test results from admissions lotteries in Boston suggest conventional VAM estimates are biased, a finding that motivates the development of a hierarchical model describing the joint distribution of school value-added, bias, and lottery compliance. We use this model to assess the substantive importance of bias in conventional VAM estimates and to construct hybrid value-added estimates that optimally combine ordinary least squares and lottery-based estimates of VAM parameters. The hybrid estimation strategy provides a general recipe for combining nonexperimental and quasi-experimental estimates. While still biased, hybrid school value-added estimates have lower mean squared error than conventional VAM estimates. Simulations calibrated to the Boston data show that, bias notwithstanding, policy decisions based on conventional VAMs that control for lagged achievement are likely to generate substantial achievement gains. Hybrid estimates that incorporate lotteries yield further gains.

Charters without Lotteries: Testing Takeovers in New Orleans and Boston

American Economic Review 2016 106(7), 1878-1920 open access
Charter takeovers are traditional public schools restarted as charter schools. We develop a grandfathering instrument for takeover attendance that compares students at schools designated for takeover with a matched sample of students attending similar schools not yet taken over. Grandfathering estimates from New Orleans show substantial gains from takeover enrollment. In Boston, grandfathered students see achievement gains at least as large as the gains for students assigned charter seats in lotteries. A non-charter Boston turnaround intervention that had much in common with the takeover strategy generated gains as large as those seen for takeovers, while other more modest turnaround interventions yielded smaller effects.