Conventional value-added models (VAMs) compare average test scores across schools after regression-adjusting for students’ demographic characteristics and previous scores. This article tests for VAM bias using a procedure that asks whether VAM estimates accurately predict the achievement consequences of random assignment to specific schools. Test results from admissions lotteries in Boston suggest conventional VAM estimates are biased, a finding that motivates the development of a hierarchical model describing the joint distribution of school value-added, bias, and lottery compliance. We use this model to assess the substantive importance of bias in conventional VAM estimates and to construct hybrid value-added estimates that optimally combine ordinary least squares and lottery-based estimates of VAM parameters. The hybrid estimation strategy provides a general recipe for combining nonexperimental and quasi-experimental estimates. While still biased, hybrid school value-added estimates have lower mean squared error than conventional VAM estimates. Simulations calibrated to the Boston data show that, bias notwithstanding, policy decisions based on conventional VAMs that control for lagged achievement are likely to generate substantial achievement gains. Hybrid estimates that incorporate lotteries yield further gains.

Coordinated single-offer school assignment systems are a popular education reform. We show that uncoordinated offers in NYC's school assignment mechanism generated mismatches. One-third of applicants were unassigned after the main round and later administratively placed at less desirable schools. We evaluate the effects of the new coordinated mechanism based on deferred acceptance using estimated student preferences. The new mechanism achieves 80 percent of the possible gains from a no-choice neighborhood extreme to a utilitarian benchmark. Coordinating offers dominates the effects of further algorithm modifications. Students most likely to be previously administratively assigned experienced the largest gains in welfare and subsequent achievement. (JEL C78, D82, I21, I28)

A growing number of school districts use centralized assignment mechanisms to allocate school seats in a manner that reflects student preferences and school priorities. Many of these assignment schemes use lotteries to ration seats when schools are oversubscribed. The resulting random assignment opens the door to credible quasi-experimental research designs for the evaluation of school effectiveness. Yet the question of how best to separate the lottery-generated randomization integral to such designs from non-random preferences and priorities remains open. This paper develops easily-implemented empirical strategies that fully exploit the random assignment embedded in a wide class of mechanisms, while also revealing why seats are randomized at one school but not another. We use these methods to evaluate charter schools in Denver, one of a growing number of districts that combine charter and traditional public schools in a unified assignment system. The resulting estimates show large achievement gains from charter school attendance. Our approach generates efficiency gains over ad hoc methods, such as those that focus on schools ranked first, while also identifying a more representative average causal effect. We also show how to use centralized assignment mechanisms to identify causal effects in models with multiple school sectors.

Many school and college admission systems use centralized mechanisms to allocate seats based on applicant preferences and school priorities. When tie-breaking uses non-randomly assigned criteria like distance or a test score, applicants with the same preferences and priorities are not directly comparable. The non-lottery setting does generate a kind of local random assignment that opens the door to regression discontinuity designs. This paper introduces a hybrid RD/propensity score empirical strategy that exploits quasi-experiments embedded in serial dictatorship, a mechanism widely used for college and selective K-12 school admissions. We use our approach to estimate achievement effects of Chicago's exam schools.