This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Bloom, H. S. Articles by Lee, S.-W. Search for Related Content PubMed PubMed Citation Articles by Bloom, H. S. Articles by Lee, S.-W. Social Bookmarking                         What's this?

Using Cluster Random Assignment to Measure Program Impacts

Statistical Implications for the Evaluation of Education Programs

Manpower Demonstration Research Corporation

Johannes M. Bos

Manpower Demonstration Research Corporation

Suk-Won Lee

New York University

This article explores the possibility of randomly assigning groups (or clusters) of individuals to a program or a control group to estimate the impacts of programs designed to affect whole groups. This cluster assignment approach maintains the primary strength of random assignment—the provision of unbiased impact estimates—but has less statistical power than random assignment of individuals, which usually is not possible for programs focused on whole groups. To explore the statistical implications of cluster assignment, the authors (a) outline the issues involved, (b) present an analytic framework for studying these issues, and (c) apply this framework to assess the potential for using the approach to evaluate education programs targeted on whole schools. The findings suggest that cluster assignment of schools holds some promise for estimating the impacts of education programs when it is possible to control for the average performance of past student cohorts or the past performance of individual students.

Evaluation Review, Vol. 23, No. 4, 445-469 (1999)
DOI: 10.1177/0193841X9902300405


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				J. Spybrook and S. W. Raudenbush An Examination of the Precision and Technical Accuracy of the First Wave of Group-Randomized Trials Funded by the Institute of Education Sciences Educational Evaluation and Policy Analysis, September 1, 2009; 31(3): 298 - 318. [Abstract] [Full Text] [PDF]

				P. Z. Schochet Statistical Power for Regression Discontinuity Designs in Education Evaluations Journal of Educational and Behavioral Statistics, June 1, 2009; 34(2): 238 - 266. [Abstract] [Full Text] [PDF]

				G. D. Borman, N. M. Dowling, and C. Schneck A Multisite Cluster Randomized Field Trial of Open Court Reading Educational Evaluation and Policy Analysis, December 1, 2008; 30(4): 389 - 407. [Abstract] [Full Text] [PDF]

				P. Z. Schochet Statistical Power for Random Assignment Evaluations of Education Programs Journal of Educational and Behavioral Statistics, March 1, 2008; 33(1): 62 - 87. [Abstract] [Full Text] [PDF]

				G. D. Borman, R. E. Slavin, A. C. K. Cheung, A. M. Chamberlain, N. A. Madden, and B. Chambers Final Reading Outcomes of the National Randomized Field Trial of Success for All American Educational Research Journal, September 1, 2007; 44(3): 701 - 731. [Abstract] [Full Text] [PDF]

				S. W. Raudenbush, A. Martinez, and J. Spybrook Strategies for Improving Precision in Group-Randomized Experiments Educational Evaluation and Policy Analysis, March 1, 2007; 29(1): 5 - 29. [Abstract] [Full Text] [PDF]

				H. S. Bloom, L. Richburg-Hayes, and A. R. Black Using Covariates to Improve Precision for Studies That Randomize Schools to Evaluate Educational Interventions Educational Evaluation and Policy Analysis, March 1, 2007; 29(1): 30 - 59. [Abstract] [Full Text] [PDF]

				L. V. Hedges and E. C. Hedberg Intraclass Correlation Values for Planning Group-Randomized Trials in Education Educational Evaluation and Policy Analysis, March 1, 2007; 29(1): 60 - 87. [Abstract] [Full Text] [PDF]

				K. Arceneaux Using Cluster Randomized Field Experiments to Study Voting Behavior The ANNALS of the American Academy of Political and Social Science, September 1, 2005; 601(1): 169 - 179. [Abstract] [PDF]

				H. S. Bloom and J. A. Riccio Using Place-Based Random Assignment and Comparative Interrupted Time-Series Analysis to Evaluate the Jobs-Plus Employment Program for Public Housing Residents The ANNALS of the American Academy of Political and Social Science, May 1, 2005; 599(1): 19 - 51. [Abstract] [PDF]

				G. D. Borman, R. E. Slavin, A. Cheung, A. M. Chamberlain, N. A. Madden, and B. Chambers Success for All: First-Year Results From the National Randomized Field Trial Educational Evaluation and Policy Analysis, January 1, 2005; 27(1): 1 - 22. [Abstract] [PDF]

				G. D Borman, R. E Slavin, A. C. Cheung, A. M Chamberlain, N. A Madden, and B. Chambers The National Randomized Field Trial of Success for All: Second-Year Outcomes American Educational Research Journal, January 1, 2005; 42(4): 673 - 696. [Abstract] [PDF]

				D. M. Murray, S. P. Varnell, and J. L. Blitstein Design and Analysis of Group-Randomized Trials: A Review of Recent Methodological Developments Am J Public Health, March 1, 2004; 94(3): 423 - 432. [Abstract] [Full Text] [PDF]

				R. Bifulco Addressing Self-Selection Bias in Quasi-Experimental Evaluations of Whole-School Reform: A Comparison of Methods Eval Rev, October 1, 2002; 26(5): 545 - 572. [Abstract] [PDF]