This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Julnes, G. Articles by Mohr, L. B. Search for Related Content PubMed Articles by Julnes, G. Articles by Mohr, L. B. Social Bookmarking                         What's this?

Analysis of No-Difference Findings in Evaluation Research

University of Michigan

Lawrence B. Mohr

University of Michigan

Conclusions of no difference are becoming increasingly important in evaluation research. We delineate three major uses of no-difference findings and analyze their meanings. (1) No-differ ence findings in randomized experiments can be interpreted as support for conclusions of the absence of a meaningful treatment effect, but only if the proper analytic methods are used. (2) Statistically based conclusions in quasi-experiments do not allow causal statements about the treatment impact but do provide a metric to judge the size of the resulting difference. (3) Using no-difference findings to conclude equivalence on control variables is inefficient and potentially misleading. The final section of the article presents alternative methods by which conclusions of no difference may be supported when applicable. These methods include the use of arbitrarily high alpha levels, interval estimation, and power analysis.

Evaluation Review, Vol. 13, No. 6, 628-655 (1989)
DOI: 10.1177/0193841X8901300604


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				M. Sprague The Effects of Measurement and Methods Decisions on Committee Preference Outlier Results Political Research Quarterly, June 1, 2008; 61(2): 309 - 318. [Abstract] [PDF]

				J. T. Austin, K. A. Boyle, and J. C. Lualhati Statistical Conclusion Validity for Organizational Science Researchers: A Review Organizational Research Methods, April 1, 1998; 1(2): 164 - 208. [Abstract]

				G. T. Henry, M. J. McTaggart, and J. H. McMillan Establishing Benchmarks for Outcome Indicators: A Statistical Approach To Developing Performance Standards Eval Rev, April 1, 1992; 16(2): 131 - 150. [Abstract] [PDF]