Journal of Applied Psychology 2005

Assessing measurement equivalence across rating sources: A multitrait-multirater approach.

David J. Woehr¹; Mary Kathleen Sheehan²; Winston Bennett³

¹ University of Tennessee at Knoxville · ² Texas A&M University · ³ United States Air Force Research Laboratory

Abstract

Research examining the structure of multisource performance ratings has demonstrated that ratings are a direct function of both who is doing the rating (rating source) as well as what is being rated (performance dimension). A separate line of research has focused on the extent to which performance ratings are equivalent across sources. To date no research has examined the measurement equivalence of multisource ratings within the context of both dimension and rating source direct effects on ratings. We examine the impact of both performance dimension and rating source as well as the degree of measurement equivalence across sources. Results indicate that (a) the impact of the underlying performance dimension is the same across rating sources, (b) the impact of rating source is substantial and only slightly smaller than the impact of the underlying performance dimension, and (c) the impact of rating source differs substantially depending on the source.

DOI

10.1037/0021-9010.90.3.592

Sources

openalex

Cite

APA 7 MLA 9 Chicago (author–date) Harvard Elsevier Harvard (JFE, JBF…) The Accounting Review Academy of Management American Marketing Association INFORMS (Management Science) Copy citation Copied ✓