Agreement Between Self and Other Ratings in Multi-Rater Tools: Performance, Alternative Measures, and Importance. (open access)

Agreement Between Self and Other Ratings in Multi-Rater Tools: Performance, Alternative Measures, and Importance.

Multi-rater tools also referred to as 360-degree feedback tools, are frequently used in addition to traditional supervisory appraisals due to sources (i.e., supervisor, peer, direct report) unique perspectives and opportunities to view different aspects of job performance. Research has found that the differences among sources are most prevalent between self and other ratings, and the direction of agreement is related to overall job performance. Research has typically focused on one form of agreement, the direction of an individual's self-ratings compared to others' ratings. The current study expanded on past research on rater agreement using a data set (n = 215) consisting of multi-rater data for professionals participating in a leadership development process. The study examined the ability to predict job performance with three different measures of self-other agreement (i.e., difference between overall mean scores (difference), mean absolute difference across items (difference), and mean correlation across items (similarity)). The study also examined how the relationships may differ across performance dimensions. The final purpose was to explore how the importance of the performance dimensions, as rated by the participant, may moderate the relationship between self-other agreement and job performance. Partial support for study's hypotheses was found. The direction and difference measures of …
Date: August 2008
Creator: Grahek, Myranda
System: The UNT Digital Library
Correlates of a Past Behavior Interview for the Business Unit Leader: Experience, Motivation, Personality and Cognitive Ability (open access)

Correlates of a Past Behavior Interview for the Business Unit Leader: Experience, Motivation, Personality and Cognitive Ability

This research evaluates the relationship between various individual differences constructs and performance on a past behavior interview (PBI)-one of the most popular forms of personnel selection interviews used today-within a sample of business unit leader level incumbents and applicants from organizations across the United States. Correlation analysis is conducted on the relationship between overall performance on a PBI and four work-related constructs: Experience, Motivation, Personality, and Cognitive Ability. The existing literature on PBIs and the four independent variables is critically reviewed. As limited research has been conducted on the influence of Experience and Motivation on PBI performance, this study makes unique contributions to the literature regarding impact of these two constructs. The major hypotheses stated that Experience and Motivation would yield significant, positive correlations with PBI performance while Personality and Cognitive Ability would not be significantly correlated with PBIs. Results partially supported the hypotheses-Experience, Motivation, and Personality were significantly related to overall PBI score, while Cognitive Ability was not. Implications for the findings as well as suggestions for future research are discussed.
Date: August 2008
Creator: Conner, Lane A.
System: The UNT Digital Library