Search

This study investigated whether faking in personality assessments affects the prediction of job performance and consequences of selection decisions when a nonlinear relationship was assumed between personality scores and job performance. It was also examined whether a selection strategy suggested for nonlinear relationships reduces the adverse impact of faking on consequences of selection decisions. The findings from the item response theory-based simulations indicated that the prediction of job performance was affected by faking, whereas selection accuracy was not substantially affected by faking. The improvement in selection accuracy due to the strategy suggested for a nonlinear relationship was not noticeable. However, the suggested strategy reduced adverse impacts of faking on the estimation of selected applicants' performance scores. [ABSTRACT FROM AUTHOR]

The most important fact emerging from the combination of my article and the three commentaries is the consensus judgment that content validity is appropriate scientifically and professionally for use with tests of specific cognitive skills used in job performance. This is important because the 1978 Uniform Guidelines on Employee Selection Procedures have typically been interpreted as not permitting such usage, and this is particularly the case in the interpretation given to the Guidelines by federal government enforcement agencies. Although the Society for Industrial and Organizational Psychology Principles and the Standards do not prohibit such usage, many industrial-organizational psychologists believe that it is not professionally or scientifically appropriate to employ content validity methods with cognitive measures. The hope is that this series will convince them otherwise. On this point, all four authors in the series are in agreement. The major disagreement among us concerns whether specific cognitive skills used in content valid tests must be considered constructs or not. My position, and apparently that of Kehoe, is that they need not be so considered. I argue that constructs must be invoked only in the context of a substantive theory. Sackett and Ployhart, on the other hand, argue that all measures taken on people must be viewed as constructs, regardless of whether any theoretical propositions and assumptions are involved. In this response, I present reasons why this need not be the case. [ABSTRACT FROM AUTHOR]

A work-specific measure of openness to experience was compared with the general NEO PI-R Openness scale for predicting supervisory ratings of creative performance at work. Results at the scale and facet levels indicated that the use of a consistent and criterion-matched frame of reference improved validity of this personality construct for the prediction of work-related creative problem solving. Scores from the Work-specific Openness scale significantly predicted creative work performance, whereas scores from the general measure did not. Results also showed incremental validity of the Work-specific scale over the NEO PI-R scale. Evidence is mounting that specifying a work context for personality measures can increase validity for predicting job performance beyond that typically observed when using general scales. [ABSTRACT FROM AUTHOR]

Despite the high skill levels needed to cope with complex technical systems and the pace of technological change, there remain persistent skill gaps in the United States workforce. Organizations are increasingly relying on skill-based programs to encourage and foster employee skill development. Unfortunately, many questions remain about how to make skill-based promotions. Drawing from research on performance testing and structured interviewing, as well as work that examines broader issues of performance prediction and candidate reactions, we outline the development and empirical test of a performance interview that can be used for skill-based promotions. Such interviews allow employees to demonstrate their skills on the job, and thus may be more accepted by employees. We first discuss seven design principles that form the conceptual foundation for the performance interview, followed by the specific steps practitioners can follow to develop a performance interview. Finally, using a sample of 230 auto parts manufacturing employees, we provide empirical evidence for the high reliability, validity, and positive candidate reactions to the performance interview. [ABSTRACT FROM AUTHOR]

The current study used a Social Relations Model to analyze self and peer ratings to explore the dynamics of team member perceptions and performance ratings. The results from 29 organizational teams who completed performance ratings of themselves and team members indicated that the most rating variance was attributed to the relationship component, followed by the ratee component, followed by the rater component. Among other findings, the results indicated that self-ratings were related to how one rates, and is rated by, others; that there were high levels of reciprocity between peers for dimensions that were interpersonal in nature; and that raters tended to evaluate others within, but not necessarily across, dimensions similarly. [ABSTRACT FROM AUTHOR]

This study uses data collected using a 360°-assessment instrument to investigate the structural equivalence of 360°-assessment ratings, according to rater type, controlling for organizational level. Data from 533 managers and their raters were employed in the study, which used multi-group structural equations modeling. Issues central to the implementation and use of 360°-assessment data are also considered within the context of current research and practice. [ABSTRACT FROM AUTHOR]

The choice of performance rating format may influence employees' fairness perceptions. Participants in two studies, one consisting of 208 participants and the other of 393 participants, evaluated the fairness of common relative and absolute rating formats. The participants in the second study also evaluated the fairness of two rating formats, one absolute and one relative, presented in organizational contexts of varying procedural and distributive justice. Results indicate that not only are absolute formats perceived as more fair than relative formats, but differences in fairness perceptions also occur among relative and absolute formats. Furthermore, it appears that rating format influences procedural justice, especially when outcomes are perceived as fair. Implications for organizations' appraisal practices are discussed. [ABSTRACT FROM AUTHOR]

The current study examines the influence of functional impulsivity on speeded ability test performance. As predicted, functional impulsivity was positively related to number of items attempted (i.e., speed), but its impact on total score was more complex. In particular, analysis of the relations between ability, functional impulsivity and accuracy revealed evidence of a suppressor effect. Specifically, functional impulsivity was found to be negatively related to accuracy, but only after ability differences were controlled. Taken as whole, the current results suggest functional impulsivity may influence test-taking behavior, but it likely does not result in a systematic influence on observed scores. Directions for further research needed to clarify these relations are discussed. [ABSTRACT FROM AUTHOR]

Although there has been empirical attention paid to the criterion-related validity of predictor composites, there has been much less attention paid to the standardized ethnic group differences associated with these composites. One important area of inquiry in predictor composite research is the influence of adding predictors to a test of general mental ability. The limited empirical literature on this practice is mixed, but the prevailing expectation is that there is likely to be higher validity and less adverse impact. Unfortunately, much of the previous work is limited by the presence of inaccurate validity and standardized ethnic group difference values. In this analysis we formed meta-analytic matrices to more accurately estimate the validity and standardized ethnic group differences of several composites that combine a measure of cognitive ability with measures of conscientiousness, a structured interview, or biodata. While results were somewhat complex, we found that adding alternative predictors does not result in a situation in which validity automatically goes up and adverse impact potential automatically goes down. In fact, the reductions in adverse impact (if any) from adding “non-cognitive” predictors were more modest than much of the literature suggests. [ABSTRACT FROM AUTHOR]

This study investigates the effects of rater personality (Conscientiousness and Agreeableness), rating format (graphic rating scale vs. behavioral checklist), and the rating social context (face-to-face feedback vs. no face-to-face feedback) on rating elevation of performance ratings. As predicted, raters high on Agreeableness showed more elevated ratings than those low on Agreeableness when they expected to have the face-to-face feedback meeting. Furthermore, rating format moderated the relationship between Agreeableness and rating elevation, such that raters high on Agreeableness provided less elevated ratings when using the behavioral checklist than the graphic rating scale, whereas raters low on Agreeableness showed little difference in elevation across different rating formats. Results also suggest that the interactive effects of rater personality, rating format, and social context may depend on the performance level of the ratee. The implications of these findings will be discussed. [ABSTRACT FROM AUTHOR]

The last decade has witnessed a resurgence of organizational socialization research. However, a critical question has been neglected: Is there a common underlying pattern to organizational socialization? We investigated newcomer learning, job satisfaction and intent to quit as common indicators of socialization, in research with 222 newcomers at two organizations during the crucial post-entry period. The results support a learning-dependent model of newcomer adjustment, with learning in specific domains related to improved attitudinal outcomes. Some aspects of organizational socialization were not uniform across the two organizations, suggesting a need for further development of socialization models and greater accounting for this in organizational socialization research. [ABSTRACT FROM AUTHOR]

Theorists have argued that impression management scales should predict job performance in jobs where interpersonal interactions are important. This research examined the correlation between impression management scale scores and overall job performance as well as its component dimensions for managerial jobs (one type of job requiring considerable interpersonal interaction). First, a meta-analysis was conducted to determine the relationship between impression management scale scores and overall managerial performance. Results indicated that the correlation was .04 (k=17, N=20,069) for managers. Two additional studies were conducted to investigate the relationship between impression management and specific facets or dimensions of managerial performance. In one of these two studies, the relationships between impression management scores and supervisory ratings on 24 performance facets were investigated for 826 managers. Criterion-related validities ranged from -.06 to .07. In the second study, correlations of an impression management scale with ratings on 22 dimensions of performance were examined using a sample of 257 executives. The validities ranged from .01 to .11. There appears to be little evidence that impression management scales predict job performance in at least one job category where interpersonal interactions are important (management). Potential relevance of these results for understanding social desirability in personality measurement for personnel selection is discussed. [ABSTRACT FROM AUTHOR]

An important issue in personnel selection and test validation has been the nature of performance criteria and more specifically the existence of dynamic criteria. There is a continuing debate regarding the extent to which performance and validity coefficients remain stable over time. We examine research within work, laboratory, and academic settings and evaluate existing models of dynamic criteria. Building on previous models, we propose an integrative model of dynamic criteria that identifies important issues for ability and performance constructs and discusses how variables related to the task, job, and organization can affect the temporal stability of criterion performance and the ability-performance relationship. [ABSTRACT FROM AUTHOR]

Some job tasks do not lend themselves to formal on-the-job assessment because they do not occur with sufficient regularity to permit the standardized measurement required in validational research. The preparation of incident reports by police and security officers is such a job task. The production of accurate, literate incident reports is important because these reports are often required in legal proceedings. Their standardized evaluation on the job is not practical because incidents occur at unpredictable intervals with highly variable content. Given the limitations of on-the-job performance criteria, we developed a standardized work sample by preparing sets of non-verbal drawings depicting incidents, each of which required a written descriptive report by security officers. A total of 187 security officers completed a cognitive and personality test battery and criterion incident reports based on the standardized materials. Reports supported the usefulness of the standardized work sample, as well as the validity of the test battery — 100% of participants in the upper quartile of the test score distribution produced satisfactory reports, while only 17% of those in the lowest quartile produced satisfactory incident reports. A number of advantages of structured work samples as criterion measures are noted, including their greater standardization, the elimination of range restriction problems by administering them to all job candidates, the opportunity to obtain expert evaluations of work samples at remote sites, and their face and content validity resulting in acceptability to job candidates and to decision makers. [ABSTRACT FROM AUTHOR]

Discusses the utility of a job selection technique. Importance of the selection test on predicting job performance; Effect of the face-valid selection technique on the application process and job applicants.