It is important to note at this point that job analysis should be conducted prior to test selection in order to choose the most related scale, as specific traits predict job performance better than general traits (Tett et al., 1991). In other words, assessments will be more useful if they are tailored to, or at least closely related to, the job in question.
One other key finding of Goldberg is that shortened versions of personality assessments – which are often popular with HR practitioners because of the substantial time and financial costs of longer inventories – are less useful as predictors of overall job performance. Clearly, this should be considered by professionals when choosing they are deciding what test to use. There are a few other issues which should be considered prior to using one of the numerous personality assessments available, not least the possibility that a personality test, per se, might not be the most effective tool to use in all cases.
For example, Holland’s Vocational Types theory – and Self Directed Search (SDS) test – was the subject of much analysis in the 1970s and was generally offered both qualitative and quantitative support (e.g., Edwards & Whitney, 1972 and Eggenberger & Herman, 1972). Recently, it has been suggested that vocational types are better predictors of person-job fit than personality factors (Ehrhart & Makransky, 2007). It follows that if the HR professional is searching for a recruitment method (as opposed to a development tool) they should consider the methods besides personality assessment in order to choose the most suitable for their particular task.
Interactions
In practice many professionals do use multiple assessment methods to select employees. This helps to control for the various mediators and moderators affecting the predictive validity of personality traits.
General mental ability (GMA) is viewed by most recruiters as very important in selection processes and as such is commonly measured alongside personality (Dunn et al., 1995). Interests are also thought to interact with personality factors to predict job performance (Rothstein and Goffin, 2006) and, similar to intelligence testing, it is possible and indeed useful to test simultaneously.
It is not clear whether this broad testing method stems from a detailed knowledge of the interactions between personality and performance - for example, the moderating effect of autonomy on the predictive validity of Conscientiousness and Extraversion for manager job performance (Barrick and Mount, 1993) - or whether it is simply protocol in many organisations. Whichever, it does help to increase the usefulness of personality assessment in work settings.
Generally speaking, most HR professionals use multiple assessment techniques for recruitment, particularly for higher-level jobs. From this perspective the main factors interacting with personality are assessed concurrently, providing that a personality test has been selected. However, it is important to have an understanding of the specific mediating effects of, for example, goal setting behaviours between conscientiousness and job performance (Barrick et al.,1993), so that suitable items and assessments can be included for each specific job.
Self-rating
Of the many different personality assessments currently on the market the majority are self report measures, often based on the Big 5 trait theory. The most commonly used tests include the well-known Occupational Personality Questionnaire (OPQ), the NEO Personality Inventory - Revised (NEO-PI-R) and the Myers Briggs Type Inventory (MBTI). The self-report nature of these personality tests is one issue which may cause problems and should be considered prior to usage.
According to a study by Mount et al. (1994) the validity of self and external ratings of personality was approximately equal, but external ratings explained variance in job performance better than self-ratings. Judge et al. (1999) provide supporting evidence; external ratings of personality in childhood predict later occupational success. This suggests that the use of self-rating personality assessments might not be the optimum method for predicting job performance (Barrick et al., 2001). Most occupational personality measures are used for recruitment and it would probably be impractical to use an externally rated scale in this context, but where personality tests are used for career development purposes it might be useful to obtain external ratings. The current popularity of 360 degree appraisal methods (Luthens and Peterson, 2003) indicates that HR professionals are aware of the benefits of external ratings and are willing to use them for employee development. However, recent research into whether external ratings are superior has proved somewhat inconclusive (Hooft et al., 2006). It appears that further investigation is needed. Nevertheless a HR professional should be aware of the alternatives to a self-rating method as they may increase the usefulness of personality assessment in the workplace.
Faking
Aside from the issues mentioned above, the main drawback to self-rating is the social desirability effect. Individuals attempt to portray themselves in the way they assume the administrator will prefer, thus reducing the usefulness of personality scores (Rothstein and Goffin, 2006). This has become arguably the biggest and most long-standing issue for HR professionals with regards to personality testing and is possibly the main disadvantage of the method. Naturally, a large body of research has developed relating to faking and the social desirability effect.
Viswesvaran and Ones (1999) offer a meta-analysis on faking. They report that in applied and laboratory settings participants increase their scores for desirable traits and decrease their scores for undesirable traits when attempting to present themselves positively. More recently, Donovan et al. (2003) attempted to find the base rate of faked responses to personality inventory type items. This spanned a range of 15% to 62%, with the highest base rates on undesirable traits. In other words, individuals are more likely to decrease their scores on negative traits than to increase them on positive traits. Also, perhaps unsurprisingly, some individuals fake more than others. From a HR perspective this is clearly very undesirable, and due to its unpredictability, hard to control for.
Numerous studies have shown acceptable levels of criterion validity in personality tests, even when perceived motivation for faking is high (e.g., Hough, 1998). However, Mueller-Hanson et al. (2003) note that where personality testing is used as part of a selection procedure applicants who fake to the ideal are more likely to be hired. Based on this, they suggest that personality tests should be used to select-out applicants (i.e., identify those who are unsuitable) rather than select-in. In practice, selection-in use is more prevalent that select-out and subsequent evidence has indicated that the effectiveness of personality assessment for selection-in does not appear to be completely neutralised by faking, although it is decreased (Hogan, 2005). To ensure personality inventories are sufficiently effective for employee selection it is useful to identify or minimise opportunities to fake.
Controlling for faking
From these studies it can be seen that it is necessary for HR practitioners to be aware of, and to utilise, methods to decrease the effects of socially desirable responding as far as possible. To this enc, some commercial tests include items which have been shown to be sensitive to instructions to fake good (Viswesvaran & Ones, 1999). Scoring highly on these items indicates to the HR professional that the individual may be faking. There are some ethical questions concerning the responses taken by the practitioner when faced with this result. To exclude the applicant from the rest of the selection process implies that they have tried to cheat the test, when in fact they may have been honest. Paulhus et al. (2003) uses a typical SDR item to illustrate the point: it is impossible to tell whether an individual who denies ever swearing is being honest or not.
An alternative technique uses SDR scales to ‘correct’ for faking. This method, however, has in recent years been consistently shown not to improve validity. It is thought that scoring highly on SDR scales might not be due to faking but to actual personality differences (e.g., Ones and Viswesvaran, 1998). Hakstian and Ng (2005) and Paulhus (2002) propose new, relatively untested, methods for correcting for faking: employment-related motivation distortion (EMD) and a four-dimensional approach, respectively. Initial data suggests these techniques do show a limited ability to increase criterion validity, but HR professionals should monitor the emerging research to confirm whether subsequent evidence confirms this.
Forced choice testing is another method of controlling for faking. In theory, all choices presented have the same level of social desirability and thus SDR will not be an issue. Early forced choice personality tests were actually very susceptible to change when participants were asked to fake-good, but contemporary tests are more resistant to this effect (Martin et al., 2002), particularly when tailored to a specific job (Christiansen et al., 2005). In this case construct validity appears to increase, compared to traditional assessments. The long and costly development time involved with role-targeted forced choice tests is the main disadvantage for HR practitioners but there are some commercially available forced choice tests, the OPQ, for example.
A much simpler technique of controlling for faking is simply telling participants that a method of detection is in use. Applicants are thought to respond more honestly if they believe their answers can be verified (Donovan et al., 2003). With or without the more complex measures, HR professionals should definitely consider the use of this straightforward measure.
Summary
The main issues HR professionals should be aware of are test-selection, self-rating, faking and the interaction of personality with other factors. Once the suitable test has been selected, faking is possibly the most researched and important issue for practitioners, because it significantly affects the ability to confidently select applicants.
All of the issues mentioned are, of course, relative to context. The most suitable test to predict the job performance for a junior sales role, for example, would be very different from that to predict job performance in a senior executive role. If an incorrect or unsuitable test has been used it will probably not be useful for predicting job performance. Overall, though the use of personality assessments in the workplace is successful, subject to professionals being aware of the issues discussed in this paper. More research is needed into personality testing as a predictor job performance in order to further increase its usefulness in the workplace.
Word count: 2138
References
-
Barrick, M. R. & Mount, M. K. (1991). The big five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1-26.
-
Barrick, M. R. & Mount, M. K. (1993). Autonomy as a moderator of the relationship between the Big Five personality dimensions and job performance. Journal of Applied Psychology, 78(1), 111–118.
-
Barrick, M. R., Mount, M. K. & Judge, T. A. (2001). Personality and performance at the beginning of new millenium: What do we know and where do we go next? International Journal of Selection and Assessment, 9(1/2), 9-30.
-
Barrick, M. R., Mount, M. K. & Strauss, J. P. (1993). Conscientiousness and performance of sales representatives: Test of the mediating effects of goal setting. Journal of Applied Psychology, 78(5), 715–722.
-
Christiansen, N. D., Burns, G. N. & Montgomery, G. E. (2005). Reconsidering forced-choice item format for applicant personality assessment. Human Performance, 18, 267–307.
-
Donovan, J. J., Dwight, S. A. & Hurtz, G. M. (2003). An assessment of the prevalence, severity and verifiability of entry-level applicant faking using the randomized response technique. Human Performance, 16, 81–106.
-
Dunn, W., Mount, M., Barrick, M. & Ones, D. (1995). Relative importance of personality and general mental ability in managers’ judgement of applicant qualifications. Journal of Applied Psychology, 80(4), 500-509.
-
Edwards, K. J. & Whitney, D. R. (1972). Structural analysis of Holland's personality types using factor and configural analysis. Journal of Counseling Psychology 19(2), 136-145.
-
Eggenberger, J. & Herman, A. (1972). The Strong inventory and Holland's theory. Journal of Vocational Behavior 2(4), 447-456.
Ehrhart, K. H. & Makransky, G. (2007). Testing Vocational Interests and Personality as Predictors of Person-Vocation and Person-Job Fit. Journal of Career Assessment, 15(2), 206-226.
-
Erdheim, J., Wang, M. & Zickar, M. J. (2006). Linking the Big Five personality constructs to organizational commitment. Personality and Individual Differences, 41(5), 959-970.
-
Faulder, L. (2005, Jan 9). The growing cult of personality tests. Edmonton Journal, D.6.
Goldberg, L. R. (In press). The Comparative Validity of Adult Personality Inventories: Applications of a Consumer-Testing Framework. In S. R. Briggs, J. M. Cheek & E. M. Donahue (Eds.).
Handbook of Adult Personality Inventories. New York: Plenum Publishing Corp. Accessed May 2, 2009 from http://ipip.ori.org/ipip/newInventoriesText.htm
-
Guion, R. M. & Gottier, R. F. (1965). Validity of personality measures in personnel selection. Personnel Psychology, 18(2), 135–164.
-
Hakstian, A. R. & Ng, E. (2005). Employment related motivational distortion: Its nature, measurement, and reduction. Educational and Psychological Measurement, 65, 405–441.
-
Hogan, R. (2005). In defence of personality measurement: New wine for old whiners. Human Performance, 18, 331–341.
-
Hooft, E. A., Van der Flier, H. & Minne, M. R. (2006). Construct Validity of Multi-Source Performance Ratings: An Examination of the Relationship of Self-, Supervisor-, and Peer-Ratings with Cognitive and Personality Measures. International Journal of Selection and Assessment, 14(1), 67-81.
-
Hough, L. M. (1998). Effects of intentional distortion in personality measurement and evaluation of suggested palliatives. Human Performance, 11, 209–244.
-
Judge, T. A., Heller, D. & Mount, M. K. (2002). Five-factor model of personality and job satisfaction: A meta-analysis. Journal of Applied Psychology, 87(3), 530-541.
-
Luthens, S. & Peterson, S. J. (2003). 360-degree feedback with systematic coaching: Empirical analysis suggests a winning combination. Human Resource Management, 42(3), 243–256.
-
Martin, B. A., Bowen, C. C. & Hunt, S. T. (2002). How effective are people at faking on personality questionnaires? Personality and Individual Differences, 32, 247–256.
- Mount, M. K. & Barrick, M. R. (1995). The Big Five personality dimensions: Implications for research and practice in human resource management. In G. Ferris (Ed.), Research in personnel and human resource management, 13 (pp. 153-200). Stamford, CT: JAI.
-
Mueller-Hanson, R., Hegestad, E. D. & Thornton, G. C. (2003). Faking and selection: Considering the use of personality from select-in and select-out perspectives. Journal of Applied Psychology, 88, 348–355.
-
Ones, D. S. & Viswesvaran, C. (1998). The effects of social desirability and faking on personality and integrity assessment for personnel selection. Human Performance, 11, 245–269.
-
Orvis, K. A., Dudley, N. M. & Cortina, J. M. (2008). Conscientiousness and reactions to psychological contract breach: A longitudinal field study. Journal of Applied Psychology, 93(5), 1183-1193.
-
Paulhus, D. L. (2002). Socially desirable responding: The evolution of a construct. In H. I. Braun, D. N. Jackson & D. E. Wiley (Eds.), The role of constructs in psychological and educational measurement (pp. 49–69). Mahwah NJ: Erlbaum.
-
Paulhus, D. L., Harms, P. D., Bruce, M. N. & Lysy, D. C. (2003). The Over-Claiming Technique: Measuring Self-Enhancement Independent of Ability. Journal of Personality and Social Psychology 84(4), 890–904.
-
Personality Assessment. (2009). Retrieved May 2, 2009 from http://www.shl.com/WhatWeDo/PersonalityAssessment/default.aspx
-
Rothstein, M. G. & Goffin, R. D. (2006). The use of personality measures in personnel selection: What does current research support? Human Resource Management Review 16, 155–180.
-
SHL facts. (2009). Retrieved May 2, 2009, from http://www.shl.com/AboutSHL/Pages/SHLFacts.aspx
-
Tett, R. P., Jackson, D. N. & Rothstein, M. G. (1991). Personality measures as predictors of job performance: A meta-analytic review. Personnel Psychology, 44, 703–742.
-
Viswesvaran, C. & Ones, D. S. (1999). Meta-analyses of fakability estimates: Implications for personality measurement. Educational and Psychological Measurement, 59, 197–210.