Convergent and predictive validity of the big five factors assessed with singlestimulus and quasi-ipsative questionnaires

• Inmaculada Otero ^[1] ; Dámaris Cuadrado ^[1] ; Alexandra Martínez ^[1]
  1. [1] Universidade de Santiago de Compostela

     Universidade de Santiago de Compostela

     Santiago de Compostela, España

     
• Localización: Revista de psicología del trabajo y de las organizaciones = Journal of work and organizational psychology, ISSN 1576-5962, Vol. 36, Nº 3, 2020, págs. 215-222
• Idioma: inglés
• DOI: 10.5093/jwop2020a17
• Títulos paralelos:
  • La validez convergente y predictiva de los factores Big Five medidos con cuestionarios de estímulo único y quasiipsativos
• Enlaces
  • Texto completo (pdf)
• Dialnet Métricas: 8 Citas
• Resumen
  • español

    Esta investigación examina la validez convergente y discriminante y la validez predictiva de los cinco grandes factores de personalidad evaluados con dos formatos diferentes de inventarios de personalidad: estímulo único (SS) y de elección forzosa quasiipsativo (EF). También se analizó la relación entre los dos tipos de medidas e inteligencia (GMA). Los resultados mostraron que: (1) las medidas SS y las medidas EF quasiipsativas presentan una alta validez convergente y discriminante, (2) los cinco grandes factores de personalidad, evaluados con ambos cuestionarios, y GMA son constructos independientes y (3) ambos tipos de medidas de personalidad tienen validez predictiva similar para los tres criterios examinados (desempeño académico, éxito en la formación y competencia interpersonal). Como se esperaba, el mejor predictor del desempeño académico y del éxito en la formación fue el factor responsabilidad. La extraversión fue el mejor predictor de la competencia interpersonal. Finalmente, se comentan las implicaciones teóricas y prácticas de estos resultados.

  • English

    This research examines the convergent-discriminant and predictive validity of the Big Five personality dimensions assessed with two different formats of personality inventories: a single-stimulus (SS) and a quasi-ipsative forced-choice (FC). The relationship between both types of measures and intelligence (GMA) was also analyzed. The results showed that: (1) the SS and the quasi-ipsative FC measures present a high convergent-discriminant validity; (2) the Big Five personality dimensions, assessed with both questionnaires, and GMA are independent constructs; and (3) both types of personality measures have similar predictive validity for the three criteria examined (academic performance, training success, and interpersonal competence). As expected, conscientiousness was the best predictor of academic performance and training success. Extraversion was the best predictor of interpersonal competence. Finally, the theoretical and practical implications of these findings are discussed.

• Referencias bibliográficas
  • Adair, C. (2014). Interventions for addressing faking on personality assessments for employee selection: A meta-analysis (Unpublished doctoral...
  • Aguinis, H., Henle, C. A., & Ostroff, C. (2001). Measurement in work and organizational psychology. In N. Anderson, D. Z. Ones, H. K....
  • Barrick, M. R., & Mount, M. K. (1991). The Big Five personality dimensions and job performance: A meta-analysis. Personnel Psychology,...
  • Barrick, M. R., Mount, M. K., & Judge, T. A. (2001). Personality and performance at the beginning of the new millennium: What do we know...
  • Bartram, D. (2005). The Great Eight competencies: A criterion-centric approach to validation. Journal of Applied Psychology, 90(6), 1185-1203....
  • Bartram, D. (2007). Increasing validity with forced-choice criterion measurement formats. International Journal of Selection and Assessment,...
  • Benet-Martínez, V., & John, O. P. (1998). Los “cinco grandes” across cultures and ethnic groups: Multitrait multimethod analyses of the...
  • Berry, C. M., Ones, D. S., & Sackett, P. R. (2007). Interpersonal deviance, organizational deviance, and their common correlates: A review...
  • Birkeland, S. A., Manson, T. M., Kisamore, J. L., Brannick, M. T., & Smith, M. A. (2006). A meta-analytic investigation of job applicant...
  • Borman, W. C., Penner, L. A., Allen, T. D., & Motowidlo, S. J. (2001). Personality predictors of citizenship performance. International...
  • Brown, A., & Maydeu-Olivares, A. (2013). How IRT can solve problems of ipsative data in forced-choice questionnaires. Psychological Methods,...
  • Cao, M., & Drasgow, F. (2019). Does forcing reduce faking? A meta-analytic review of forced-choice personality measures in high-stakes...
  • Caprara, G. V., & Perugini, M. (1994). Personality described by adjectives: The generalizability of the Big Five to the Italian lexical...
  • Christiansen, N. D., Burns, G. N., & Montgomery, G. E. (2005). Reconsidering forced-choice item formats for applicant personality assessment....
  • Cohen, J. (1977). Statistical power analysis for the behavioral sciences. Academic Press.
  • Collins, J. M., Schmidt, F. L., Sanchez-Ku, M., Thomas, L., & McDaniel, M. (1999). Predicting assessment center ratings from cognitive...
  • Collins, J. M., Schmidt, F. L., Sanchez–Ku, M., Thomas, L., McDaniel, M. A., & Le, H. (2003). Can basic individual differences shed light...
  • Connolly, J. J., Kavanagh, E. J., & Viswesvaran, C. (2007). The convergent validity between self and observer ratings of personality:...
  • Converse, P. D., Oswald, F. L., Imus, A., Hedricks, C., Roy, R., & Butera, H. (2006). Forcing choices in personality measurement. In R....
  • Costa, P. T., & McCrae, R. R. (1992). Neo personality inventory-revised (NEO-PI-R) and neo five-factor inventory (NEO-FFI) professional...
  • Cuadrado, D., Salgado, J., & Moscoso, S. (2020). Counterproductive academic behaviors and academic performance: A meta-analysis and structural...
  • DeYoung, C. G., Quilty, L. C., & Peterson, J. B. (2007). Between facets and domains: 10 aspects of the Big Five. Journal of Personality...
  • Digman, J. M., & Takemoto-Chock, N. K. (1981). Factors in the natural language of personality: Re-analysis and comparison of six major...
  • Ferrando, P. J., & Lorenzo-Seva, U. (2014). Exploratory item factor analysis: Additional considerations. Anales de Psicología, 30(3),...
  • Goldberg, L. R. (1990). An alternative” description of personality”: The Big-Five factor structure. Journal of Personality and Social Psychology,...
  • Goldberg, L. R. (1992). The development of markers for the Big-Five factor structure. Psychological Assessment, 4(1), 26-42. https://doi.org/10.1037/1040-3590.4.1.26
  • Hicks, L. E. (1970). Some properties of ipsative, normative, and forced-choice normative measures. Psychological Bulletin, 74(3), 167-184....
  • Horn, J. L. (1971). Motivation and dynamic calculus concepts from multivariate experiment. In R. B. Cattell (Ed.), Handbook of multivariate...
  • Hough, L. M. (1992). The Big Five personality variables-construct confusion: Description versus prediction. Human Performance, 5(1-2), 139-155....
  • Hunter, J. E., & Hunter, R. F. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96(1),...
  • Hurtz, G. M., & Donovan, J. J. (2000). Personality and job performance: The Big Five revisited. Journal of Applied Psychology, 85(6),...
  • Jackson, D. N., Wroblewski, V. R., & Ashton, M. C. (2000). The impact of faking on employment tests: Does forced choice offer a solution?...
  • Joubert, T., Inceoglu, I., Bartram, D., Dowdeswell, K., & Lin, Y. (2015). A comparison of the psychometric properties of the forced choice...
  • Judge, T. A., Jackson, C. L., Shaw, J. C., Scott, B. A., & Rich, B. L. (2007). Self-efficacy and work-related performance: the integral...
  • Kuncel, N. R., Hezlett, S. H., & Ones, D. S. (2001). A comprehensive meta-analysis of the predictive validity of the graduate record examinations:...
  • Kuncel, N. R., Hezlett, S. A., & Ones, D. S. (2004). Academic performance, career potential, creativity, and job performance: Can one...
  • Lee, P., Lee, S., & Stark, S. (2018). Examining validity evidence for multidimensional forced choice measures with different scoring approaches....
  • Lim, B. C., & Ployhart, R. E. (2006). Assessing the convergent and discriminant validity of Goldberg’s International Personality Item...
  • Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A., & Tomás-Marco, I. (2014). El análisis factorial exploratorio de los ítems:...
  • Martínez, A. (2019). Evaluación empírica de un modelo teórico de los efectos del “faking” sobre las medidas de personalidad ocupacional [Empirical...
  • Morillo, D., Abad, F. J., Kreitchmann, R. S., Leenen, I., Hontangas, P., & Ponsoda, V. (2019). The journey from Likert to forced-choice...
  • Mount, M. K., & Barrick, M. R. (1995). The Big Five personality dimensions: Implications for research and practice in human resources...
  • Murphy, K. R. (2005). Why don’t measures of broad dimensions of personality perform better as predictors of job performance? Human Performance,...
  • Nguyen, N. T., & McDaniel, M. A. (2000, December). Brain size and intelligence: A meta-analysis. Paper presented at the 1ª Annual Conference...
  • Norman, W. T. (1963). Toward an adequate taxonomy of personality attributes: Replicated factor structure in peer nomination personality ratings....
  • Ones, D. S., Viswesvaran, C., & Dilchert, S. (2005). Cognitive ability in personnel selection decisions. In A. Evers, O. Voskuijl, &...
  • Organ, D. W., & Ryan, K. (1995). A meta-analytic review of attitudinal and dispositional predictors of organizational citizenship behavior....
  • Peabody, D., & Goldberg, L. R. (1989). Some determinants of factor structures from personality-trait descriptors. Journal of Personality...
  • Poropat, A. E. (2009). A meta-analysis of the five-factor model of personality and academic performance. Psychological Bulletin, 135(2), 322-338....
  • Poropat, A. E. (2014). A meta-analysis of adult-rated child personality and academic performance in primary education. British Journal of...
  • Postlethwaite, B. E. (2011). Fluid ability, crystallized ability, and performance across multiple domains: A meta-analysis (Doctoral dissertation)....
  • Richardson, M., Abraham, C., & Bond, R. (2012). Psychological correlates of university students’ academic performance: A systematic review...
  • Rosse, J. G., Stecher, M. D., Miller, J. L, & Levin, R. A. (1998). The impact of response distortion on preemployment personality testing...
  • Salgado, J. F. (1997). The Five Factor Model of personality and job performance in the European Community. Journal of Applied Psychology,...
  • Salgado, J. F. (1998a). Big Five personality dimensions and job performance in army and civil occupations: A European perspective. Human Performance,...
  • Salgado, J. F. (1998b). Manual técnico del inventario de personalidad de cinco factores (IP/5F) [Manual of the Five Factors of Personality...
  • Salgado, J. F. (2002). The Big Five personality dimensions and counterproductive behaviors. International Journal of Selection and Assessment,...
  • Salgado, J. F. (2003). Predicting job performance using FFM and non-FFM personality measures. Journal of Occupational and Organizational Psychology,...
  • Salgado, J. F. (2004, April). Moderator effects of job complexity on the Big Five validity. Poster presented at the 19th Annual Conference...
  • Salgado, J. F. (2010). Escalas de desempeño académico: CDTE, CDCE y CDAN [Academic performance scales: CDTE, CDCE, and CDAN] (Unpublished...
  • Salgado, J. F. (2014). Reliability, construct, and criterion validity of the Quasi-Ipsative Personality Inventory (QI5F/Tri). (Unpublish manuscript.)...
  • Salgado, J. F. (2016). A theoretical model of psychometric effects of faking on assessment procedures: Empirical findings and implications...
  • Salgado, J. F. (2017). Moderator effects of job complexity on the validity of forced-choice personality inventories for predicting job performance....
  • Salgado, J. F., Anderson, N., & Táuriz, G. (2015). The validity of ipsative and quasi-ipsative forced-choice personality inventories for...
  • Salgado, J. F., & Lado, M. (2018). Faking resistance of a quasi-ipsative forced-choice personality inventory without algebraic dependence....
  • Salgado, J. F., & Moscoso, S. (2019). The validity of general mental ability for five performance criteria: Hunter and Hunter (1984) revisited....
  • Salgado, J. F., Moscoso, S., & Anderson, N. (2013). Personality and counterproductive work behavior. In N. D. Christiansen & R. P....
  • Salgado, J. F., Moscoso, S., & Lado, M. (2003). Evidence of cross-cultural invariance of the big five personality dimensions in work settings....
  • Salgado, J. F., & Táuriz, G. (2014). The Five-Factor Model, forced-choice personality inventories and performance: A comprehensive meta-analysis...
  • Salgado, J. F., Viswesvaran, C., & Ones, D. S. (2001). Predictors used for personnel selection: An overview of constructs, methods and...
  • Saucier, G., & Goldberg, L. R. (1998). What is beyond the Big Five? Journal of Personality, 66(4), 495-524. https://doi.org/10.1111/1467-6494.00022
  • Saucier, G., & Goldberg, L. R. (2002). Assessing the Big Five: Applications of 10 psychometric criteria to the development of marker scales....
  • Scarpello, V. G., Ledvinka, J., & Bergmann, T. J. (1995). Human Resource Management. South-Western College Publishing.
  • Schmidt, F. L., & Hunter, J. E. (2015). Methods of meta-analysis: Correcting error and bias in research findings. Sage.
  • Scholz, G., & Schuler, H. (1993). Das nomologische Netzwerk des Assessment Centers: Eine Metaanalyse, [The nomological network of the...
  • Trapmann, S., Hell, B., Hirn, J. O. W., & Schuler, H. (2007). Meta-analysis of the relationship between the Big Five and academic success...
  • Vasilopoulos, N. L., Cucina, J. M., Dyomina, N. V., Morewitz, C. L., & Reilly, R. R. (2006). Forced-choice personality tests: A measure...
  • Viswesvaran, C., & Ones, D. S. (1999). Meta-analyses of fakability estimates: Implications for personality measurement. Educational and...
  • Viswesvaran, C., Ones, D. S., & Schmidt, F. L. (1996). Comparative analysis of the reliability of job performance ratings. Journal of...
  • Wonderlic (1992). Wonderlic Personnel Test & Scholastic Level Exam. User’s manual. Wonderlic, Inc.