Justin A. DeSimone

Publications and References

Overview

This page provides an overview of my research contributions across topics including measurement, personality, statistical techniques, and careless responding. Each section contains summaries of each publication describing the scope and impact of the research. Links to each article are included for anyone interested in exploring the studies in more detail.

Publication Topics

Careless Responding

My work on careless responding focuses on the causes, detection, and consequences of insufficient effort responding (IER) in surveys and tests. I have shown how behaviors such as straightlining, random responding, and fatigue can distort psychometric properties, confound associations between measures, and undermine the validity of conclusions. I also identify substantive predictors of IER, explore practical data-screening techniques, and provide guidance for both researchers and practitioners on mitigating the threat of low-quality responses.

Measurement

My research on measurement and psychometrics advances the science of assessment by developing and refining tools that capture personality, resilience, passion, and risk propensity more accurately. I have examined the reliability, validity, and psychometric properties of both established and newly developed instruments, incorporating innovative approaches such as conditional reasoning and item response theory. Through this work, I provide both conceptual clarity and practical guidance for scholars and practitioners who rely on robust measures to study behavior, performance, and well-being.

Personality

My research on personality explores both explicit and implicit traits, focusing on how they shape behavior, decision-making, and organizational outcomes. I have examined personality constructs ranging from dark traits and maladaptive dimensions to implicit motives assessed through conditional reasoning, while also clarifying conceptual foundations such as justification mechanisms and ambition. This work advances theory and practice by deepening our understanding of how personality is measured, expressed, and applied in workplace and leadership contexts.

Statistical Techniques

I have contributed to advancing statistical methods in organizational research by developing and evaluating tools that improve the way we interpret reliability, meta-analyses, and complex variance structures. My work highlights the importance of examining temporal consistency, situational specificity, and corrections for measurement error while also pointing out common pitfalls in citing or reviewing meta-analytic findings. Across these projects, I seek to provide researchers with clearer, more transparent, and more accurate tools for designing studies, interpreting data, and building stronger cumulative science.

Other

My work addresses a diverse set of topics that cut across organizational research methods, leadership, workforce well-being, and broader social issues. I explore emerging phenomena such as online data collection, questionable research practices, authorship fairness, and antiwork attitudes. I also contribute to applied topics like leadership, entrepreneurship education, and the role of meetings. These projects highlight my commitment to advancing both methodological rigor and practical relevance across various topics in organizational scholarship.

References

  1. Banks, G. C., Ramussen, L. M., Tonidandel, S., Pollack, J. M., Hausfeld, M. M., Williams, C., Albritton, B. H., Allen, J. A., Bastardoz, N., Batchelor, J. H., Bennett, A. A., Briker, R., Castille, C. M., De Jong, B. A., Demeter, E., DeSimone, J. A., Gonzalez-Brambila, C. N., Field, J. G., Figueroa-Armijos, M., …, & Yang, T. (2025). Women’s and men’s authorship experiences: A prospective meta-analysis. Journal of Management, 51, 1273-1287.

  2. Baxley, A. D., DeSimone, J. A., Svyantek, D. J., & Noll, K. (2024). A conditional reasoning test for risk and incident propensity: Development and validation Journal of Applied Psychology, 109, 1159-1177.

  3. Bowling, N. A., Gibson, A. M., & DeSimone, J. A. (2022). Stop with the questions already! Does data quality suffer for scales positioned near the end of a lengthy questionnaire? Journal of Business and Psychology, 37, 1099-1116.

  4. Bowling, N. A., Huang, J. L., & DeSimone, J. A. (2025). Insufficient effort responding to psychological assessments: Practical advice for combating a serious threat to data quality [White paper]. Society for Industrial and Organizational Psychology. Link

  5. DeSimone, J. A. (2017). Ambition. In S. G. Rogelberg (Ed.), The SAGE encyclopedia of industrial and organizational psychology (2nd ed., pp. 45-46). Thousand Oaks, CA: Sage.

  6. DeSimone, J. A. (2016). Exemplary exercises for entrepreneurship education. Management Teaching Review, 1, 170-175.

  7. DeSimone, J. A. (2015). New techniques for evaluating temporal consistency. Organizational Research Methods, 18, 133-152.

  8. DeSimone, J. A. (2016). What else are we missing? Additional issues associated with sample misrepresentation. Industrial and Organizational Psychology: Perspectives on Science and Practice, 9, 129-137.

  9. DeSimone, J. A. (2014). When it’s incorrect to correct: A brief history and cautionary note. Industrial and Organizational Psychology: Perspectives on Science and Practice, 7, 527-531.

  10. DeSimone, J. A. (2014). Will exploring the darkness prove enlightening? Five questions about the “Maladaptive Big Five.” Industrial and Organizational Psychology: Perspectives on Science and Practice, 7, 126-130.

  11. DeSimone, J. A., Brannick, M. T., O’Boyle, E. H., & Ryu, J. W. (2021). Recommendations for reviewing meta-analyses in organizational research. Organizational Research Methods, 24, 694-717.

  12. DeSimone, J. A., Davison, H. K., Schoen, J. L., & Bing, M. N. (2020). Insufficient effort responding as a meaningful construct and a partial function of latent aggression. Organizational Research Methods, 23, 154-180.

  13. DeSimone, J. A., DeSimone, A. J., Harms, P. D., & Wood, D. (2018). The differential impacts of two forms of insufficient effort responding. Applied Psychology: An International Review, 67, 309-338.

  14. DeSimone, J. A., & Fezzey, T. (2023). Is it also time to revisit situational specificity? Industrial and Organizational Psychology: Perspectives on Science and Practice, 16, 317-321.

  15. DeSimone, J. A., & Harms, P. D. (2018). Dirty data: The effects of screening respondents who provide low-quality data in survey research. Journal of Business and Psychology, 33, 559-577.

  16. DeSimone, J. A., Harms, P. D., & DeSimone, A. J. (2015). Best practice recommendations for data screening. Journal of Organizational Behavior, 36, 171-181.

  17. DeSimone, J. A., Harms, P. D., Vanhove, A. J., & Herian, M. N. (2017). Development and validation of the Five-by-five Resilience Scale. Assessment, 24, 778-797.

  18. DeSimone, J. A. & James, L. R. (2015). An analysis of the item characteristics of the Conditional Reasoning Test of Aggression. Journal of Applied Psychology, 100, 1872-1886.

  19. DeSimone, J. A., Köhler, T., & Schoen, J. L. (2019). If it were only that easy: The use of meta-analytic research by organizational scholars. Organizational Research Methods, 22, 867-891.

  20. DeSimone, J. A. & LeBreton, J. M. (2018). Attenuation, Correction for. In B. B. Frey (Ed.), The SAGE encyclopedia of educational research, measurement and evaluation (pp. 138-139). Thousand Oaks, CA: Sage.

  21. DeSimone, J. A., Schoen, J. L., & Köhler, T. (2023). Reliability. In L. R. Ford & T. A. Scandura (Eds.), The SAGE Handbook of Scale Development and Application (pp. 185-198). London, Sage

  22. Geimer, J. L., Leach, D. J., DeSimone, J. A., Rogelberg, S. G., & Warr, P. B. (2015). Meetings at work: Perceived effectiveness and recommended improvements. Journal of Business Research, 68, 2015-2026.

  23. Harms, P. D., Credé, M., & DeSimone, J. A. (2018). The last line of defense: Corrigenda and retractions. Industrial and Organizational Psychology: Perspectives on Science and Practice, 11, 61-65.

  24. Harms, P. D. & DeSimone, J. A. (2015). Caution! Mturk workers ahead – fines doubled. Industrial and Organizational Psychology: Perspectives on Science and Practice, 8, 183-190.

  25. Harms, P. D., Wood, D., & DeSimone, J. A. (2019). Just because it’s dark doesn’t mean that we can’t go there. Industrial and Organizational Psychology: Perspectives on Science and Practice, 12, 206-210.

  26. Huang, J. L., & DeSimone, J. A. (2021). Insufficient effort responding as a potential confound between survey measures and objective tests. Journal of Business and Psychology, 36, 807-828.

  27. James, L. R., LeBreton, J. M., Mitchell, T. R., Smith, D. R., DeSimone, J. A., Cookson, R., & Lee, H. J. (2013). Use of conditional reasoning to measure the power motive. In R. Landis & J. M. Cortina (Eds.), Modern research methods for the study of behavior in organizations (pp. 233-263). San Francisco: Jossey-Bass.

  28. Kerry, M. J., & DeSimone, J. A. (2019). Learning organizational ambidexterity: A joint-variance synthesis of exploration-exploitation modes on performance. The Learning Organization, 26, 352-380.

  29. Köhler, T., DeSimone, J. A., & Schoen, J. L. (2020). Prestige does not equal quality: Lack of research quality in high-prestige journals. Industrial and Organizational Psychology: Perspectives on Science and Practice, 13, 321-327.

  30. Landay, K. M., DeSimone, J. A., & Harms, P. D. (2022). A psychometric investigation of harmonious and obsessive work passion. Journal of Organizational Behavior, 43, 1535-1561.

  31. Lester, P., Harms, P. D., & DeSimone, J. A. (2024). Taken to the Extreme: Transformational Leadership, Psychological Capital, and Follower Health Outcomes in Extreme Contexts. Military Psychology, 36, 137-147.

  32. Olson, A. M., DeSimone, J. A., Mills, M. J. Ford, M. T., & Butler, S. (2024). A tale of two antiworks. Industrial and Organizational Psychology: Perspectives on Science and Practice, 17, 79-84.

  33. Schoen, J. L., DeSimone, J. A., James, L. R. (2011). Exploring joint variance between independent variables and a criterion: Meaning, effect, and size. Organizational Research Methods, 14, 674-695.

  34. Schoen, J. L., DeSimone, J. A., Meyer, R. D., Schnure, K. A., & LeBreton, J. M. (2021). Identifying, defining, and measuring justification mechanisms: The implicit biases underlying individual differences. Journal of Management, 47, 716-744.

  35. Vanhove, A. J., Harms, P. D., & DeSimone, J. A. (2016). The Abbreviated Character Strengths Test (ACST): A preliminary assessment of test validity. Journal of Personality Assessment, 98, 536-544.

  36. Wood, D., Harms, P. D., Lowman, G. H., & DeSimone, J. A. (2017). Response speed and response consistency as mutually validating data screens in online samples. Social Psychological and Personality Science, 8, 454-464.