Development and validation of a neuroticism scale: Assessment of reliability and validity
Neuroticism, a personality trait linked to emotional instability and negative emotions, is associated with increased anxiety, depression, and poor mental health outcomes, particularly in individuals with psychiatric disorders. However, existing neuroticism scales often have too many items, are not tailored for psychiatric populations, and lack cultural adaptation for Chinese contexts. We aimed to develop a brief neuroticism scale with adequate reliability and validity for the Chinese population, including individuals with psychiatric disorders. The 14-item scale was developed based on the five-factor model and Eysenck’s personality theory. The scale, in the form of a questionnaire, was distributed to college students from Southeast University and patients from the Affiliated Zhongda Hospital of Southeast University. A total of 554 participants were recruited, and demographic information, the neurotic subscale of the Neuroticism Extraversion Openness Five-Factor Inventory (NEO-FFI), Patient Health Questionnaire (PHQ-9), and generalized anxiety disorder (GAD-7) were collected along with the neuroticism scale. Correlation analysis, Cronbach’s alpha, exploratory factor analysis (EFA), and confirmatory factor analysis (CFA) were conducted to test and revise the scale. EFA indicated that the neuroticism scale consisted of four factors: Low self-esteem, excessive emotional sensitivity, unstable mood, and excessive worry. The Cronbach’s alpha was 0.926. CFA suggested a good fit of the scale structure (χ2/df =2.506, root mean square error of approximation =0.039, Tucker–Lewis index =0.947, comparative fit index =0.959, and standardized root mean square residual =0.032). The total scores of the neuroticism scale were positively related to those of PHQ-9, GAD-7, and NEO-FFI. The results indicate that the neuroticism scale exhibited a stable four-dimensional structure with good reliability and validity in the Chinese population. It is useful and time-saving for assessing neuroticism in individuals with psychiatric disorders.
- Huang Y, Zhou R, Wu M. Neurophysiological mechanism of neuroticism. Adv Psychol Sci. 2015;23(4):602-613. doi: 10.3724/SP.J.1042.2015.00602
- Lahey BB. Public health significance of neuroticism. Am Psychol. 2009;64(4):241-256. doi: 10.1037/a0015309
- Ding JL, Tian H. A review of Honey’s neurosis theory. Med Philos (Humanit Soc Med). 2007(6);28:43-45.
- Mats BK. Eysenck’s theory of personality and the role of background music in cognitive task performance: A mini-review of conflicting findings and a new perspective. Front Psychol. 2017;14(8):1991. doi: 10.3389/fpsyg.2017.01991
- McCrae RR, Sutin AR. A five-factor theory perspective on causal analysis. Eur J Pers. 2018;32(3):151-166. doi: 10.1002/per.2134
- Gu SQ, Xi XN, Cheng ZH, Wu ZG, Wang GQ. The relationship between personality and mental health in college students. Chin J Clin Psychol. 2014;22(2):354-356.
- Rydberg Sterner T, Gudmundsson P, Sigström R, et al. Depression and neuroticism decrease among women but not among men between 1976 and 2016 in Swedish septuagenarians. Acta Psychiatr Scand. 2019;139(4):381-394. doi: 10.1111/acps.13005
- O’Loughlin, RE, Fryer JW, Zuckerman M. Mindfulness and stress appraisals mediate the effect of neuroticism on physical health. Pers Individ Differ. 2019;142:122-131. doi: 10.1016/j.paid.2019.01.019
- García Herrero AM, Sánchez-Meca J, Álvarez Muñoz FJ, Rubio-Aparicio M, Navarro-Mateu F. Neuroticism and suicidal thoughts: A meta-analytic study. Rev Esp Salud Publica. 2018;92:e201808049.
- Mohiyeddini C, Bauer S, Semple S. Neuroticism and stress: The role of displacement behavior. Anxiety Stress Coping. 2015;28(4):391-407. doi: 10.1080 / 10615806.2014.1000878
- Ferrando PJ. The measurement of neuroticism using MMQ, MPI, EPI and EPQ items: A psychometric analysis based on item response theory. Pers Individ Differ. 2001;30:641-656. doi: 10.1016/s0191-8869(00)00062-3
- Uliaszek AA, Hauner KK, Zinbarg RE, et al. An examination of content overlap and disorder-specific predictions in the associations of neuroticism with anxiety and depression. J Res Pers. 2009;43(5):785-794. doi: 10.1016/j.jrp.2009.05.009
- Costa PT, McCrae RR. Stability and change in personality assessment: The revised NEO personality inventory in the year 2000. J Pers Assess. 1997;68(1):86-94. doi: 10.1207/s15327752jpa6801_7
- Keuthen NJ, Tung ES, Tung MG, Curley EE, Flessner CA. NEO-FFI personality clusters in trichotillomania. Psychiatry Res. 2016;239:196-203. doi: 10.1016/j.psychres.2016.03.011
- Uliaszek AA, Al-Dajani N, Sellbom M, Bagby RM. Cross-validation of the demoralization construct in the revised NEO personality inventory. Psychol Assess. 2019;31(2):159-166. doi: 10.1037/pas0000655
- Zhang WP. Preparation of Neurotic Questionnaire for College Students and Its Relationship with Physical and Mental Health. China: Southwest University; 2011.
- Bu T, Liu HJ. Preparation of family resilience questionnaire. Psychol Technol Appl. 2019;7(3):173-182.
- Xi C, Zhong MT, Lei XX, et al. The reliability and validity of the full and simple subscales of neuroticism on the big five personality scale. Chin J Clin Psychol. 2017;25(3):453-456.
- Kroenke K, Spitzer RL, Williams JB. The PHQ-9: Validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606-613. doi: 10.1046/j.1525-1497.2001.016009606.x
- Manea L, Gilbody S, McMillan D. A diagnostic meta-analysis of the Patient Health Questionnaire-9 (PHQ-9) algorithm scoring method as a screen for depression. Gen Hosp Psychiatry. 2015;37(1):67-75. doi: 10.1016/j.genhosppsych.2014.09.009
- Hinz A, Klein AM, Brähler E, et al. Psychometric evaluation of the generalized anxiety disorder screener GAD-7, based on a large German general population sample. J Affect Disord. 2016;210:338-344. doi: 10.1016/j.jad.2016.12.012
- Löwe B, Decker O, Müller S, et al. Validation and standardization of the generalized anxiety disorder screener (GAD-7) in the general population. Med Care. 2008;46(3):266-274. doi: 10.1097/MLR.0b013e318160d093
- Wu ML. Questionnaire Statistical Analysis Practice: SPSS Operation and Application. China: Chongqing University Press; 2010.
- Wang MC, Bi XY. Regression hybrid model: Method progress and software implementation. Adv Psychol Sci. 2018;26(12):2272-2280.
- Bolger N, Schilling EA. Personality and the problems of everyday life: The role of neuroticism in exposure and reactivity to daily stressors. J Pers. 1991;59(3):355-386. doi: 10.1111/j.1467-6494.1991.tb00253.x
- Riccelli R, Indovina I, Staab JP, et al. Neuroticism modulates brain visuo-vestibular and anxiety systems during a virtual rollercoaster task. Hum Brain Mapp. 2017;38(2):715-726. doi:10.1002/hbm.23411
- Erin D. Anxiety. Nurs Stand. 2016;30(46):15. doi: 10.7748/ns.30.46.15.s17
- Hagger-Johnson G, Roberts B, Boniface D, et al. Neuroticism and cardiovascular disease mortality: Socioeconomic status modifies the risk in women (UK Health and Lifestyle Survey). Psychosom Med. 2012;74(6):596-603. doi: 10.1097/PSY.0b013e31825c85ca
- Smith EM, Reynolds S, Orchard F, Whalley HC, Chan SW. Cognitive biases predict symptoms of depression, anxiety and wellbeing above and beyond neuroticism in adolescence. J Affect Disord. 2018;241:446-453. doi: 10.1016/j.jad.2018.08.051.
- Subica AM, Allen JG, Frueh BC, Elhai JD, Fowler JC. Disentangling depression and anxiety in relation to neuroticism, extraversion, suicide, and self-harm among adult psychiatric inpatients with serious mental illness. Br J Clin Psychol. 2016;55(4):349-370. doi: 10.1111/bjc.12098
- McCrae RR, Costa PT Jr. A contemplated revision of the NEO five-factor inventory. Pers Individ Differ. 2004;36(3):587-596. doi: 10.1016/S0191-8869(03)00118-1
- Francis LJ, Brown LB, Philipchalk R. The development of an abbreviated form of the revised Eysenck personality questionnaire (EPQR-A): Its use among students in England, Canada, the USA and Australia. Pers Individ Differ. 1992;13(4):443-449. doi: 10.1016 / 0191-8869(92)90073-X