Psychometric properties of Mental Health Scale: An Item Response Theory Approach

Ramadhan Dwi Marvianto
(Submitted 1 April 2022)
(Published 31 October 2023)


Indonesia Family Life Survey (IFLS) the fifth wave used the Centre for Epidemiological Studies Scale (CES-D10) to measure mental health state, which was depressive symptoms construct. It was primarily used in some studies regarding depressive symptoms. However, there was no specific validation research in the Indonesian context. Thus, this study aimed to (1) investigate the item quality of depressive symptom measurement from IFLS fifth wave, (2) measurement precision of this scale, and (3) the measurement invariance based on gender using the IRT approach. This study used data from ILFS-5 in the KP ("Keadaan Psikologis" or Mental Health) section, which was CES-D10 consisting of 10 items and conduct IRT analysis using a 2-PL model. The number of participants from the data was 31,447. CFA analysis resulted a unidimensional model fit for this scale. Moreover, finding showed that this scale had good psychometric properties, including item discrimination, item location, and item fit, except item 5 and item 8. Despite the poor quality for those items, the reliability coefficient, including the items, met a reliable measurement criterion. Also, this scale had much information for assessing medium and severe depressive symptoms. Moreover, the Differential Item Functioning (DIF) analysis indicated that there was no item exhibiting DIF.


Depression Scale; IFLS; Psychometrics

Full Text: PDF

DOI: 10.22146/gamajop.73878


Andresen, E. M., Malmgren, J. A., Carter, W. B., & Patrick, D. L. (1994). Screening for Depression in Well Older Adults: Evaluation of a Short Form of the CES-D. American Journal of Preventive Medicine, 10(2), 77–84. Astutik, E., Hidajah, A. C., Tama, T. D., Efendi, F., & Li, C. Y. (2021). Prevalence and determinants of depressive symptoms among adults in Indonesia: A cross-sectional population-based national survey. Nursing Forum, 56(1), 37–44. Ayala, R. J. de. (2009). The theory and practice of item response theory. New York: The Guilford Press. Ayis, S. A., Ayerbe, L., Ashworth, M., & DA Wolfe, C. (2018). Evaluation of the Hospital Anxiety and Depression Scale (HADS) in screening stroke patients for symptoms: Item Response Theory (IRT) analysis. Journal of Affective Disorders, 228(November 2017), 33–40. Baker, F. (2001). The basics of item response theory. College Park, MD: ERIC Clearinghouse on Assessment and Evaluation. Retrieved from ation/uuid/53C840DD-C92B-4719-8EC3-AF2076EDCAB3 Baron, E. C., Davies, T., & Lund, C. (2017). Validation of the 10-item Centre for Epidemiological Studies Depression Scale (CES-D-10) in Zulu, Xhosa and Afrikaans populations in South Africa. BMC Psychiatry, 17(1), 1–14. Berk, R. A. (2006). Thirteen Strategies to Measure College Teaching. Virginia: Stylus Publishing. Björgvinsson, T., Kertz, S. J., Bigda-Peyton, J. S., McCoy, K. L., & Aderka, I. M. (2013). Psychometric Properties of the CES-D-10 in a Psychiatric Sample. Assessment, 20(4), 429–436. Boey, K. W. (1999). Cross-validation of a short form of the CES-D in Chinese elderly. International Journal of Geriatric Psychiatry, 14(8), 608–617.;2-Z Bradley, K. L., Bagnell, A. L., & Brannen, C. L. (2010). Factorial validity of the center for epidemiological studies depression 10 in adolescents. Issues in Mental Health Nursing, 31(6), 408–412. Brown, A., & Croudace, T. J. (2015). Scoring and estimating score precision using multidimensional IRT1. In Handbook of Item Response Theory Modeling: Applications to Typical Performance Assessment (a volume in the Multivariate Applications Series) (pp. 307–333). New York: Routledge. Cao, J., & Rammohan, A. (2016). Social capital and healthy ageing in Indonesia. BMC Public Health, 16(1), 1–14. Chalmers, R. P. (2012). {mirt}: A Multidimensional Item Response Theory Package for the {R} Environment. Journal of Statistical Software, 48(6), 1–29. Cheng, S. T., Chan, A. C. M., & Fung, H. H. (2006). Factorial structure of a short version of the Center for Epidemiologic Studies Depression Scale. International Journal of Geriatric Psychiatry, 21(4), 333–336. Chiesi, F., Primi, C., Pigliautile, M., Ercolani, S., della Staffa, M. C., Longo, A., ... Mecocci, P. (2017). The local reliability of the 15-item version of the Geriatric Depression Scale: An item response theory (IRT) study. Journal of Psychosomatic Research, 96(December 2016), 84–88. Diener, E., & Emmons, R. A. (1984). The independence of positive and negative affect. Journal of Personality and Social Psychology, 47(5), 1105–1117. Embretson, S. E. (1985). Test design: Developments in psychology and psychometrics. New York: Academic Press, Inc. Feuerstahler, L. M., Waller, N., & MacDonald, A. (2020). Improving Measurement Precision in Experimental Psychopathology Using Item Response Theory. Educational and Psychological Measurement (Vol. 80). Furr, M. R., & Bacharach, V. R. (2013). Psychometric: An Introduction (2nd ed.). Amazon: SAGE Publisher. Girgus, J. S., Yang, K., & Ferri, C. V. (2017). The gender difference in depression: Are elderly women at greater risk for depression than elderly men? Geriatrics (Switzerland), 2(4). Giusti, E. M., Jonkman, A., Manzoni, G. M., Castelnuovo, G., Terwee, C. B., Roorda, L. D., & Chiarotto, A. (2020). Proposal for Improvement of the Hospital Anxiety and Depression Scale for the Assessment of Emotional Distress in Patients With Chronic Musculoskeletal Pain: A Bifactor and Item Response Theory Analysis. Journal of Pain, 21(3–4), 375–389. Gustryanti, K., Thongpat, S., & Maneerat, S. (2017). Factors Relating To Depression Among Older People Living in Cimahi, West Java Province, Indonesia. Belitung Nursing Journal, 3(1), 14–22. Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of Item Response Theory Library. Hariyani, N., Bramantoro, T., Nair, R., Singh, A., & Sengupta, K. (2020). Depression symptoms and recurrent aphthous stomatitis—Evidence from a population-based study in Indonesia. Oral Diseases, 26(5), 948–954. Haynes, W. (2013). Bonferroni Correction. In W. Dubitzky, O. Wolkenhauer, K.-H. Cho, & H. Yokota (Eds.), Encyclopedia of Systems Biology (p. 154). New York, NY: Springer New York. Hu, L.-T., & Bentler, P. M. (1998). Fit Indice in Covariance Structure Modeling: Sensitivity to Underparameterized Model Misspecification. Psychological Methdos, 3(4), 424–453. Hussain, M. A., Huxley, R. R., & Al Mamun, A. (2015). Multimorbidity prevalence and pattern in Indonesian adults: An exploratory study using national survey data. BMJ Open, 5(12). Isaura, E. R., Chen, Y. C., Su, H. Y., & Yang, S. H. (2020). The relationship between food security status and sleep disturbance among adults: A cross-sectional study in an indonesian population. Nutrients, 12(11), 1–13. Iwata, N., Umesue, M., Egashira, K., Hiro, H., Mizoue, T., Mishima, N., & Nagata, S. (1998). Can positive affect items be used to assess depressive disorders in the Japanese population? Psychological Medicine, 28(1), 153–158. Kang, T., & Chen, T. T. (2007). An Investigation of the Performance of Generalized S-X2 Item- Fit Index for Polytomous IRT Models. ACT Research Report Series (Vol. 1). Kashiwagi, S., Tamiya, N., & Sandoval, F. (2016). Factors Associated with Depression amongst Family Caregivers Involved in Care for Community-dwelling Persons of Middle Age and Older: Based on Data from Indonesia Family Life Survey. Public Policy and Administration Research, 6(5), 24–32. Retrieved from Kim, S., & Feldt, L. S. (2010). The estimation of the IRT reliability coefficient and its lower and upper bounds, with comparisons to CTT reliability statistics. Asia Pacific Education Review, 11(2), 179–188. Lee, A. E. Y., & Chokkanathan, S. (2008). Factor structure of the 10-item CES-D scale among community dwelling older adults in Singapore. International Journal of Geriatric Psychiatry, 23(6), 592–597. Leung, J., Gouda, H., Chung, J. Y. C., & Irmansyah, I. (2021). Comorbidity between depressive symptoms and chronic conditions – findings from the Indonesia Family Life Survey. Journal of Affective Disorders, 280, 236–240. Liew, H. P., & Gardner, S. (2016). The interrelationship between smoking and depression in Indonesia. Health Policy and Technology, 5(1), 26–31. Liu, Q., He, H., Yang, J., Feng, X., Zhao, F., & Lyu, J. (2020). Changes in the global burden of depression from 1990 to 2017: Findings from the Global Burden of Disease study. Journal of Psychiatric Research, 126(June 2019), 134–140. MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1(2), 130–149. Mahwati, Y. (2017). The Relationship between Spirituality and Depression Among the Elderly in Indonesia. Makara Journal of Health Research, 21(1), 13–19. Nazroo, J. Y., Edwards, A. C., & Brown, G. W. (1998). Gender differences in the prevalence of depression: Artefact, alternative disorders, biology or roles? Sociology of Health and Illness, 20(3), 312–330. Nunnally, J. C., & Bernstein, I. H. (1994). Psychometrics Theory (third edit). McGraw-Hill. Olino, T. M., Yu, L., Klein, D. N., Rohde, P., Seeley, J. R., Pilkoinis, P. A., & Lewinsohn, P. M. (2008). Measuring depression using item response theory: an examination of three measures of depressive symptomatology. International Journal of Methods in Psychiatric Research, 21(1), 76–85. Peltzer, K., & Pengpid, S. (2018). High prevalence of depressive symptoms in a national sample of adults in Indonesia: Childhood adversity, sociodemographic factors and health risk behaviour. Asian Journal of Psychiatry, 33(December 2017), 52–59. Pengpid, S., Peltzer, K., & Susilowati, I. H. (2019). Cognitive Functioning and Associated Factors in Older Adults: Results from the Indonesian Family Life Survey-5 (IFLS-5) in 2014-2015. Current Gerontology and Geriatrics Research, 2019, 23–25. Purborini, N., Lee, M. B., Devi, H. M., & Chang, H. J. (2021). Associated factors of depression among young adults in Indonesia: A population-based longitudinal study. Journal of the Formosan Medical Association, (xxxx). R Core Team. (2020). R: A Language and Environment for Statistical Computing. Vienna, Austria. Retrieved from RAND. (2021a). Indonesian Family Life Survey (IFLS) Data and Documentation | RAND. Retrieved March 19, 2021, from policy/data/FLS/IFLS/download.html RAND. (2021b). RAND Indonesian Family Life Survey (IFLS) | RAND. Retrieved March 19, 2021, from policy/data/FLS/IFLS.html Rigdon, E. E. (1996). CFI versus RMSEA: A comparison of two fit indexes for structural equation modeling. Structural Equation Modeling, 3(4), 369–379. Rizopoulos, D. (2006). ltm : An R Package for Latent Variable Modeling. Journal Of Statistical Software, 17(5). Roadolff, L. S. (1977). The CES-D scale: a self-report depression scale for research in the general population. Applied Psychological Measurement, 1, 385–401. Rosseel, Y. (2012). {lavaan}: An {R} Package for Structural Equation Modeling. Journal of Statistical Software, 48(2), 1–36. Retrieved from Schroevers, M. J., Sanderman, R., Van Sonderen, E., & Ranchor, A. V. (2000). The evaluation of the Center for Epidemiologic Studies Depression (CES-D) scale: Depressed and Positive Affect in cancer patients and healthy reference subjects. Quality of Life Research, 9(9), 1015–1029. Stommel, M., Given, B. A., Given, C. W., Kalaian, H. A., Schulz, R., & McCorkle, R. (1993). Gender bias in the measurement properties of the center for epidemiologic studies depression scale (CES-D). Psychiatry Research, 49(3), 239–250. Strauss, J., Beegle, K., Sikoki, B., Dwiyanto, A., Herwati, Y., Witoelar, F., & Corporation, R. (2016). The 5th Wave of the Indonesia Family Life Survey (IFLS): Overview and Field Report. Retrieved from D_WR1143z2.pdf Univeristy of Washington. (2021). GBD Results Tool | GHDx. Retrieved March 29, 2021, from Widhowati, S. S., Chen, C. M., Chang, L. H., Lee, C. K., & Fetzer, S. (2020). Living alone, loneliness, and depressive symptoms among Indonesian older women. Health Care for Women International, 41(9), 984–996. World Health Organization. (2017). Depression and other common mental disorders: Global health estimates. Geneva: World Health Organization. Retrieved from eng.pdf Wu, H., Fai Cheung, S., & On Leung, S. (2019). Simple use of BIC to Assess Model Selection Uncertainty: An Illustration using Mediation and Moderation Models. Multivariate Behavioral Research, 55(1), 1–16. Yuniati, F., & Kamso, S. (2020). Assessing the Quality of Life Among Productive Age in the General Population: A Cross-Sectional Study of Family Life Survey in Indonesia. Asia- Pacific Journal of Public Health. Zhang, W., O’Brien, N., Forrest, J. I., Salters, K. A., Patterson, T. L., Montaner, J. S. G., ... Lima, V. D. (2012). Validating a shortened depression scale (10 item CES-D) among HIV-Positive people in British Columbia, Canada. PLoS ONE, 7(7), 1–5.


  • There are currently no refbacks.

Copyright (c) 2023 Gadjah Mada Journal of Psychology (GamaJoP)

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.