Validation of Indonesian Version of Telehealth Usability Questionnaire (TUQ)

Gilbert Sterling Octavius(1*), Theo Audi Yanto(2)

(1) University of Pelita Harapan
(2) Universitas Pelita Harapan
(*) Corresponding Author


Introduction: Indonesia is the 4th most populous country globally, with 250 million people across 17.508 islands. Despite its strong economic growth, the disparity in poverty increases as medical care costs shoot up. With inadequate medical care worker-to-patient ratio, telehealth is an alternative to providing healthcare in rural areas with similar or even better satisfaction rates. The lack of a standardized questionnaire in the Indonesian language encouraged the authors to validate Telehealth Usability Questionnaire (TUQ) in the Indonesian language. Methods: A cross-sectional study via the e-survey method was done from 17th to 31st of July 2020, while telehealth usability questionnaires were translated and adapted according to WHO protocol. The inclusion criteria were telemedicine users above 18 years old who had at least used telemedicine once in the past six months. Exclusion criteria included minors who completed the questionnaire. Results: A total of 102 data were obtained, comprising 73.5% female. The overall alpha coefficient was 0.958. The Kaiser– Meyer–Olkin (KMO) sampling test was satisfactory (KMO = 0.926), and the Bartlett test of sphericity was significant (Chisquare = 1835.043; df = 210; p < 0.001). Ease of use and learnability had the highest Cronbach’s alpha coefficient (0.907), while reliability had the lowest Cronbach’s alpha coefficient (0.794). Conclusion: In conclusion, this paper presents TUQ in the Indonesian language, which had not been done before. This set of questions will help assess the usability of the expanding number of telehealth programs available in Indonesia and allow comparisons to determine which features make them more acceptable to users.



Telemedicine; Telehealth Usability Questionnaire; Indonesia; Validity

Full Text:



1. Octavius GS, Antonio F. Antecedents of Intention to Adopt Mobile Health (mHealth) Application and Its Impact on Intention to Recommend: An Evidence from Indonesian Customers. Int J Telemed Appl. 2021;2021:6698627. https://doi. org/10.1155/2021/6698627

2. The World Bank. The World Bank in Indonesia 2022 [cited 2023 27th May]. Available from: indonesia/overview.

3. Badan Pusat Statistik. Persentase Penduduk Miskin September 2022 naik menjadi 9,57 persen 2023 [cited 2023 27th May]. Available from: https://www. persentase-penduduk-miskin-september2022-naik-menjadi-9-57-persen. html#:~:text=Abstraksi,persen%20poin%20 terhadap%20September%202021.

4. World Health Organization. New costeffectiveness updates from WHO-CHOICE 2021 [cited 2023 27th May]. Available from:

5. World Health Organization. State of Health Inequality Indonesia: Geneva: World Health Organization.; 2017 [cited 2023 27th May]. Available from: docs/default-source/gho-documents/12-decfinal-final-17220-state-of-health-inequality-inindonesia-for-web.pdf?sfvrsn=54ae73ea_2.

6. Rudel D, Fisk M, Roze R. Definitions of Terms in Telehealth. Informatica Medica Slovenica. 2011;16(1):28-46. Available from: https://ims.

7. Tuckson RV, Edmunds M, Hodgkins ML. Telehealth. N Engl J Med. 2017;377(16):1585- 92. DOI: 10.1056/NEJMsr1503323.

8. Russo JE, McCool RR, Davies L. VA Telemedicine: An Analysis of Cost and Time Savings. Telemed J E Health. 2016;22(3):209-15. DOI: 10.1089/tmj.2015.0055

9. Wade VA, Karnon J, Elshaug AG, Hiller JE. A systematic review of economic analyses of telehealth services using real time video communication. BMC Health Serv Res. 2010;10:233. 6963-10-233

10. Persaud DD, Jreige S, Skedgel C, Finley J, Sargeant J, Hanlon N. An incremental cost analysis of telehealth in Nova Scotia from a societal perspective. J Telemed Telecare. 2005;11(2):77- 84. DOI: 10.1258/1357633053499877

11. Hwei LRY, Octavius GS. Potential advantages and disadvantages of telemedicine: A literature review from the perspectives of patients, medical personnel, and hospitals. Journal of Community Empowerment for Health. 2021;4(3):180-6. jcoemph.64247

12. Nguyen M, Waller M, Pandya A, Portnoy J. A Review of Patient and Provider Satisfaction with Telemedicine. Curr Allergy Asthma Rep. 2020;20(11):72. DOI: 10.1007/s11882-020- 00969-7

13. Le LB, Rahal HK, Viramontes MR, Meneses KG, Dong TS, Saab S. Patient Satisfaction and Healthcare Utilization Using Telemedicine in Liver Transplant Recipients. Dig Dis Sci. 2019;64(5):1150-7. DOI: 10.1007/s10620-018- 5397-5

14. Schulze LN, Stentzel U, Leipert J, Schulte J, Langosch J, Freyberger HJ, et al. Improving Medication Adherence With Telemedicine for Adults With Severe Mental Illness. Psychiatr Serv. 2019;70(3):225-8. DOI: 10.1176/appi. ps.201800286

15. Xu T, Pujara S, Sutton S, Rhee M. Telemedicine in the Management of Type 1 Diabetes. Prev Chronic Dis. 2018;15:E13. DOI: 10.5888/ pcd15.170168

16. Octavius GS, Hwei LRY. Clinical Usefulness of Telehealth: A Literature Review from the Perspective of Medical Specializations. Cermin Dunia Kedokteran. 2021;48(12):735-40. https://

17. Liu W, Saxon DR, McNair B, Sanagorski R, Rasouli N. Endocrinology Telehealth Consultation Improved Glycemic Control Similar to Face-to-Face Visits in Veterans. J Diabetes Sci Technol. 2016;10(5):1079-86. DOI: 10.1177/1932296816648343

18. Halterman JS, Fagnano M, Tajon RS, Tremblay P, Wang H, Butz A, et al. Effect of the SchoolBased Telemedicine Enhanced Asthma Management (SB-TEAM) Program on Asthma Morbidity: A Randomized Clinical Trial. JAMA Pediatr. 2018;172(3):e174938. DOI: 10.1001/ jamapediatrics.2017.4938

19. Wijaya JH, Octavius GS, Hwei LRY. A Literature Review of Telemedicine in Indonesia: Past, Present, and Future Prospective. Indonesian Journal of Health Administration. 2022;10(2):261-72. DOI: 10.20473/jaki. v10i2.2022.261-272

20. Camarero L, Oliva J. Thinking in rural gap: mobility and social inequalities. Palgrave Communications. 2019;5(1):95. https://doi. org/10.1057/s41599-019-0306-x

21. Langbecker D, Caffery LJ, Gillespie N, Smith AC. Using survey methods in telehealth research: A practical guide. J Telemed Telecare. 2017;23(9):770-9. DOI: 10.1177/1357633X17721814

22. Parmanto B, Lewis AN, Jr., Graham KM, Bertolet MH. Development of the Telehealth Usability Questionnaire (TUQ). Int J Telerehabil. 2016;8(1):3-10. DOI: 10.5195/ ijt.2016.6196

23. Constanzo F, Aracena-Sherck P, Hidalgo JP, Muñoz M, Vergara G, Alvarado C. Validation of a patient satisfaction survey of the Teleneurology program in Chile. BMC Res Notes. 2019;12(1):359.

24. Efstathiou G. Translation, Adaptation and Validation Process of Research Instruments. In: Suhonen R, Stolt M, Papastavrou E, editors. Individualized Care: Theory, Measurement, Research and Practice. Cham: Springer International Publishing; 2019. p. 65-78. DOI: 10.1111/j.1365-2753.2010.01434.x

25. Kellar SP, Kelvin E. Munro’s Statistical Methods for Health Care Research: Wolters Kluwer; 2012. ISBN/ISSN: 9781451187946

26. Argimon-Pallàs JM, Flores-Mateo G, JiménezVilla J, Pujol-Ribera E, Foz G, Bundó-Vidiella M, et al. Study protocol of psychometric properties of the Spanish translation of a competence test in evidence based practice: the Fresno test. BMC Health Serv Res. 2009;9:37.

27. Ware JE, Jr., Gandek B. Methods for testing data quality, scaling assumptions, and reliability: the IQOLA Project approach. International Quality of Life Assessment. J Clin Epidemiol. 1998;51(11):945-52. DOI: 10.1016/s0895- 4356(98)00085-7

28. Rattray J, Jones MC. Essential elements of questionnaire design and development. J Clin Nurs. 2007;16(2):234-43. DOI: 10.1111/j.1365- 2702.2006.01573.x

29. Bibiloni N, Torre AC, Angles MV, Terrasa SA, Vazquez Peña FR, Sommer J, et al. Validation of a Spanish questionnaire on telemedicine usability. Medicina (B Aires). 2020;80(6):649- 53. Available from: https://www. pdf

30. Özkeskin M, Özden F, Ekmekçi Ö, Yüceyar N., et al. The reliability and validity of the Turkish version of the telehealth usability questionnaire and the telemedicine satisfaction questionnaire in patients with multiple sclerosis. Neurological Sciences and Neurophysiology. 2021;38(3)


Article Metrics

Abstract views : 135 | views : 74


  • There are currently no refbacks.

Copyright (c) 2023 Journal of Community Empowerment for Health

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.