View-Aware Chest X-Ray Report Generation with Relational-Contrastive Alignment

https://doi.org/10.22146/ijccs.122422

A’iza Karimatul Lailiyah(1), Wiyli Yustanti`(2*), Benhur Ravuri(3)

(1) Universitas Negeri Surabaya
(2) Universitas Negeri Surabaya
(3) Florida State University
(*) Corresponding Author

Abstract


One of the most popular diagnostic imaging modalities is the chest X-ray (CXR), however creating radiology reports still takes a lot of time and requires radiologist competence. Current automated techniques limit cross-view comprehension and report quality by frequently using single-view images, discarding fine-grained spatial information through global average pooling, and using inflexible decoding methodologies. This study proposes a view-aware chest X-ray report generation framework that integrates multiple radiographic views, strengthens visual–text semantic alignment, and calibrates decoding automatically. The framework comprises a domain-specific visual representation using a CheXpert-pretrained DenseNet-121 encoder that preserves 7×7 spatial features, a view-aware embedding, a relational-contrastive semantic alignment module, and an automatic decoding calibration mechanism. Evaluated on the IU X-ray dataset using paired frontal–lateral images and a DistilGPT2 decoder, the proposed framework achieved BLEU-1 of 0.4768, BLEU-2 of 0.3004, BLEU-3 of 0.2056, BLEU-4 of 0.1525, METEOR of 0.4001, ROUGE-L of 0.3211, and CIDEr of 0.3812. These results demonstrate that the proposed framework improves the coherence and clinical relevance of generated chest X-ray reports while providing an effective vision-language framework for multi-view radiology report generation.


Keywords


Medical Image Captioning; Chest X-Ray Report Generation; Semantic Alignment; Automatic Decoding Calibration; Multi-view Learning

Full Text:

PDF


References

S. Afshari Mirak, S. Harsha Tirumani, N. Ramaiya, and I. Mohamed, “The Growing Nationwide Radiologist Shortage: Current Opportunities and Ongoing Challenges for International Medical Graduate Radiologists,” Radiology, vol. 314, no. 3, 2025, doi: 10.1148/radiol.232625.

C. Tran, B. Pal, T. Stirrat, V. Shi, and M. Umair, “Recent advances in artificial intelligence for radiology report generation: a brief review,” BJR|Artificial Intell., vol. 3, no. 1, 2026, doi: 10.1093/bjrai/ubag003.

W. Jiang et al., “AI-Powered Chest X-Ray for Diagnosing Pulmonary Tuberculosis in County and Township Health Care Facilities in Yichang: Retrospective, Real-World Study,” J. Med. Internet Res., vol. 27, no. 1, pp. 1–12, 2025, doi: 10.2196/83041.

X. Wang, G. Figueredo, R. Li, W. E. Zhang, W. Chen, and X. Chen, “A survey of deep-learning-based radiology report generation using multimodal inputs,” Med. Image Anal., vol. 103, no. May, p. 103627, 2025, doi: 10.1016/j.media.2025.103627.

S. Kalidindi and S. Gandhi, “Workforce Crisis in Radiology in the UK and the Strategies to Deal With It: Is Artificial Intelligence the Saviour?,” Cureus, vol. 15, no. 8, 2023, doi: 10.7759/cureus.43866.

X. Liu, J. Xin, Q. Shen, Z. Huang, and Z. Wang, “Automatic medical report generation based on deep learning: A state of the art survey,” Comput. Med. Imaging Graph., vol. 120, no. December 2024, p. 102486, 2025, doi: 10.1016/j.compmedimag.2024.102486.

D. Demner-Fushman et al., “Preparing a collection of radiology examinations for distribution and retrieval,” J. Am. Med. Informatics Assoc., vol. 23, no. 2, pp. 304–310, 2016, doi: 10.1093/jamia/ocv080.

J. Zhao et al., “Automated Chest X-Ray Diagnosis Report Generation with Cross-Attention Mechanism,” Appl. Sci., vol. 15, no. 1, 2025, doi: 10.3390/app15010343.

H. Park, K. Kim, S. Park, and J. Choi, “Medical Image Captioning Model to Convey More Details: Methodological Comparison of Feature Difference Generation,” IEEE Access, vol. 9, pp. 150560–150568, 2021, doi: 10.1109/ACCESS.2021.3124564.

T. Tanida, P. Müller, G. Kaissis, and D. Rueckert, “Interactive and Explainable Region-guided Radiology Report Generation,” Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 2023-June, pp. 7433–7442, 2023, doi: 10.1109/CVPR52729.2023.00718.

Z. Chen, Y. Shen, Y. Song, and X. Wan, “Cross-modal memory networks for radiology report generation,” ACL-IJCNLP 2021 - 59th Annu. Meet. Assoc. Comput. Linguist. 11th Int. Jt. Conf. Nat. Lang. Process. Proc. Conf., vol. 1, no. 2018, pp. 5904–5914, 2021, doi: 10.18653/v1/2021.acl-long.459.

Y. Xue, Y. Tan, L. Tan, J. Qin, and X. Xiang, “Generating radiology reports via auxiliary signal guidance and a memory-driven network,” Expert Syst. Appl., vol. 237, no. PB, p. 121260, 2024, doi: 10.1016/j.eswa.2023.121260.

O. Alfarghaly, R. Khaled, A. Elkorany, M. Helal, and A. Fahmy, “Automated radiology report generation using conditioned transformers,” Informatics Med. Unlocked, vol. 24, p. 100557, 2021, doi: 10.1016/j.imu.2021.100557.

K. Lee, S. Yoon, and H. Lim, “CLARIFID: Improving radiology report generation by reinforcing clinically accurate impressions and enforcing detailed findings,” Expert Syst. Appl., vol. 303, no. December 2025, p. 130633, 2026, doi: 10.1016/j.eswa.2025.130633.

Z. Chen, Y. Song, T. H. Chang, and X. Wan, “Generating radiology reports via memory-driven transformer,” EMNLP 2020 - 2020 Conf. Empir. Methods Nat. Lang. Process. Proc. Conf., pp. 1439–1449, 2020, doi: 10.18653/v1/2020.emnlp-main.112.

J. P. Cohen et al., “TorchXRayVision: A library of chest X-ray datasets and models,” Proc. Mach. Learn. Res., vol. 172, pp. 231–249, 2022.

W. Li, G. Han, Y. Wu, I. C. Huang, and X. Huang, “Joint Imbalance Adaptation for Radiology Report Generation,” J. Healthc. Informatics Res., vol. 9, no. 4, pp. 720–742, 2025, doi: 10.1007/s41666-025-00205-9.

J. Irvin et al., “CheXpert: A large chest radiograph dataset with uncertainty labels and expert comparison,” 33rd AAAI Conf. Artif. Intell. AAAI 2019, 31st Innov. Appl. Artif. Intell. Conf. IAAI 2019 9th AAAI Symp. Educ. Adv. Artif. Intell. EAAI 2019, pp. 590–597, 2019, doi: 10.1609/aaai.v33i01.3301590.

Z. Liu, Z. Zhu, S. Zheng, Y. Zhao, K. He, and Y. Zhao, “From Observation to Concept: A Flexible Multi-View Paradigm for Medical Report Generation,” IEEE Trans. Multimed., vol. 26, pp. 5987–5995, 2024, doi: 10.1109/TMM.2023.3342691.

M. Boubacar Hamma, Z. Alami Merrouni, B. Frikh, and B. Ouhbi, “Automatic radiology report generation: a systematic review of emerging AI architectures and multimodal technologies,” Artif. Intell. Rev., vol. 59, no. 8, 2026, doi: 10.1007/s10462-026-11556-z.



DOI: https://doi.org/10.22146/ijccs.122422

Article Metrics

Abstract views : 0 | views : 0




Copyright (c) 2026 IJCCS (Indonesian Journal of Computing and Cybernetics Systems)

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.



Copyright of :
IJCCS (Indonesian Journal of Computing and Cybernetics Systems)
ISSN 1978-1520 (print); ISSN 2460-7258 (online)
is a scientific journal the results of Computing
and Cybernetics Systems
A publication of IndoCEISS.
Gedung S1 Ruang 416 FMIPA UGM, Sekip Utara, Yogyakarta 55281
Fax: +62274 555133
email:ijccs.mipa@ugm.ac.id | http://jurnal.ugm.ac.id/ijccs



View My Stats1
View My Stats2