View-Aware Chest X-Ray Report Generation with Relational-Contrastive Alignment
A’iza Karimatul Lailiyah(1), Wiyli Yustanti`(2*), Benhur Ravuri(3)
(1) Universitas Negeri Surabaya
(2) Universitas Negeri Surabaya
(3) Florida State University
(*) Corresponding Author
Abstract
One of the most popular diagnostic imaging modalities is the chest X-ray (CXR), however creating radiology reports still takes a lot of time and requires radiologist competence. Current automated techniques limit cross-view comprehension and report quality by frequently using single-view images, discarding fine-grained spatial information through global average pooling, and using inflexible decoding methodologies. This study proposes a view-aware chest X-ray report generation framework that integrates multiple radiographic views, strengthens visual–text semantic alignment, and calibrates decoding automatically. The framework comprises a domain-specific visual representation using a CheXpert-pretrained DenseNet-121 encoder that preserves 7×7 spatial features, a view-aware embedding, a relational-contrastive semantic alignment module, and an automatic decoding calibration mechanism. Evaluated on the IU X-ray dataset using paired frontal–lateral images and a DistilGPT2 decoder, the proposed framework achieved BLEU-1 of 0.4768, BLEU-2 of 0.3004, BLEU-3 of 0.2056, BLEU-4 of 0.1525, METEOR of 0.4001, ROUGE-L of 0.3211, and CIDEr of 0.3812. These results demonstrate that the proposed framework improves the coherence and clinical relevance of generated chest X-ray reports while providing an effective vision-language framework for multi-view radiology report generation.
Keywords
Full Text:
PDFReferences
S. Afshari Mirak, S. Harsha Tirumani, N. Ramaiya, and I. Mohamed, “The Growing Nationwide Radiologist Shortage: Current Opportunities and Ongoing Challenges for International Medical Graduate Radiologists,” Radiology, vol. 314, no. 3, 2025, doi: 10.1148/radiol.232625.
C. Tran, B. Pal, T. Stirrat, V. Shi, and M. Umair, “Recent advances in artificial intelligence for radiology report generation: a brief review,” BJR|Artificial Intell., vol. 3, no. 1, 2026, doi: 10.1093/bjrai/ubag003.
W. Jiang et al., “AI-Powered Chest X-Ray for Diagnosing Pulmonary Tuberculosis in County and Township Health Care Facilities in Yichang: Retrospective, Real-World Study,” J. Med. Internet Res., vol. 27, no. 1, pp. 1–12, 2025, doi: 10.2196/83041.
X. Wang, G. Figueredo, R. Li, W. E. Zhang, W. Chen, and X. Chen, “A survey of deep-learning-based radiology report generation using multimodal inputs,” Med. Image Anal., vol. 103, no. May, p. 103627, 2025, doi: 10.1016/j.media.2025.103627.
S. Kalidindi and S. Gandhi, “Workforce Crisis in Radiology in the UK and the Strategies to Deal With It: Is Artificial Intelligence the Saviour?,” Cureus, vol. 15, no. 8, 2023, doi: 10.7759/cureus.43866.
X. Liu, J. Xin, Q. Shen, Z. Huang, and Z. Wang, “Automatic medical report generation based on deep learning: A state of the art survey,” Comput. Med. Imaging Graph., vol. 120, no. December 2024, p. 102486, 2025, doi: 10.1016/j.compmedimag.2024.102486.
D. Demner-Fushman et al., “Preparing a collection of radiology examinations for distribution and retrieval,” J. Am. Med. Informatics Assoc., vol. 23, no. 2, pp. 304–310, 2016, doi: 10.1093/jamia/ocv080.
J. Zhao et al., “Automated Chest X-Ray Diagnosis Report Generation with Cross-Attention Mechanism,” Appl. Sci., vol. 15, no. 1, 2025, doi: 10.3390/app15010343.
H. Park, K. Kim, S. Park, and J. Choi, “Medical Image Captioning Model to Convey More Details: Methodological Comparison of Feature Difference Generation,” IEEE Access, vol. 9, pp. 150560–150568, 2021, doi: 10.1109/ACCESS.2021.3124564.
T. Tanida, P. Müller, G. Kaissis, and D. Rueckert, “Interactive and Explainable Region-guided Radiology Report Generation,” Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 2023-June, pp. 7433–7442, 2023, doi: 10.1109/CVPR52729.2023.00718.
Z. Chen, Y. Shen, Y. Song, and X. Wan, “Cross-modal memory networks for radiology report generation,” ACL-IJCNLP 2021 - 59th Annu. Meet. Assoc. Comput. Linguist. 11th Int. Jt. Conf. Nat. Lang. Process. Proc. Conf., vol. 1, no. 2018, pp. 5904–5914, 2021, doi: 10.18653/v1/2021.acl-long.459.
Y. Xue, Y. Tan, L. Tan, J. Qin, and X. Xiang, “Generating radiology reports via auxiliary signal guidance and a memory-driven network,” Expert Syst. Appl., vol. 237, no. PB, p. 121260, 2024, doi: 10.1016/j.eswa.2023.121260.
O. Alfarghaly, R. Khaled, A. Elkorany, M. Helal, and A. Fahmy, “Automated radiology report generation using conditioned transformers,” Informatics Med. Unlocked, vol. 24, p. 100557, 2021, doi: 10.1016/j.imu.2021.100557.
K. Lee, S. Yoon, and H. Lim, “CLARIFID: Improving radiology report generation by reinforcing clinically accurate impressions and enforcing detailed findings,” Expert Syst. Appl., vol. 303, no. December 2025, p. 130633, 2026, doi: 10.1016/j.eswa.2025.130633.
Z. Chen, Y. Song, T. H. Chang, and X. Wan, “Generating radiology reports via memory-driven transformer,” EMNLP 2020 - 2020 Conf. Empir. Methods Nat. Lang. Process. Proc. Conf., pp. 1439–1449, 2020, doi: 10.18653/v1/2020.emnlp-main.112.
J. P. Cohen et al., “TorchXRayVision: A library of chest X-ray datasets and models,” Proc. Mach. Learn. Res., vol. 172, pp. 231–249, 2022.
W. Li, G. Han, Y. Wu, I. C. Huang, and X. Huang, “Joint Imbalance Adaptation for Radiology Report Generation,” J. Healthc. Informatics Res., vol. 9, no. 4, pp. 720–742, 2025, doi: 10.1007/s41666-025-00205-9.
J. Irvin et al., “CheXpert: A large chest radiograph dataset with uncertainty labels and expert comparison,” 33rd AAAI Conf. Artif. Intell. AAAI 2019, 31st Innov. Appl. Artif. Intell. Conf. IAAI 2019 9th AAAI Symp. Educ. Adv. Artif. Intell. EAAI 2019, pp. 590–597, 2019, doi: 10.1609/aaai.v33i01.3301590.
Z. Liu, Z. Zhu, S. Zheng, Y. Zhao, K. He, and Y. Zhao, “From Observation to Concept: A Flexible Multi-View Paradigm for Medical Report Generation,” IEEE Trans. Multimed., vol. 26, pp. 5987–5995, 2024, doi: 10.1109/TMM.2023.3342691.
M. Boubacar Hamma, Z. Alami Merrouni, B. Frikh, and B. Ouhbi, “Automatic radiology report generation: a systematic review of emerging AI architectures and multimodal technologies,” Artif. Intell. Rev., vol. 59, no. 8, 2026, doi: 10.1007/s10462-026-11556-z.
Article Metrics
Copyright (c) 2026 IJCCS (Indonesian Journal of Computing and Cybernetics Systems)

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
View My Stats1






