AccScience Publishing / AIH / Online First / DOI: 10.36922/AIH025490110
ORIGINAL RESEARCH ARTICLE

Deep learning-based multimodal prediction of chronic kidney disease stage

Yan Zhang1,2* Xintong Zou2,3 Zhuoyun Xie2,3 Haole Huang2,3 Ruihui Chen2,3 Zihui Lin2,3 Kaiting Wang2,4 Jialin Zhao2,4 Xiaoqing Liang2,4 Yuhan Zhang2,3 Ziyue Xiong2,3 Xueyan Chen2,4 Runxi Zhou2,4 Huimin Li5* Xiaoli Chu6,7*
Show Less
1 Guangdong Provincial Key Laboratory of Philosophy and Social Sciences, Guangdong University of Finance and Economics, Guangzhou, Guangdong, China
2 Research Center of Intelligent Computing and Big Data Technology, Guangdong University of Finance and Economics, Guangzhou, Guangdong, China
3 Department of Data Science and Big Data Technology, School of Statistics and Data Science, Guangdong University of Finance and Economics, Guangzhou, Guangdong, China
4 Department of Big Data Management and Application, School of Big Data and Artificial Intelligence, Guangdong University of Finance and Economics, Guangzhou, Guangdong, China
5 Department of Traditional Chinese Medicine Rehabilitation, Boai Hospital of Zhongshan, Zhongshan, Guangdong, China
6 State Key Laboratory of Traditional Chinese Medicine Syndrome, The Second Affiliated Hospital, Guangzhou University of Chinese Medicine, Guangzhou, Guangdong, China
7 Department of Traditional Chinese Medicine Big Data Research, The Second Affiliated Hospital, Guangzhou University of Chinese Medicine, Guangzhou, Guangdong, China
Received: 2 December 2025 | Revised: 25 January 2026 | Accepted: 28 January 2026 | Published online: 15 April 2026
(This article belongs to the Special Issue Artificial Intelligence in Traditional Chinese Medicine)
© 2026 by the Author(s). This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution 4.0 International License ( https://creativecommons.org/licenses/by/4.0/ )
Abstract

Chronic kidney disease (CKD) constitutes a critical global public health challenge. Its early-stage symptoms are subtle and easily overlooked, frequently resulting in delayed diagnosis and escalated treatment expenditures. To enable timely early intervention, this study proposes a deep learning-based multimodal CKD stage prediction model, which integrates Western medical laboratory data and traditional Chinese medicine (TCM) symptom descriptions, thereby overcoming the inherent limitations of unimodal prediction approaches. For Western medical data, the synthetic minority oversampling technique (SMOTE) was employed to address class imbalance. Subsequently, a least absolute shrinkage and selection operator (LASSO) feature selection model was utilized to identify key biomarkers, including serum creatinine and serum chloride. A backpropagation neural network, enhanced with Adam optimization and regularization mechanisms, was constructed for predictive modeling. For TCM symptom texts (e.g., tongue manifestations and pulse conditions), the Google-pretrained Bidirectional Encoder Representations from Transformers (BERT) model was leveraged to learn latent semantic patterns in the textual data. Finally, a multimodal decision fusion strategy based on the attention mechanism was adopted to dynamically learn the relative importance of Western medical and TCM features in CKD staging prediction, culminating in the development of the proposed deep learning-driven multimodal CKD staging model. Validation results indicate that the proposed model outperforms classical machine learning models and unimodal models across multiple metrics, including accuracy, F1-score, area under the curve, and convergence efficiency. These findings confirm its clinical feasibility and effectiveness, providing an innovative multimodal data-driven prediction framework that synergizes the strengths of Western medical quantitative testing and TCM qualitative diagnosis.

Graphical abstract
Keywords
Multimodal model
Chronic kidney disease
Improved backpropagation neural network
Self-attention mechanism
Bidirectional Encoder Representations from Transformers model
Funding
The work was supported by the National Natural Science Foundation of China (72301082), the China Postdoctoral Science Foundation (2025M773863), the Guangdong Basic and Applied Basic Research Foundation (2022A1515110703), the Guangdong Provincial Hospital of Chinese Medicine Science and Technology Research Project (YN2022QN33, YN2024GZRPY077), the Guangzhou Key Research and Development Program (202206010101), the National Key Laboratory of Chinese Medicine Syndrome (QZ2023ZZ07), the Postdoctoral Fellowship Program of CPSF (GZC20252561), the Special Project of State Key Laboratory of Dampness Syndrome of Chinese Medicine (SZ2021ZZ36, SZ2021ZZ09), the Guangzhou Science and Technology Plan Project (2024A03J0117, 2025A03J4062), and the 2020 Guangdong Provincial Science and Technology Innovation Strategy Special Fund (Guangdong-Hong Kong-Macau Joint Lab) (2020B1212030006).
Conflict of interest
The authors declare they have no competing interests.
References
  1. Zhang L, Wang F, Wang L, et al. Prevalence of chronic kidney disease in China: a cross-sectional survey. Lancet. 2012;379(9818):815-822. doi: 10.1016/S0140-6736(12)60033-6

 

  1. Shlipak MG, Tummalapalli SL, Boulware LE, et al. The case for early identification and intervention of chronic kidney disease: conclusions from a Kidney Disease: Improving Global Outcomes (KDIGO) Controversies Conference. Kidney Int. 2021;99(1):34-47. doi: 10.1016/j.kint.2020.10.012

 

  1. Hossain MS, Hassa SMN, Al-Amin M, Rahaman MN, Hossain R, Hossain MI. Kidney Disease Detection from CT Images using a customized CNN model and Deep Learning. In: 2023 International Conference on Advances in Intelligent Computing and Applications (AICAPS). IEEE; 2023:1-6. doi: 10.1109/aicaps57044.2023.10074314

 

  1. Dubin RF, Deo R, Ren Y, et al. Proteomics of CKD progression in the chronic renal insufficiency cohort. Nat Commun. 2023;14(1):6340. doi: 10.1038/s41467-023-41642-7

 

  1. Tin A, Köttgen A. Genome-wide association studies of CKD and related traits. Clin J Am Soc Nephrol. 2020;15(11):1643-1656. doi: 10.2215/cjn.00020120

 

  1. Robinson-Cohen C, Triozzi JL, Rowan B, et al. Genomewide association study of CKD progression. J Am Soc Nephrol. 2023;34(9):1547-1559. doi: 10.1681/asn.0000000000000170

 

  1. Hannan M, Chen J, Hsu J, et al. Frailty and cardiovascular outcomes in adults with CKD: Findings from the Chronic Renal Insufficiency Cohort (CRIC) study. Am J Kidney Dis. 2024;83(2):208-215. doi: 10.1053/j.ajkd.2023.06.009

 

  1. Ding N, Lv Y, Su H, et al. Vascular calcification in CKD: New insights into its mechanisms. J Cell Physiol. 2023;238(6):1160-1182. doi: 10.1002/jcp.31021

 

  1. Venkatesan VK, Ramakrishna MT, Izonin I, Tkachenko R, Havryliuk M. Efficient Data Preprocessing with Ensemble Machine Learning Technique for the Early Detection of Chronic Kidney Disease. Appl Sci. 2023;13(5):2885. doi: 10.3390/app13052885

 

  1. Krukowski H, Valkenburg S, Madella AM, et al. Gut microbiome studies in CKD: opportunities, pitfalls and therapeutic potential. Nat Rev Nephrol. 2023;19(2):87-101. doi: 10.1038/s41581-022-00647-z

 

  1. Kumar K, Pradeepa M, Mahdal M, RajaRao MVLN, Ramesh JVN. A Deep Learning Approach for Kidney Disease Recognition and Prediction through Image Processing. Appl Sci. 2023;13(6):3621. doi: 10.3390/app13063621

 

  1. Joshi S, Kalantar-Zadeh K, Chauveau P, Carrero JJ. Risks and Benefits of Different Dietary Patterns in CKD. Am J Kidney Dis. 2023;81(3):352-360. doi: 10.1053/j.ajkd.2022.08.013

 

  1. Macdougall IC. Anaemia in CKD—treatment standard. Nephrol Dial Transplant. 2024;39(5):770-777. doi: 10.1093/ndt/gfad250

 

  1. Świątek Ł, Jeske J, Miedziaszczyk M, Idasiak-Piechocka I. The impact of a vegetarian diet on chronic kidney disease (CKD) progression–a systematic review. BMC Nephrol. 2023;24(1):168. doi: 10.1186/s12882-023-03233-y

 

  1. Yamada S, Nakano T. Role of Chronic Kidney Disease (CKD)–Mineral and Bone Disorder (MBD) in the Pathogenesis of Cardiovascular Disease in CKD. J Atheroscler Thromb. 2023;30(8):835-850. doi: 10.5551/jat.RV22006

 

  1. Heo GY, Koh HB, Kim HJ, et al. Association of Plant Protein Intake with Risk of incident CKD: a UK Biobank study. Am J Kidney Dis. 2023;82(6):687-697.e1. doi: 10.1053/j.ajkd.2023.05.007

 

  1. Mapuskar KA, Vasquez-Martinez G, Mayoral-Andrade G, Tomanek-Chalkley A, Zepeda-Orozco D, Allen BG. Mitochondrial oxidative metabolism: an emerging therapeutic target to improve CKD outcomes. Biomedicines. 2023;11(6):1573. doi: 10.3390/biomedicines11061573

 

  1. Saif D, Sarhan AM, Elshennawy NM. Deep-kidney: an effective deep learning framework for chronic kidney disease prediction. Health Inf Sci Syst. 2023;12(1):3. doi: 10.1007/s13755-023-00261-8

 

  1. Alsekait DM, Saleh H, Gabralla LA, et al. Toward comprehensive chronic kidney disease prediction based on ensemble deep learning models. Appl Sci. 2023;13(6):3937. doi: 10.3390/app13063937

 

  1. Akter S, Ahmed M, Al Imran A, et al. CKD.Net: A novel deep learning hybrid model for effective, real-time, automated screening tool towards prediction of multi stages of CKD along with eGFR and creatinine. Expert Syst Appl. 2023;223:119851. doi: 10.1016/j.eswa.2023.119851

 

  1. Ge XY, Lan ZK, Lan QQ, Lin HS, Wang GD, Chen J. Diagnostic accuracy of ultrasound-based multimodal radiomics modeling for fibrosis detection in chronic kidney disease. Eur Radiol. 2023;33(4):2386-2398. doi: 10.1007/s00330-022-09268-3

 

  1. Hou Z, Zhang G, Ma Y, et al. Development of a multimodal kidney age prediction based on automatic segmentation CT image in patients with normal renal function. Clin Kidney J. 2023;16(11):2091-2099. doi: 10.1093/ckj/sfad167

 

  1. Chertow GM, Correa-Rotter R, Vart P, et al. Effects of Dapagliflozin in Chronic Kidney Disease, With and Without Other Cardiovascular Medications: DAPA-CKD Trial. J Am Heart Assoc. 2023;12(9):e028739. doi: 10.1161/JAHA.122.028739

 

  1. Evenepoel P, Stenvinkel P, Shanahan C. Inflammation and gut dysbiosis as drivers of CKD–MBD. Nat Rev Nephrol. 2023;19(10):646-657. doi: 10.1038/s41581-023-00736-7

 

  1. Ren F, Jin Q, Jin Q, et al. Genetic evidence supporting the causal role of gut microbiota in chronic kidney disease and chronic systemic inflammation in CKD: a bilateral twosample Mendelian randomization study. Front Immunol. 2023;14:1287698. doi: 10.3389/fimmu.2023.1287698

 

  1. Venkatrao K, Kareemulla S. HDLNET: a hybrid deep learning network model with intelligent IoT for detection and classification of chronic kidney disease. IEEE Access. 2023;11:99638-99652. doi: 10.1109/ACCESS.2023.3312183

 

  1. Joo YS, Rim TH, Koh HB, et al. Non-invasive chronic kidney disease risk stratification tool derived from retinabased deep learning and clinical factors. NPJ Digit Med. 2023;6(1):114. doi: 10.1038/s41746-023-00860-5

 

  1. Liang P, Yang J, Wang W, et al. Deep learning identifies intelligible predictors of poor prognosis in chronic kidney disease. IEEE J Biomed Health Inform. 2023;27(7):3677-3685. doi: 10.1109/JBHI.2023.3266587

 

  1. Yang J, Chen X, Luo C, et al. Application of serum SERS technology combined with deep learning algorithm in the rapid diagnosis of immune diseases and chronic kidney disease. Sci Rep. 2023;13(1):15719. doi: 10.1038/s41598-023-42719-5

 

  1. Bhattacharjee A, Rabea S, Bhattacharjee A, et al. A multiclass deep learning model for early lung cancer and chronic kidney disease detection using computed tomography images. Front Oncol. 2023;13:1193746. doi: 10.3389/fonc.2023.1193746

 

  1. Zhang M, Ye Z, Yuan E, et al. Imaging-based deep learning in kidney diseases: recent progress and future prospects. Insights Imaging. 2024;15(1):50. doi: 10.1186/s13244-024-01636-5

 

  1. Arif MS, Rehman AU, Asif D. Explainable machine learning models for chronic kidney disease prediction. Algorithms. 2024;17(10):443. doi: 10.3390/a17100443

 

  1. Arif MS, Mukheimer A, Asif D. Enhancing the Early Detection of Chronic Kidney Disease: A Robust Machine Learning Model. Big Data Cogn Comput. 2023;7(3):144. doi: 10.3390/bdcc7030144

 

  1. Li J, Zakka KR, Booth J, et al. Discovering patient groups in sequential electronic healthcare data using unsupervised representation learning. BMC Med Inform Decis Mak. 2025;25(1):45. doi: 10.1186/s12911-024-02812-9

 

  1. Miotto R, Li L, Kidd BA, Dudley JT. Deep patient: An unsupervised representation to predict the future of patients from the electronic health records. Sci Rep. 2016;6(1):26094. doi: 10.1038/srep26094

 

  1. Friedman SF, Khurshid S, Venn RA, et al. Unsupervised deep learning of electrocardiograms enables scalable human disease profiling. NPJ Digit Med. 2025;8:23. doi: 10.1038/s41746-024-01418-9

 

  1. Baltrušaitis T, Ahuja C, Morency LP. Multimodal machine learning: A survey and taxonomy. IEEE Trans Pattern Anal Mach Intell. 2018;41(2):423-443. doi: 10.1109/TPAMI.2018.2798607

 

  1. Li W, Ge X, Liu S, Xu L, Zhai X, Yu L. Opportunities and challenges of traditional Chinese medicine doctors in the era of artificial intelligence. Front Med. 2024;10:1336175. doi: 10.3389/fmed.2023.1336175

 

  1. Zhai Y, Gu J, Zong F, Jiang W. Fine grained cross-modal retrieval algorithm for IETM with attention mechanism fused. Syst Eng Electron. 2023;45(12):3915-3923. doi: 10.12305/j.issn.1001-506X.2023.12.21

 

  1. Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP. SMOTE: Synthetic minority over-sampling technique. J Artif Intell Res. 2002;16:321-357. doi: 10.1613/jair.953

 

  1. Hastie T, Tibshirani R, Friedman J. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. 2nd ed. Springer; 2009. doi: 10.1007/978-0-387-84858-7

 

  1. Khatri M, Zitovsky J, Lee D, Nayyar K, Fazzari M, Grant C. The association between serum chloride levels and chronic kidney disease progression: a cohort study. BMC Nephrol. 2020;21(1):165. doi: 10.1186/s12882-020-01828-3

 

  1. Kingma D, Ba J. Adam: A method for stochastic optimization. International Conference on Learning Representations (ICLR). arXiv. Preprint posted online January 30, 2017. doi: 10.48550/arXiv.1412.6980

 

  1. Bezinque A, Parker J, Babitz SK, Noyes SL, Hu S, Lane BR. Proteinuria impacts patient survival differentially based on clinical setting: A retrospective cross-sectional analysis of cohorts from a single health system: Retrospective cohort study. Ann Med Surg. 2019;45:120-126. doi: 10.1016/j.amsu.2019.07.029

 

  1. Feng Y, Shen J, Xu H, Wang R, Liu T, Zhang Y. Cross fusion multimodal sentiment analysis model based on translate mechanism. Data Anal Knowl Discov. 2025;9(3):16-27. doi: 10.11925/infotech.2096-3467.2024.0003

 

  1. Bahdanau D, Cho K, Bengio Y. Neural Machine Translation by Jointly Learning to Align and Translate. International Conference on Learning Representations (ICLR). arXiv. Preprint posted online May 19, 2014. doi: 10.48550/arXiv.1409.0473

 

  1. Li F, Zheng T, He N, et al. Data-driven hybrid neural fuzzy network and ARX modeling approach to practical industrial process identification. IEEE/CAA J Autom Sin. 2022;9(9):1702-1705. doi: 10.1109/JAS.2022.105821
Share
Back to top
Artificial Intelligence in Health, Electronic ISSN: 3029-2387 Print ISSN: 3041-0894, Published by AccScience Publishing