Contribution to the design of a hybrid machine learning-based predictive maintenance method: The case of the shop process in the biopharmaceutical industry
In the biopharmaceutical industry, pneumatic valve diaphragms are critical components whose progressive degradation can affect production reliability and maintenance planning. This paper lays the foundation for a hybrid predictive maintenance approach for valve diaphragms used in the biopharmaceutical industry, within the framework of Prognostics and Health Management. The proposed data-driven method combines supervised and unsupervised machine learning techniques to classify equipment degradation stages and estimate its remaining useful life (RUL). The data, enriched through dedicated feature transformations, enable the identification of the equipment life stages and the prediction of the time remaining before failure. The present work focuses on the design and evaluation of these prognostic models. The integration of the resulting predictions into a decision-support system comparing time-based preventive maintenance with predictive strategies is identified as future work. Although developed for valve diaphragms, the approach is adaptable to other industrial equipment and aims to enhance system reliability while reducing production downtime, in compliance with the regulatory constraints of the biopharmaceutical industry.
- Adhao V, Ambhore J, Chaudhari S. Transforming pharmaceutical quality assurance and validation through artificial intelligence. Artif Intell Health. 2025;3(1):18-28. doi: 10.36922/AIH025160032
- Wadel F, Tighazoui A, Houssin R, Coulibaly A. An equipment behavioral study in fluidic production processes using data for optimized predictive maintenance: application to pneumatic valves in biopharmaceutical industry. FME Trans. 2025;53(3):345-362. doi: 10.5937/fme2503345W
- Zwingelstein G. Méthodes de diagnostic et de pronostic de défaillance basées sur les modèles physiques. Maintenance. 2020. doi: 10.51257/a-v1-mt9133
- Menanno M, Salsano A. Centrifugal pump fault diagnosis using a predictive maintenance model. In: Proceedings of the 6th European International Conference on Industrial Engineering and Operations Management. IEOM Soc. 2023. doi: 10.46254/EU6.20230422
- Amasyali K, El-Gohary N. Hybrid approach for energy consumption prediction: coupling data-driven and physical approaches. Energy Build. 2022;259:111758. doi: 10.1016/j.enbuild.2021.111758
- Zhou ZH. A brief introduction to weakly supervised learning. Natl Sci Rev. 2018;5(1):44-53. doi: 10.1093/nsr/nwx106
- Yan M, Wang X, Wang B, Chang M, Muhammad I. Bearing remaining useful life prediction using support vector machine and hybrid degradation tracking model. ISA Trans. 2020;98:471-482. doi: 10.1016/j.isatra.2019.08.058
- Li Z, Goebel K, Wu D. Degradation modeling and remaining useful life prediction of aircraft engines using ensemble learning. J Eng Gas Turbines Power. 2019;141(4):041008. doi: 10.1115/1.4041674
- Lei Y, Jia F, Lin J, Xing S, Ding SX. An intelligent fault diagnosis method using unsupervised feature learning towards mechanical big data. IEEE Trans Ind Electron. 2016;63(5):3137-3147. doi: 10.1109/TIE.2016.2519325
- Choi WH, Kim J. Unsupervised learning approach for anomaly detection in industrial control systems. Appl Syst Innov. 2024;7(2):18. doi: 10.3390/asi7020018
- Lei Y, Yang B, Jiang X, Jia F, Li N, Nandi AK. Applications of machine learning to machine fault diagnosis: a review and roadmap. Mech Syst Signal Process. 2020;138:106587. doi: 10.1016/j.ymssp.2019.106587
- Liu H, Chen W, Chen W, Gu Y. A CNN-LSTM-based domain adaptation model for remaining useful life prediction. Meas Sci Technol. 2022;33(11):115118. doi: 10.1088/1361-6501/ac7f7f
- Li X, Zhang W, Ding Q. Deep learning-based remaining useful life estimation of bearings using multi-scale feature extraction. Reliab Eng Syst Saf. 2019;182:208-218. doi: 10.1016/j.ress.2018.11.011
- Fink O, Wang Q, Svensén M, Dersin P, Lee WJ, Ducoffe M. Potential, challenges and future directions for deep learning in prognostics and health management applications. Eng Appl Artif Intell. 2020;92:103678. doi: 10.1016/j.engappai.2020.103678
- Sharma R, Sharma K, Khanna A. Study of supervised learning and unsupervised learning. Int J Res Appl Sci Eng Technol. 2020;8(6):588-593. doi: 10.22214/ijraset.2020.6095
- Shinde PP, Shah S. A review of machine learning and deep learning applications. In: 2018 Fourth International Conference on Computing Communication Control and Automation (ICCUBEA). IEEE; 2018:1-6. doi: 10.1109/ICCUBEA.2018.8697857
- Drissi A, Iung B, Voisin A, Galinier V. Coupling prognostics and decision making (P&DM) processes in PHM: a literature review and proposal of a residual performance lifetime concept. IFAC-PapersOnLine. 2022;55(19):145-150. doi: 10.1016/j.ifacol.2022.09.198
- Yilmaz A, Ozkat EC, Gul F. Signal intelligence: vibration-driven deep learning for anomaly detection of rotary-wing UAVs. Drones. 2026;10(5):321. doi: 10.3390/drones10050321
- Wattenberg M, Viégas F, Johnson I. How to use t-SNE effectively. Distill. 2016;1(10):e2. doi: 10.23915/distill.00002
- Kamiński B, Jakubczyk M, Szufel P. A framework for sensitivity analysis of decision trees. Cent Eur J Oper Res. 2018;26(1):135-159. doi: 10.1007/s10100-017-0479-6
- Biau G, Scornet E. A random forest guided tour. TEST. 2016;25(2):197-227. doi: 10.1007/s11749-016-0481-7
- Cervantes J, Garcia-Lamont F, Rodríguez-Mazahua L, Lopez A. A comprehensive survey on support vector machine classification: applications, challenges and trends. Neurocomputing. 2020;408:189-215. doi: 10.1016/j.neucom.2019.10.118
- Abiodun OI, Jantan A, Omolara AE, Dada KV, Mohamed NA, Arshad H. State-of-the-art in artificial neural network applications: a survey. Heliyon. 2018;4(11):e00938. doi: 10.1016/j.heliyon.2018.e00938
- Hosmer DW, Lemeshow S, Sturdivant RX. Applied Logistic Regression. 3rd ed. Wiley; 2020. doi: 10.1002/9781118548387
- Van de Schoot R, Depaoli S, King R, et al. Bayesian statistics and modeling. Nat Rev Methods Primers. 2021;1(1):1. doi: 10.1038/s43586-020-00001-2
- Zhang S, Li X, Zong M, Zhu X, Wang R. Efficient kNN classification with different numbers of nearest neighbors. IEEE Trans Neural Netw Learn Syst. 2018;29(5):1774-1785. doi: 10.1109/TNNLS.2017.2673241
- Chen T, Guestrin C. XGBoost: a scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Association for Computing Machinery; 2016:785-794. doi: 10.1145/2939672.2939785
- Bentéjac C, Csörgő A, Martínez-Muñoz G. A comparative analysis of gradient boosting algorithms. Artif Intell Rev. 2021;54(3):1937-1967. doi: 10.1007/s10462-020-09896-5
- Schulz E, Speekenbrink M, Krause A. A tutorial on Gaussian process regression: modeling, exploring, and exploiting functions. J Math Psychol. 2018;85:1-16. doi: 10.1016/j.jmp.2018.03.001
- Kocher G, Kumar G. Analysis of machine learning algorithms with feature selection for intrusion detection using UNSW-NB15 dataset. SSRN. 2021. doi: 10.2139/ssrn.3784406
- Nti IK, Nyarko-Boateng O, Aning J. Performance of machine learning algorithms with different K values in K-fold cross-validation. Int J Inf Technol Comput Sci. 2021;13(6):61-71. doi: 10.5815/ijitcs.2021.06.05
- Patra GK, Kuraku C, Konkimalla S, Boddapati VN, Sarisa M, Reddy MS. An analysis and prediction of health insurance costs using machine learning-based regressor techniques. J Data Anal Inf Process. 2024;12(4):581-596. doi: 10.4236/jdaip.2024.124031
- Weerts HJ, Mueller AC, Vanschoren J. Importance of tuning hyperparameters of machine learning algorithms. arXiv. Preprint posted online 2020. doi: 10.48550/arXiv.2007.07588
- Hastie T, Tibshirani R, Friedman J. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. 2nd ed. Springer; 2009. doi: 10.1007/978-0-387-84858-7
- Pedregosa F, Varoquaux G, Gramfort A, et al. Scikit-learn: machine learning in Python. J Mach Learn Res. 2011;12:2825-2830.
- Bergstra J, Bengio Y. Random search for hyper-parameter optimization. J Mach Learn Res. 2012;13:281-305. https://jmlr.org/papers/volume13/bergstra12a/bergstra12a.pdf
- Lei Y, Li N, Gontarz S, Lin J, Radkowski S, Dybala J. A model-based method for remaining useful life prediction of machinery. IEEE Trans Reliab. 2016;65(3):1314-1326. doi: 10.1109/TR.2016.2570568
- Wen Q, Sun L, Yang F, Song X, Gao J, Wang X, Xu H. Time series data augmentation for deep learning: a survey. In: Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence (IJCAI-21). International Joint Conferences on Artificial Intelligence Organization; 2021:4653-4660. doi: 10.24963/ijcai.2021/631
- Sapre A, Vartak S. Scientific computing and data analysis using NumPy and Pandas. Int Res J Eng Technol. 2020;7(3):1334-1346. https://www.irjet.net/archives/V7/i12/IRJET-V7I12236.pdf
- Breiman L. Random forests. Mach Learn. 2001;45(1):5-32. doi: 10.1023/A:1010933404324
- Akırmak OO, Altan A. Estimation of extrusion process parameters in tire manufacturing industry using random forest classifier. Balkan J Electr Comput Eng. 2023;11(2):138-143. doi: 10.17694/bajece.1232811
- Breiman L. Bagging predictors. Mach Learn. 1996;24(2):123-140. doi: 10.1007/BF00058655
