Dynamic operating room scheduling with emergency arrivals via deep reinforcement learning
Operating room (OR) scheduling in modern hospitals must reconcile elective case planning precision with emergency arrival uncertainty. Traditional two-phase approaches---offline elective and emergency case scheduling and emergency calling forth rescheduling in the reactive mode---are marred by computational delays and the wasteful use of resources. We introduce an integrated, real-time dynamic OR scheduling model grounded on deep reinforcement learning (DRL). By casting the OR scheduling problem as a Markov decision process, our method continuously adapts surgery assignments, start times, and overtime accruals to both elective and emergent requirements. An actor--critic structure trained with proximal policy optimization learns to progressively dispatch cases to minimize total overtime without separate rescheduling steps. On synthetic benchmarks for small, medium, and large instances with uniform and Poisson emergency-arrival distributions, the DRL outperformed a reactive mixed-integer programming (RMIP) baseline and an optimized heuristic. It reduced average overtime by over 50% while generating schedules in less than 4 s–achieving 100-1,000× speedup over RMIP. These results demonstrate that our learning-based method offers a scalable, reliable, and real-time solution to dynamic OR scheduling, paving the way for deployment in high-stakes clinical environments.

- Zhu S, Fan W, Yang S, Pei J, Pardalos PM. Oper-ating room planning and surgical case scheduling: a review of literature. J Comb Optim. 2019;37(3):757- https://www.doi.org/10.1007/s10878-018-0322-6.
- Addis B, Carello G, Tanfani E. Evaluating the impact of the level of robustness in operating room scheduling problems. Healthcare. 2024;12(20):2023. https://www.doi.org/10.3390/healthcare12202023.
- Abdalkareem ZA, Amir A, Al-Betar MA, Ekhan P, Hammouri AI. Healthcare scheduling in opti-mization context: a review. Health Technol (Berl). 2021;11(3):445-469. https://www.doi.org/10.1007/s12553-021-00547-
- Kroer LR, Foverskov K, Vilhelmsen C, Hansen AS, Larsen Planning and scheduling operating rooms for elective and emergency surgeries with uncertain duration. Oper Res Health Care. 2018;19:107-119. https://www.doi.org/10.1016/j.orhc.2018.03.006.
- Schouten AM, Flipse SM, van Nieuwenhuizen KE, Jansen FW, van der Eijk AC, van den Dobbel-steen JJ. Operating room performance optimiza-tion metrics: a systematic review. J Med Syst. 2023;47(1):19. https://www.doi.org/10.1007/s10916-023-01912-
- Ahmadi-Javid A, Jalali Z, Klassen KJ. Outpatient appointment systems in healthcare: a review of op-timization studies. Eur J Oper Res. 2017;258(1):3- https://www.doi.org/10.1016/j.ejor.2016.06.064.
- Shehadeh KS, Padman R. A distributionally ro-bust optimization approach for stochastic elective surgery scheduling with limited intensive care unit Eur J Oper Res. 2021;290(3):901-913. https://www.doi.org/10.1016/j.ejor.2020.09.001.
- Bovim TR, Christiansen M, Gullhav AN, Range TM, Hellemo Stochastic master surgery schedul-ing. Eur J Oper Res. 2020;285(2):695-711. https://www.doi.org/10.1016/j.ejor.2020.02.001.
- Kamran MA, Karimi B, Dellaert N. A column-generation-heuristic-based Benders decomposition for adaptive allocation scheduling of patients in op-erating rooms. Comput Ind Eng. 2020;148:106698. https://www.doi.org/10.1016/j.cie.2020.
- Akbarzadeh B, Moslehi G, Reisi-Nafchi M, Maen-hout Re-planning and scheduling of surgi-cal cases after block release time with resource rescheduling. Eur J Oper Res. 2019;278(2):596-614. https://www.doi.org/10.1016/j.ejor.2019.04.037.
- Addis B, Carello G, Grosso A, Tanfani E. Op-erating room scheduling and rescheduling: a rolling horizon approach. Flex Serv Manuf J. 2016;28(1):206-232. https://www.doi.org/10.1007/s10696-015-9213-
- Gauthier JB, Legrain A. Operating room management under uncertainty. 2016;21(4):577-596. https://www.doi.org/10.1007/s10601-015-9236-4.
- Rabbani M, Zhalechian M, Farshbaf-Geranmayeh A robust possibilistic programming approach to multiperiod hospital evacuation planning. Int Trans Oper Res. 2018;25(1):157-189. https://www.doi.org/10.1111/itor.12331.
- Cardoen B, Demeulemeester E, Belien Operating room planning and scheduling: a literature review. Eur J Oper Res. 2010;201(3):921-932. https://www.doi.org/10.1016/j.ejor.2009.04.011.
- Eshghali M, Kannan D, Salmanzadeh-Meydani N, Esmaieeli Sikaroudi AM. Machine learning based integrated scheduling and rescheduling for elective and emergency patients. Ann Oper Res. 2024;332(1):989-1012. https://www.doi.org/10.1007/s10479-023-05168-
- Khan J, Khan MA, Sarwar Improvements of Hermite-Hadamard-Mercer inequality using k-fractional integral. Int J Optim Control Theor Appl. 2025;15(1):155-165. https://www.doi.org/10.36922/ijocta.1568.
- Fallahpour Y, Rafiee M, Elomri A, Kayvanfar V, El Omri A. Multi-objective planning and scheduling model for elective and emergency cases under uncertainty. Decis Anal J. 2024;11:100475. https://www.doi.org/10.1016/j.dajour.2024.100475.
- Miao H, Wang JJ. Scheduling elective and emergency surgeries with emergency uncertainty and waiting time limit. Comput Ind Eng. 2021;160:107551. https://www.doi.org/10.1016/j.cie.2021.107551.
- Wang Y, Zhang Y, Tang J. Wasserstein distri-butionally robust surgery scheduling with elec-tive and emergency patients. Eur J Oper Res. 2024;314(2):509-522. https://www.doi.org/10.1016/j.ejor.2023.10.026.
- Zhao L, Zhu H, Zhang M, Tang J, Wang Large-scale dynamic surgical scheduling under uncer-tainty by hierarchical reinforcement learning. Int J Prod Res. 2024;62:1-32. https://www.doi.org/10.1080/00207543.2024. 2361449.
- Ahmed A, He L, Chou CA, Firouz M, Hamasha Prediction-optimization approach to surgery prioritization. J Ind Prod Eng. 2021;39:1-15. https://www.doi.org/10.1080/21681015.2021. 2017362.
- Arab Momeni M, Mostofi A, Jain V, Soni COVID-19 epidemic outbreak: operating room scheduling and emergency assignment using robust optimization. Ann Oper Res. 2022. https://www.doi.org/10.1007/s10479-022-04667-7.
- Amin MA, Baldacci R, Kayvanfar A compre-hensive review on operating room scheduling and optimization. Operational Research. 2025;25(3). https://www.doi.org/10.1007/s12351-024-00884-z.
- Majthoub Almoghrabi M, Sagnol G. Surgery scheduling in flexible operating rooms by using a convex surrogate model of second-stage costs. Eur J Oper Res. 2025;321(1):23-40. https://www.doi.org/10.1016/j.ejor.2024.07.036.
- Heydari M, Soudi A. Predictive/reactive planning and scheduling of a surgical suite with emergency patient arrival. J Med Syst. 2016;40(1):30. https://www.doi.org/10.1007/s10916-015-0385-1.
- Lopes J Sr, Guimar˜aes T, Duarte J, Santos Enhancing surgery scheduling with artificial intel-ligence: metaheuristic optimisation models. JMIR Med Inform. 2024;13:1-11. https://www.doi.org/10.2196/57231.
- Lin YK, Yen CH. Genetic algorithm for solving the no-wait three-stage surgery scheduling Healthcare. 2023;11(5):739. https://www.doi.org/10.3390/healthcare11050739.
- Dai JG, Shi Recent modeling and analyti-cal advances in hospital inpatient flow manage-ment. Prod Oper Manag. 2021;30(6):1838-1862. doi: 10.1111/poms.13132.
- Zhu T, Xie J, Sim M. Joint estimation and robust-ness optimization. Manage Sci. 2022;68(3):1659- https://www.doi.org/10.1287/mnsc.2020.3898.
- Lee S, Yih Y. Analysis of an open access schedul-ing system in outpatient clinics. 2010;86:503-518. https://www.doi.org/10.1177/0037549709358295.
- Leeftink G, Hans E. Case mix classification and benchmark set for surgery scheduling. J Sched. 2018;21:1-14. https://www.doi.org/10.1007/s10951-017-0539-
- Britt J, Baki MF, Azab A, Chaouch A, Li X. Stochastic hierarchical approach for the master surgical scheduling problem. Comput Ind Eng. 2021;158:107385. https://www.doi.org/10.1016/j.cie.2021.107385.
- Oliveira M, B´elanger V, Marques I, Ruiz As-sessing the impact of patient prioritization on op-erating room schedules. Oper Res Health Care. 2020;24:100232. https://www.doi.org/10.1016/j.orhc.2019.100232.
- V ali-Siar MM, Gholami S, Ramezanian R. Multi-period and multi-resource operating room scheduling under uncertainty. Comput Ind Eng. 2018;126:549-568. https://www.doi.org/10.1016/j.cie.2018.10.014.
- Khalfalli M, Verny J. Fuzzy logic for stochastic operating theater optimization: a In: Proc Int Conf Health Care Syst Eng. 2020:259-270. https://www.doi.org/10.1007/978-3-030-34702- 4 16.
- Tsang MY, Shehadeh KS, Curtis FE, Hochman BR, Brentjens Stochastic optimization ap-proaches for operating room and anesthesiologist scheduling. Oper Res. 2024. https://www.doi.org/10.1287/opre.2022.0258.
- Rachuba S, Werners B. Robust approach for scheduling in hospitals using multiple J Oper Res Soc. 2014;65:546-556. https://www.doi.org/10.1057/jors.2013.112.
- Addis B, Carello G, T`anfani A Robust Op-timization Approach for the Operating Room Planning Problem with Uncertain Surgery Du-ration. In: Springer Proceedings in Mathematics & Statistics. Springer International Publish-ing; 2013:175-189. https://www.doi.org/10.1007/978-3-319-01848-5 14.
- Wang Y, Zhang Y, Tang J. Distributionally robust optimization for surgery block allocation. Eur J Oper Res. 2019;273(2):740-753. https://www.doi.org/10.1016/j.ejor.2018.08.037.
- He L, Chalil Madathil S, Oberoi A, Servis G, Kha-sawneh A systematic review of research design and modeling techniques in inpatient bed manage-ment. Comput Ind Eng. 2019;127:451-466. https://www.doi.org/10.1016/j.cie.2018.10.033.
- Wu R, Zheng J, Yin X. Dynamic scheduling for multi-objective flexible job shops with machine breakdown by deep reinforcement learning. Pro-cesses. 2025;13(4):1246. https://www.doi.org/10.3390/pr13041246.
- Yuan E, Wang L, Song S, Cheng S, Fan W. Dy-namic scheduling for multi-objective flexible job shop via deep reinforcement learning. Appl Soft Comput. 2025;171:112787. https://www.doi.org/10.1016/j.asoc.2025.112787.
- Lee S, Lee YH. Improving emergency department efficiency by patient scheduling using deep rein-forcement learning. 2020;8(2):77. https://www.doi.org/10.3390/healthcare8020077.
- Miao H, Wang JJ. Distributed surgical scheduling across collaborating hospitals. Comput Ind Eng. 2023;183:109462. https://www.doi.org/10.1016/j.cie.2023.109462.
- Hooshmand F, MirHassani SA, Akhavein Adapt-ing GA for operating room scheduling with en-dogenous uncertainty. 0 Oper Res Health Care. 2018;19:26-43. https://www.doi.org/10.1016/j.orhc.2018.02.002.
