Effectiveness of Kaizen-Based Programmes in Improving Patient Safety Incident Reporting: A Systematic Review Protocol with Monte Carlo Validation
Downloads
Incident reporting is a fundamental component of organizational learning in patient safety. However, Kaizen-based continuous improvement programs designed to strengthen incident reporting are often evaluated using report counts, which cannot distinguish improvements in reporting culture from increases in actual patient harm. This study aimed to develop and validate an analytical framework that differentiates these effects and establish a systematic review protocol for its application. The observed reporting rate was decomposed into three components: exposure, the true incident rate, and reporting propensity. A severity-stratified Reporting Propensity Index (RPI) was developed using partial identification bounds, alongside a behavioral reporting model, an assessment of bias in before-and-after study designs, and a sustainability half-life measure. Four Monte Carlo simulation studies encompassing 52 scenarios were conducted to evaluate estimator performance, and a systematic review protocol was developed in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 guidelines. Under the specified assumptions, the RPI estimator was unbiased and achieved nominal confidence interval coverage, whereas the conventional total-count estimator exhibited bias of up to ?0.35 log units. When assumptions were violated, the partial identification bounds contained the true parameter in at least 97.4% of simulation replications. Uncontrolled before-and-after designs overestimated intervention effects, consistent with theoretical predictions, while reusing baseline-period data in moderator analyses increased the false-positive rate to 20.7%. These findings suggest that severity-stratified incident reporting, analyzed using the RPI framework, may provide hospitals with a more reliable measure of reporting propensity and support evidence-based decisions regarding the implementation and evaluation of Kaizen-based patient safety improvement programs.
Akmal, A., Greatbanks, R., & Foote, J. (2020). Lean thinking in healthcare – Findings from a systematic literature network and bibliometric analysis. Health Policy, 124(6), 615–627. https://doi.org/10.1016/j.healthpol.2020.04.008
Archer, S., Hull, L., Soukup, T., Mayer, E., Athanasiou, T., Sevdalis, N., & Darzi, A. (2017). Development of a theoretical framework of factors affecting patient safety incident reporting: A theoretical review of the literature. BMJ Open, 7(12), e017155. https://doi.org/10.1136/bmjopen-2017-017155
Bakbergenuly, I., & Kulinskaya, E. (2018). Meta-analysis of binary outcomes via generalized linear mixed models: A simulation study. BMC Medical Research Methodology, 18, 70.
Bates, W., D., Levine, M., D., Salmasian, H., Syrowatka, A., Shahian, M., D., Lipsitz, S., Zebrowski, P., J., Myers, C., L., Logan, S., M., Roy, … … Mort, E. (2023). The safety of inpatient health care. New England Journal of Medicine, 388(2), 142–153. https://doi.org/10.1056/NEJMsa2206117
Campbell, M., McKenzie, E., J., Sowden, A., Katikireddi, V., S., Brennan, E., S., Ellis, S., Hartmann-Boyce, J., Ryan, R., Shepperd, S., Thomas, … Thomson, H. (2020). Synthesis without meta-analysis (SWiM) in systematic reviews: Reporting guideline. BMJ, 368, l6890. https://doi.org/10.1136/bmj.l6890
Dhamanti, I., Leggat, S., & Barraclough, S. (2020). Practical and cultural barriers to reporting incidents among health workers in Indonesian public hospitals. Journal of Multidisciplinary Healthcare, 13, 351–359. https://doi.org/10.2147/JMDH.S240124
Dhamanti, I., Leggat, S., Barraclough, S., & Tjahjono, B. (2019). Patient safety incident reporting in Indonesia: An analysis using World Health Organization characteristics for successful reporting. Risk Management and Healthcare Policy, 12, 331–338. https://doi.org/10.2147/RMHP.S222262
Dixon-Woods, M., & Martin, G. P. (2016). Does quality improvement improve quality? Future Hospital Journal, 3(3), 191–194. https://doi.org/10.7861/futurehosp.3-3-191
Grailey, E., K., Murray, E., Reader, T., & Brett, S. J. (2021). The presence and potential impact of psychological safety in the healthcare setting: An evidence synthesis. BMC Health Services Research, 21, 773. https://doi.org/10.1186/s12913-021-06740-6
Hallam, C. R. A., & Contreras, C. (2018). Lean healthcare: Scale, scope and sustainability. International Journal of Health Care Quality Assurance, 31(7), 684–696. https://doi.org/10.1108/IJHCQA-02-2017-0023
Hamed, M. M. M., & Konstantinidis, S. (2022). Barriers to incident reporting among nurses: A qualitative systematic review. Western Journal of Nursing Research, 44(5), 506–523. https://doi.org/10.1177/0193945921999449
Hultcrantz, M., Rind, D., Akl, A., E., Treweek, S., Mustafa, A., R., Iorio, A., Alper, S., B., Meerpohl, J., J., Murad, H., M., Ansari, … Guyatt, G. (2017). The GRADE Working Group clarifies the construct of certainty of evidence. Journal of Clinical Epidemiology, 87, 4–13. https://doi.org/10.1016/j.jclinepi.2017.05.006
Kanamori, S., Shibanuma, A., & Jimba, M. (2016). Applicability of the 5S management method for quality improvement in health-care facilities: A review. Tropical Medicine and Health, 44, 21.
Knudsen, V., S., Laursen, B., H. V, Johnsen, P., S., Bartels, D., P., Ehlers, L. H., & Mainz, J. (2019). Can quality improvement improve the quality of care? A systematic review of reported effects and methodological rigor in plan-do-study-act projects. BMC Health Services Research, 19, 683. https://doi.org/10.1186/s12913-019-4482-6
Lee, E., S., Scott, D., L., Dahinten, S., V., Vincent, C., Lopez, K. D., & Park, C. G. (2019). Safety culture, patient safety, and quality of care outcomes: A literature review. Western Journal of Nursing Research, 41(2), 279–304. https://doi.org/10.1177/0193945917747416
Leite, H., Bateman, N., & Radnor, Z. (2020). Beyond the ostensible: An exploration of barriers to lean implementation and sustainability in healthcare. Production Planning & Control, 31(1), 1–18.
Macrae, C. (2016). The problem with incident reporting. BMJ Quality & Safety, 25(2), 71–75. https://doi.org/10.1136/bmjqs-2015-004732
Mahmoud, Z., Angelé-Halgand, N., Churruca, K., Ellis, L. A., & Braithwaite, J. (2021). The impact of lean management on frontline healthcare professionals: A scoping review of the literature. BMC Health Services Research, 21, 383. https://doi.org/10.1186/s12913-021-06344-0
Marsilio, M., & Pisarra, M. (2021). Lean management in health care: A review of reviews of socio-technical components for effective impact. Journal of Health Organization and Management, 35(4), 475–491. https://doi.org/10.1108/JHOM-06-2020-0241
Mazzocato, P., Stenfors-Hayes, T., Schwarz, von T., U., Hasson, H., & Nyström, M. E. (2016). Kaizen practice in healthcare: A qualitative analysis of hospital employees’ suggestions for improvement. BMJ Open, 6(7), e012256. https://doi.org/10.1136/bmjopen-2016-012256
Mitchell, I., Schuster, A., Smith, K., Pronovost, P., & Wu, A. (2016). Patient safety incident reporting: A qualitative study of thoughts and perceptions of experts 15 years after ‘To Err is Human.’ BMJ Quality & Safety, 25(2), 92–99.
Moraros, J., Lemstra, M., & Nwankwo, C. (2016). Lean interventions in healthcare: Do they actually work? A systematic literature review. International Journal for Quality in Health Care, 28(2), 150–165. https://doi.org/10.1093/intqhc/mzv123
Morris, P., T., White, I. R., & Crowther, M. J. (2019). Using simulation studies to evaluate statistical methods. Statistics in Medicine, 38(11), 2074–2102. https://doi.org/10.1002/sim.8086
O’Donovan, R., & McAuliffe, E. (2020). A systematic review of factors that enable psychological safety in healthcare teams. International Journal for Quality in Health Care, 32(4), 240–250. https://doi.org/10.1093/intqhc/mzaa025
Ouzzani, M., Hammady, H., Fedorowicz, Z., & Elmagarmid, A. (2016). Rayyan—A web and mobile app for systematic reviews. Systematic Reviews, 5, 210. https://doi.org/10.1186/s13643-016-0384-4
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., … Moher, D. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ, 372, n7.
Panagioti, M., Khan, K., Keers, N., R., Abuzour, A., Phipps, D., Kontopantelis, E., Bower, P., Campbell, S., Haneef, R., Avery, A. J., & Ashcroft, D. M. (2019). Prevalence, severity, and nature of preventable patient harm across medical care settings: Systematic review and meta-analysis. BMJ, 366, l4185. https://doi.org/10.1136/bmj.l4185
Reed, J. E., & Card, A. J. (2016). The problem with Plan-Do-Study-Act cycles. BMJ Quality & Safety, 25(3), 147–152. https://doi.org/10.1136/bmjqs-2015-005076
Rees, G. H., & Gauld, R. (2017). Can lean contribute to work intensification in healthcare? Journal of Health Organization and Management, 31(3), 369–384. https://doi.org/10.1108/JHOM-11-2016-0219
Reis, T., C., Paiva, S. G., & Sousa, P. (2018). The patient safety culture: A systematic review by characteristics of Hospital Survey on Patient Safety Culture dimensions. International Journal for Quality in Health Care, 30(9), 660–677. https://doi.org/10.1093/intqhc/mzy080
Rotter, T., Plishka, C., Lawal, A., Harrison, L., Sari, N., Goodridge, D., Flynn, R., Chan, J., Fiander, M., Poksinska, … Kinsman, L. (2019). What is lean management in health care? Development of an operational definition for a Cochrane systematic review. Evaluation & the Health Professions, 42(3), 366–390. https://doi.org/10.1177/0163278718756992
Sterne, C., J. A., Hernán, A., M., Reeves, C., B., Savovi?, J., Berkman, D., N., Viswanathan, M., Henry, D., Altman, G., D., Ansari, T., M., Boutron, … … Higgins, J. P. T. (2016). ROBINS-I: A tool for assessing risk of bias in non-randomised studies of interventions. BMJ, 355, i4919. https://doi.org/10.1136/bmj.i4919
Sterne, C., J. A., Savovi?, J., Page, J., M., Elbers, G., R., Blencowe, S., N., Boutron, I., Cates, J., C., Cheng, H.-Y., Corbett, S., M., Eldridge, … … Higgins, J. P. T. (2019). RoB 2: A revised tool for assessing risk of bias in randomised trials. BMJ, 366, l4898. https://doi.org/10.1136/bmj.l4898
Tlapa, D., Zepeda-Lugo, A., C., Tortorella, L., G., Baez-Lopez, A., Y., Limon-Romero, J., Alvarado-Iniesta, A., & Rodriguez-Borbon, M. I. (2020). Effects of lean healthcare on patient flow: A systematic review. Value in Health, 23(2), 260–273. https://doi.org/10.1016/j.jval.2019.11.002
Woodier, N., Burnett, C., & Moppett, I. (2023). The value of learning from near misses to improve patient safety: A scoping review. Journal of Patient Safety, 19(1), 42–47. https://doi.org/10.1097/PTS.0000000000001078
Copyright (c) 2026 Andan Suryo Wardani, Dyah Wiji Puspita Sari, Dwi Heppy Rochmawati, Muh. Abdurrouf

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlike 4.0 International (CC-BY-SA). that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.





