Acessibilidade / Reportar erro

Auditable criteria for implementing best practices in adhering to the surgical safety checklist

Abstract

Objective

To assess adherence to the use of the hospital’s Surgical Safety Checklist according to the auditable criteria of the Joanna Briggs Institute.

Methods

An observational descriptive study was conducted, using the Practical Application of Clinical Evidence System and Getting Research into Practice tools in the three phases of the study methodology: basic, educational and follow-up audits. The audits took place in the surgical center of a hospital in western Santa Catarina, Brazil. A total of 100 surgeries were eligible in the baseline audit, with the same 100 being included in the follow-up audit, and direct observation being performed by the surgical team in completing the Surgical Safety Checklist.

Results

Criteria 2 and 3 were highly compliant with best practices (81% to 93%) in the baseline audit, while Criteria 1 and 4 (45%, 49%) had low compliance. Thus, educational activities were conducted with the surgical team based on the barriers found in the basic audit. There was an increase in the compliance percentages for all criteria in the follow-up audit, and Criteria 2 and 3 obtained 100% and 99%, respectively; however, Criteria 1 and 4 continued with percentages below the expected (65% and 54%, respectively).

Conclusion

Failure to achieve 100% compliance with the audited criteria is caused by the provided care not being based on evidence-based practice. However, permanent and continuous education is expected to result in good practices at the study institution.

Checklist; Surgicenters; Patient safety; Perioperative nursing; Quality of health care

Resumo

Objetivo

Avaliar a adesão ao uso da Lista de Verificação de Segurança Cirúrgica de um hospital, conforme os critérios auditáveis do Instituto Joanna Briggs.

Métodos

Estudo observacional descritivo que utilizou as ferramentas Practical Application of Clinical Evidence System e Getting Reasearch into Practice nas três fases previstas da metodologia: auditoria de base, educativa e auditoria de seguimento. As auditorias aconteceram no centro cirúrgico de um hospital do oeste de Santa Catarina. Na auditoria de base, foram elegíveis cem cirurgias, sendo as mesmas cem incluídas na auditoria de seguimento, com observação direta da equipe cirúrgica no preenchimento completo da Lista de Verificação de Segurança Cirúrgica.

Resultados

Na auditoria de base, os critérios 2 e 3 tiveram alta conformidade com a melhor prática (81% a 93%), e os critérios 1 e 4 (45%, 49%) apresentaram baixa conformidade. A partir das barreiras encontradas na auditoria de base, foram realizadas atividades educativas junto à equipe cirúrgica. Na auditoria de seguimento, houve aumento nos percentuais da conformidade em todos os critérios, e os critérios 2 e 3 obtiveram 100% e 99%, respectivamente, contudo os critérios 1 e 4 continuaram com percentuais abaixo do esperado (65% e 54%, respectivamente).

Conclusão

A não obtenção de 100% de conformidade nos critérios auditados é ocasionada por um cuidado assistido não baseado na prática por evidências. Contudo, espera-se uma educação permanente e continuada para realizar as boas práticas na instituição do estudo.

Lista de checagem; Centros cirúrgicos; Segurança do paciente; Enfermagem perioperatória; Qualidade da assistência à saúde

Resumen

Objetivo

Evaluar la adhesión al uso de la Lista de Verificación de Seguridad Quirúrgica de un hospital, según los criterios de auditoría del Instituto Joanna Briggs.

Métodos

Estudio observacional descriptivo que utilizó las herramientas Practical Application of Clinical Evidence System y Getting Reasearch into Practice en las tres fases previstas de la metodología: auditoría basal, educativa y auditoría de seguimiento. Las auditorías se realizaron en el quirófano de un hospital del oeste del estado de Santa Catarina. En la auditoría basal, se seleccionaron 100 cirugías y las mismas 100 se incluyeron en la auditoría de seguimiento, con observación directa del equipo quirúrgico para el llenado completo de la Lista de Verificación de Seguridad Quirúrgica.

Resultados

En la auditoría basal, los criterios 2 y 3 tuvieron alta conformidad con la mejor práctica (81 % a 93 %), y los criterios 1 y 4 (45 %, 49 %) presentaron baja conformidad. A partir de los obstáculos encontrados en la auditoría basal, se realizaron actividades educativas con el equipo quirúrgico. En la auditoría de seguimiento, hubo un aumento en los porcentajes de conformidad en todos los criterios. El criterio 2 obtuvo 100 % y el 3, 99 %; no obstante, los criterios 1 y 4 continuaron con porcentajes inferiores a lo esperado (65 % y 54 %, respectivamente).

Conclusión

La no obtención del 100 % de conformidad en los criterios auditados se debe a un cuidado asistido no basado en la práctica por evidencias. Sin embargo, se espera una educación permanente y continua para realizar las buenas prácticas en la institución del estudio.

Lista de verificación; Centros quirúrgicos; Seguridad del paciente; Enfermería perioperatoria; Calidad de la atención de salud

Introduction

Anesthetic-surgical care is permeated by dynamic contexts that are developed by high-level complexity practices in attending to various situations and invasive interventions, and mediated by the interaction of interdisciplinary teams, further exercised in environmental conditions dominated by agility, precision and pressure. These characteristics often lead to unsafe conditions/situations, which are defined by the World Health Organization (WHO) as an avoidable event or circumstance resulting from care not associated with the underlying disease. ( 11. World Health Organization (WHO) . WHO guidelines for safe surgery 2009: safe surgery saves lives [ Internet ]. Geneva : WHO ; 2009 . [ cited 2020 Jul 29 ]. Available from: https://www.who.int/patientsafety/safesurgery/tools_resources/9789241598552/en/
https://www.who.int/patientsafety/safesu...
, 22. Martins GF , Silva AX , Silva Júnior AO , Gomes JA , Gomes TJ . [ Patient safety and systematization of nursing care in the postoperative period of cardiac transplantation: a systematic review ]. Braz J Health Rev . 2019 ; 2 ( 2 ): 727 – 41 . Portuguese . )

Despite the unquestionable benefits of the approach in the health-disease process, surgical care is considerably associated with important risks of complications and death. It is in this perspective and with a view to reduce the occurrence of adverse events in patients undergoing surgical procedures that the WHO established the second global challenge for patient safety in 2009, named Safe Surgery Saves Lives. In this program, the WHO disclosed guidelines for implementing a universal surgical patient safety protocol, including the definition of the Surgical Safety Checklist. ( 11. World Health Organization (WHO) . WHO guidelines for safe surgery 2009: safe surgery saves lives [ Internet ]. Geneva : WHO ; 2009 . [ cited 2020 Jul 29 ]. Available from: https://www.who.int/patientsafety/safesurgery/tools_resources/9789241598552/en/
https://www.who.int/patientsafety/safesu...
, 33. Carvalho PA , Göttems LB , Pires MR , de Oliveira ML . Safety culture in the operating room of a public hospital in the perception of healthcare professionals . Rev Lat Am Enfermagem . 2015 ; 23 ( 6 ): 1041 – 8 . )

The Surgical Safety Checklist is a tool structured in a formal list used to identify, compare and verify a group of procedures in the three phases: before the start of anesthesia ( sign in ), before skin incision ( time out ), and before the patient leaves the operating room ( sign out ). ( 11. World Health Organization (WHO) . WHO guidelines for safe surgery 2009: safe surgery saves lives [ Internet ]. Geneva : WHO ; 2009 . [ cited 2020 Jul 29 ]. Available from: https://www.who.int/patientsafety/safesurgery/tools_resources/9789241598552/en/
https://www.who.int/patientsafety/safesu...
, 44. Panesar SS , Noble DJ , Mirza SB , Patel B , Mann B , Emerton M , et al . Can the surgical checklist reduce the risk of wrong site surgery in orthopaedics?—can the checklist help? Supporting evidence from analysis of a national patient incident reporting system . J Orthop Surg Res . 2011 ; 6 ( 1 ): 18 .

5. Grigoleto A , Gimenes F , Avelar M . Segurança do cliente e as ações frente ao procedimento cirúrgico . Rev Eletr Enf . 2011 ; 13 ( 2 ): 347 – 54 .

6. Maziero EC , de Camargo Silva AE , de Fátima Mantovani M , de Almeida Cruz ED . [ Adherence to the use of the surgical checklist for patient safety ]. Rev Gaúcha Enferm . 2015 ; 36 ( 4 ): 14 – 20 . Portuguese .
- 77. Tostes MF , Galvão CM . Implementation process of the Surgical Safety Checklist: integrative review . Rev Lat Am Enfermagem . 2019 ; 27 ( 3104 ): e3104 . ) At the sign in , the patient’s identity, marking of the surgical site, presentation and signature of the informed consent form and the presence of the requested materials are verified. ( 88. Motta Filho GD , Neves da Silva LF , Ferracini AM , Bähr GL . The WHO Surgical Safety Checklist: knowledge and use by Brazilian orthopedists . Rev Bras Ortop . 2013 ; 48 ( 6 ): 554 – 62 .

9. Biccard BM , Rodseth R , Cronje L , Agaba P , Chikumba E , Du Toit L , et al . A meta-analysis of the efficacy of preoperative surgical safety checklists to improve perioperative outcomes . S Afr Med J . 2016 ; 106 ( 6 ): 592 – 7 .
- 1010. Treadwell JR , Lucas S , Tsou AY . Surgical checklists: a systematic review of impacts and implementation . BMJ Qual Saf . 2014 ; 23 ( 4 ): 299 – 318 . ) In the time out , there is a brief pause before the incision, during which all team members introduce themselves and state their function in the room, as well as verbally confirm the patient’s identification, the surgical site, the procedure to be performed, the patient’s position and possible surgery complications. ( 88. Motta Filho GD , Neves da Silva LF , Ferracini AM , Bähr GL . The WHO Surgical Safety Checklist: knowledge and use by Brazilian orthopedists . Rev Bras Ortop . 2013 ; 48 ( 6 ): 554 – 62 .

9. Biccard BM , Rodseth R , Cronje L , Agaba P , Chikumba E , Du Toit L , et al . A meta-analysis of the efficacy of preoperative surgical safety checklists to improve perioperative outcomes . S Afr Med J . 2016 ; 106 ( 6 ): 592 – 7 .

10. Treadwell JR , Lucas S , Tsou AY . Surgical checklists: a systematic review of impacts and implementation . BMJ Qual Saf . 2014 ; 23 ( 4 ): 299 – 318 .
- 1111. Sewell M , Adebibe M , Jayakumar P , Jowett C , Kong K , Vemulapalli K , et al . Use of the WHO surgical safety checklist in trauma and orthopaedic patients . Int Orthop . 2011 ; 35 ( 6 ): 897 – 901 . ) At sign out , the materials used in the operating rooms are checked and counted, and the patient is referred to the recovery room. ( 88. Motta Filho GD , Neves da Silva LF , Ferracini AM , Bähr GL . The WHO Surgical Safety Checklist: knowledge and use by Brazilian orthopedists . Rev Bras Ortop . 2013 ; 48 ( 6 ): 554 – 62 . )

In this sense, the benefits of adhering to the Surgical Safety Checklist are proven in a meta-analysis study in which its effectiveness was determined from three randomized controlled clinical studies (eligible and included in the study), showing a reduction in surgical complications such as respiratory (relative risk of 0.59; 95% confidence interval 0.21-1.70; p = 0.33), cardiac (relative risk of 0.74; 95% confidence interval 0.28-1.95; p = 0.54) and perioperative infections (relative risk of 0.61; 95% confidence interval 0.29-1.27; p = 0.18), as well as decreased surgical mortality (relative risk of 0.59; 95% confidence interval 0.42-0.85). ( 99. Biccard BM , Rodseth R , Cronje L , Agaba P , Chikumba E , Du Toit L , et al . A meta-analysis of the efficacy of preoperative surgical safety checklists to improve perioperative outcomes . S Afr Med J . 2016 ; 106 ( 6 ): 592 – 7 . )

A systematic review with 21 studies regarding the Surgical Safety Checklist implemented along the lines of the WHO and two others elaborated from institutional experiences pointed out that the use of the list was well understood by the surgical team, especially by nurses and anesthetists, in addition to the sharing of responsibilities in filling in the list items and good communication and teamwork. ( 1010. Treadwell JR , Lucas S , Tsou AY . Surgical checklists: a systematic review of impacts and implementation . BMJ Qual Saf . 2014 ; 23 ( 4 ): 299 – 318 . ) Thus, between 70% and 77% of health professionals perceived that the Surgical Safety Checklist improved team communication. ( 1111. Sewell M , Adebibe M , Jayakumar P , Jowett C , Kong K , Vemulapalli K , et al . Use of the WHO surgical safety checklist in trauma and orthopaedic patients . Int Orthop . 2011 ; 35 ( 6 ): 897 – 901 . , 1212. Kearns RJ , Uppal V , Bonner J , Robertson J , Daniel M , McGrady EM . The introduction of a surgical safety checklist in a tertiary referral obstetric centre . BMJ Qual Saf . 2011 ; 20 ( 9 ): 818 – 22 . )

With regard to the costs of implementing the Surgical Safety Checklists pointed out by the systematic review, values of US$11.00 per use and US$12,635.00 for training employees with the operationalization of all the items on the list stands out, be it according to the WHO model or prepared by the health institutions themselves. ( 1010. Treadwell JR , Lucas S , Tsou AY . Surgical checklists: a systematic review of impacts and implementation . BMJ Qual Saf . 2014 ; 23 ( 4 ): 299 – 318 . ) These values refer to the year 2008. Furthermore, the perception of the surgical team about the effect of surgical delays caused by this list is high, since this was revealed as an unnecessary action in the anesthetic-surgical act in the referenced study. The completion of safe perioperative care items on the list recommended by WHO takes an average of about 2 minutes. ( 1313. Taylor B , Slater A , Reznick R . The surgical safety checklist effects are sustained, and team culture is strengthened . Surgeon . 2010 ; 8 ( 1 ): 1 – 4 . )

Although the evidence demonstrates the significance of using the Surgical Safety Checklist for patient safety, a reflection study problematizes that operating this tool has revealed experiences with flaws and mistakes , such as the incompleteness of checklist items, low adherence, checking without verbalizing their items, reliability in the data filled in and resistance by health professionals. ( 1414. Tostes MF , Haracemiw A , Mai LD . Surgical Safety Checklist: considerations on institutional policies . Esc Anna Nery . 2016 ; 20 ( 1 ): 203 – 9 . ) In this sense, the authors question the causal factors of this difficulty, pointing out that implementing the list in some health services summarily, passively and bureaucratically represents yet another form to be filled out imposed on the nursing team, and may have contributed to the low adherence to its use. ( 1414. Tostes MF , Haracemiw A , Mai LD . Surgical Safety Checklist: considerations on institutional policies . Esc Anna Nery . 2016 ; 20 ( 1 ): 203 – 9 . )

The auditing processes meet the demand and need to verify adherence to the use of the Surgical Safety Checklist, as in health services it is necessary to manage quality through conformity and education audits in health, in addition to knowing the multiprofessional work process in order to guarantee behavioral changes in the safety and quality of surgical care. Verifying criteria to ensure that care is provided free of damage, malfunctions and events which should never occur (never events) is necessary for the surgical environment to be safe and reliable.

Thus, it was decided to perform the audit criteria of the Joanna Briggs Institute (JBI) based on the Evidence-Based Clinical Fellowship Program (EBCFP), conducted by the professor of the nursing course at a university in the state of Santa Catarina, Brazil, in March 2018, offered by the University of São Paulo School of Nursing, which prepared health professionals to promote evidence-based health care, as well as to develop knowledge and skills in change management and clinical leadership according to the implementation methodology of the collaboration with the Joanna Briggs Center of Excellence. There are studies that have conducted independent and/or institutional audits from quality and risk management departments regarding adherence to the Surgical Safety Checklist, however there were no publications on audits based on JBI auditable criteria on the subject in question. ( 1515. Sendlhofer G , Lumenta DB , Leitgeb K , Kober B , Jantscher L , Schanbacher M , et al . The gap between individual perception and compliance: a qualitative follow-up study of the surgical safety checklist application . PLoS One . 2016 ; 11 ( 2 ): e0149212 . , 1616. Ambulkar R , Ranganathan P , Salunke K , Savarkar S . The World Health Organization Surgical Safety Checklist: an audit of quality of implementation at a tertiary care high volume cancer institution . J Anaesthesiol Clin Pharmacol . 2018 ; 34 ( 3 ): 392 – 8 . ) Thus, this study sought to answer the following guiding question: Is there a commitment to the use of the Surgical Safety Checklist by the surgical team based on the JBI auditable criteria for best practices?

The recommendation for best practices regarding the effectiveness and adherence to the JBI surgical checklist was to recognize that adherence to the surgical checklist depends on its implementation by the surgical team (Evidence Grade A) and on continuing education and training about the objectives and their correct use in order to improve their adherence. This education should address possible misperceptions in its use and general safety (Evidence Grade A) and integrate the surgical checklist into existing work routines, so that it does not compromise and/or hinder the present work process (Level of Evidence A). 1717. Weiser TG , Haynes AB . Ten years of the Surgical Safety Checklist . Br J Surg . 2018 ; 105 ( 8 ): 927 – 9 . Therefore, the objective of this study was to evaluate adherence to the use of the Surgical Safety Checklist of a referral hospital in cardiac surgery according to the JBI auditable criteria.

Methods

This is an observational, cross-sectional and descriptive study. Data collection was carried out from December 2018 to February 2019 with a total of 200 (100%) direct observations of surgical procedures (general, orthopedic and cardiac). The study scenario was the surgical center of a hospital in the west of Santa Catarina State, referred to by the Ministry of Health as providing highly complex care in cardiology. The hospital has 174 beds with an average of 920 hospitalizations/month and 499 surgeries/month. The surgical center consisted of four operating rooms; one for cardiac surgery, another for emergencies and cesarean sections, and the others for other medical specializations.

The Surgical Safety Checklist was implemented in the study hospital in 2013, and was definitively instituted after training the surgical team and inserted in the patient’s electronic medical record in the three operative moments, as recommended by WHO in 2009. After implementation, any divergences contained on the list were individually managed and discussed by the general nursing coordinator with the surgical team. These inconsistencies were sometimes about patient identification data and items from the operative moments at sign in, time out and sign out . In addition, the present study site did not have a certification process with previously defined standards or requirements, nationally or internationally, with a view to the quality and safety of the care provided to the assisted patient, nor auditable processes regarding care quality.

This study was based on Evidence-Based Practice, which combines the best scientific evidence with clinical experience, thereby seeking critical and reflective decision making to be applied in health care and thus implement the best practices in health services. ( 1919. Tang R , Ranmuthugala G , Cunningham F . Surgical safety checklists: a review . ANZ J Surg . 2014 ; 84 ( 3 ): 148 – 54 . ) Among international centers that use Evidence-Based Practice, JBI promotes and supports the synthesis, transfer and use of evidence by identifying viable, appropriate, meaningful and effective health practices to assist in improving health results globally. ( 2020. Camargo FC , Iwamoto HH , Monteiro DA , Lorena LT , Pereira GA . Assessment of an intervention for the diffusion of evidence-based nursing in a teaching hospital . Rev. Gaúcha Enferm . 2016 ; 37 ( Spe ): 1 - 9 . ) This study followed the method recommended by the best practices for adhering to the use of the Surgical Safety Checklist, supported by scientific evidence from the JBI, and striving for quality in the studies used according to its Degree of Recommendation and its Evidence Levels. It was accordingly structured in three phases.

Phase 1 – Baseline audit

The professionals were invited to participate in the research and signed an Informed Consent Form prior to beginning the observation phase. These professionals were surgeons, anesthetists, the nurse coordinator of the surgical center, the hospital nursing manager and nursing technicians (circulating and surgical instrumentalist). Thus, the audit team was established by these professionals and coordinated by a nursing student from the Nursing Course at the Higher Education Center at the State University of Santa Catarina. She was responsible for measuring compliance in the adherence to the use of the surgical checklist by the multidisciplinary team, according to the recommendations of the best practices made available by the JBI, along with the assistance of the professor. The basic audit was carried out by the researcher for 15 days after communicating with the surgical team about the objectives of the project to implement best practices. The data were collected through systematic and non-participant observation in a non-probabilistic sample, totaling 100 surgical procedures (general, orthopedic and cardiac). Emergency surgeries were excluded due to the researcher’s concern to not affect the team’s work dynamics in high-risk situations. A semi-structured questionnaire built by the researcher using the JBI Practical Application of Clinical Evidence System (PACES) program was used for auditable criteria in accordance with Evidence-Based Practice. The criteria used are presented in Table 1 .

Table 1
Auditing criteria.

The analysis of descriptive data was performed by means of percentage values of the audited criteria that were in compliance and non-compliance using Microsoft Excel ® 2013 and Microsoft Word ® 2013.

Phase 2 – Educational

This moment is characterized by reflection on the results of the basic audit, elaborating and implementing strategies to improve clinical practice. The results of the baseline audit were presented to the surgical center team (doctors, anesthetists, nurses and coordinating doctors of the surgical center, circulators and instrumentalists), discussing obstacles and the proposed strategies to improve compliance for each audited criterion. Stakeholders, including the surgical team and the nursing manager, were invited to participate in conversation circles or individual conversations or meetings in the surgical center’s staff break room to discuss the baseline audit data. The data were presented in graphs to the surgical team and to the nursing manager, and then improvement strategies were discussed to obtain an increase in the percentage of all audited criteria. The quality of the criteria by JBI must have a percentage above 75%. The JBI’s Getting Research into Practice (GRiP) tool was used to document the barriers found, the strategies implemented and the resources needed to overcome these barriers, aiming to improve compliance to the audited criteria. Members of the surgical team who were on sick leave or absent from work were excluded from the study. Inclusion criteria were all professionals who were not on any kind of leave during the data collection period.

Phase 3 – Follow-up audit

The post-implementation audit was carried out 1 month immediately after the basic audit for 15 consecutive days. This phase aimed to evaluate the results of the implemented interventions. Thus, 100 surgical procedures (general, orthopedic and cardiac) were observed with the same surgical team as the basic audit and in the same way, also using the same criteria and data collection instrument. The results of the compliance percentages for each criterion audited were compared before and after the implementation of best practices, thus enabling to verify the impact of this study on clinical practice. The data were computed using Microsoft Excel ® 2013 and Microsoft Word ® 2013.

The study met the requirements of the Research Ethics Committee Involving Human Beings according to the terms of the Resolution National Research Ethics Commission/National Health Council 466/2012, registered and approved under process CAAE 88803418.1.0000.0118.

Results

Phase 1 – Baseline audit

The results of the baseline audit identified that only Criteria 2 and 3 had high compliance with best practices (81% to 93%). Criteria 1 and 4 showed low compliance, ranging from 45% to 49% and falling below the expected value, which was 75% ( Figure 1 ).

Figure 1
Compliance with the best practices for the basic audit (%) according to criteria set out in Table 1: (1) the implementation of the Surgical Safety Checklist must involve a multidisciplinary health team; (2) the health team should be educated on various aspects of the checklist and how to use it; (3) the Surgical Safety Checklist is used to augment and not to replace other initiatives that contribute to the safety culture; (4) measures that are sensitive to the quality of the checklist practice have been used to identify areas for improvement in implementation.

Phase 2 – Educational

The JBI’s GRiP tool was used to document the barriers found, the strategies implemented and the resources needed to improve compliance to the audited criteria. The educational phase took place 7 days after the last day of the basic audit, in which the researcher met with the nursing manager, the coordinating nurse of the surgical center, the medical coordinator of the surgical center and the anesthesia coordinator in the morning and afternoon. The nursing team discussed the continued insertion of the Surgical Safety Checklist in the patient’s electronic medical record by hospital staff, as they were responsible for referring patients to the hospital’s surgical center reception. There was a dialogue with the medical coordinator of the surgical center about the incentive for an assertive and clear verbal communication between the surgeon and the patient and the surgical team in the three operative moments. Furthermore, there was continued stimulus of the approaches already taken by the anesthesiologists to the patients before the anesthetic induction, in which they asked about allergies, fasting time and the surgical procedure to be performed, in addition to evaluating the patient’s airway. Despite the non-conformities resulting from the baseline audit, professionals in surgery, anesthesia and nursing were shown to be proactive and emphatic in improving surgical safety. All team members were trained and recognized the importance of effective communication between the team and the completeness of the Surgical Safety Checklist record.

Phase 3 – Follow-up audit

The data from the follow-up audit proved to be satisfactory, as the compliance rates for all the audited criteria increased. Specifically, 100% compliance with the criteria related to the education and training of nursing professionals regarding the use of the Surgical Safety Checklist was observed ( Figure 2 ).

Figure 2
Results of the baseline and follow-up audit (%) according to criteria parameterized in Table 1: (1) the implementation of the Surgical Safety Checklist must involve a multidisciplinary health team; (2) the health team should be educated on various aspects of the checklist and how to use it; (3) the Surgical Safety Checklist is used to augment and not to replace other initiatives that contribute to the safety culture; (4) measures that are sensitive to the quality of the checklist practice have been used to identify areas for improvement in implementation.

Discussion

The audit of this study evaluated four criteria for compliance with current practices with the best evidence available in the literature. Our observations infer the difficulties related to adhering to safe surgery procedures by the multiprofessional team (Criterion 1), and possibly influence the incompleteness of the electronic record of the Surgical Safety Checklist (Criterion 4). Therefore, findings below the 75% compliance level are better discussed to elucidate this low compliance.

Criterion 1 (implementation of the Surgical Safety Checklist must involve the multidisciplinary health team) revealed low compliance (65%) in the follow-up audit regarding adherence to using the list. There was no identification of safe surgery in the three operative times in 35% of the observations made, which is justified by the fact that these surgeons entered the operating rooms after anesthetic induction and did not communicate with the team during the operation. Considering communication as a fundamental aspect during any surgery, it is considered that there was eventually not enough time between the time of the educational phase and the follow-up audit (15 days) to structure the feedbacks with the surgeons in order to achieve the desired compliance.

A study carried out in India in which the Surgical Safety Checklist was audited in 600 observations (200 at sign in , 200 at sign out, and 200 at time out ) evidenced active involvement of the three members of the surgical team (surgeons, anesthetists and nurses), especially at the surgery time out (78%) on the list. ( 1616. Ambulkar R , Ranganathan P , Salunke K , Savarkar S . The World Health Organization Surgical Safety Checklist: an audit of quality of implementation at a tertiary care high volume cancer institution . J Anaesthesiol Clin Pharmacol . 2018 ; 34 ( 3 ): 392 – 8 . ) The audit of this study took place 5 years after implementing the list, as there was a need to structure both the team and the hospital. The findings also showed that surgeons used the checklist proactively in the three surgical moments (98.5% at sign in ; 59% at time out ; and 88.9% at sign out ). The items on the list’s time out in this study were about the verbal confirmation of the patient and demarcation of laterality, antimicrobial prophylaxis, imaging exams and filling out the pathology form. ( 1616. Ambulkar R , Ranganathan P , Salunke K , Savarkar S . The World Health Organization Surgical Safety Checklist: an audit of quality of implementation at a tertiary care high volume cancer institution . J Anaesthesiol Clin Pharmacol . 2018 ; 34 ( 3 ): 392 – 8 . ) For further argument about adherence to Verification of Surgical Safety by the surgical team, one study evaluated 875 health professionals (nurses, surgeons and anesthetists) via an online form on the frequency and satisfaction in using the list after its implementation in a university hospital, verifying that 99.4% of the evaluated professionals used the list. Still, 88.3% specified that they use it between 91% and 100% in all surgeries performed. ( 1515. Sendlhofer G , Lumenta DB , Leitgeb K , Kober B , Jantscher L , Schanbacher M , et al . The gap between individual perception and compliance: a qualitative follow-up study of the surgical safety checklist application . PLoS One . 2016 ; 11 ( 2 ): e0149212 . )

In an analysis of which professionals most frequently used the Surgical Safety Checklist, there were no significant differences between surgeons and anesthetists (p = 0.212), or among anesthesiologists and nurses (p = 0.451). ( 1515. Sendlhofer G , Lumenta DB , Leitgeb K , Kober B , Jantscher L , Schanbacher M , et al . The gap between individual perception and compliance: a qualitative follow-up study of the surgical safety checklist application . PLoS One . 2016 ; 11 ( 2 ): e0149212 . ) Thus, these studies reinforce the importance of multiprofessional involvement, with the physician being a fundamental actor in changing the safety culture in the operating room, as unsafe decisions can be made without their active day-to-day participation, not in the least because the medical partnership is an essentially interdisciplinary phenomenon in surgical care. ( 2222. Styer KA , Ashley SW , Schmidt I , Zive EM , Eappen S . Implementing the World Health Organization surgical safety checklist: a model for future perioperative initiatives . AORN J . 2011 ; 94 ( 6 ): 590 – 8 . ) The active involvement of the surgical team in the implementation phase and in evaluating the Checklist of Surgical Safety is important, with continuous training being proposed in order to obtain presuppositions regarding adherence to the use of the list and data compliance. ( 2323. Levy SM , Senter CE , Hawkins RB , Zhao JY , Doody K , Kao LS , et al . Implementing a surgical checklist: more than checking a box . Surgery . 2012 ; 152 ( 3 ): 331 – 6 . , 2424. Mascherek AC , Schwappach DL , Bezzola P . Frequency of use and knowledge of the WHO-surgical checklist in Swiss hospitals: a cross-sectional online survey . Patient Saf Surg . 2013 ; 7 ( 1 ): 36 . ) In addition, the continuous training of the team in using the list can break multiple barriers regarding misuse, non-use or incomplete execution of the list, and furthermore collective work seems to be a salutary point in the effectiveness of communication.

In this perspective, the findings of Criterion 2 of the performed audit revealed that all circulating people, especially newcomers at the institution, received training on the use of the list, and also affirmed that it is extremely important for the surgical progress because you cannot let the patient leave the operating room without checking all the sign out items, for example. Surgical teams should be trained by the leaders (hands-on leadership) to implement the Surgical Safety Checklist, and from time to time the surgical safety protocols should be reviewed to avoid possibly forgetting their use. ( 2525. Püchel VA , Lockwood C . Translating knowledge: Joanna Briggs Institute’s expertise . Rev Esc Enferm USP . 2018 ]; 52 : e03344 . ) It is necessary to implement a systematic work of observation and to improve the use of the Surgical Safety Checklist in order to evaluate its use, and so that if there is a need to change the content, this be done to strengthen the implementation team.

In view of the aspects involving the audit, it is worth mentioning that the processes which incorporate continuous feedback in real time are crucial for care to be efficient, effective and safe. ( 1010. Treadwell JR , Lucas S , Tsou AY . Surgical checklists: a systematic review of impacts and implementation . BMJ Qual Saf . 2014 ; 23 ( 4 ): 299 – 318 . , 1919. Tang R , Ranmuthugala G , Cunningham F . Surgical safety checklists: a review . ANZ J Surg . 2014 ; 84 ( 3 ): 148 – 54 . ) In operational terms, nurses are encouraged to invite instructors and circulators, anesthesiologists and surgeons to provide continuous feedback on the content and execution of the Surgical Safety Checklist, in addition to individual perceptions about the daily use of the list. When face-to-face meetings are not feasible, feedback can be conducted via e-mail. ( 2626. Conley DM , Singer SJ , Edmondson L , Berry WR , Gawande AA . Effective surgical safety checklist implementation . J Am Coll Surg . 2011 ; 212 ( 5 ): 873 – 9 . ) Thus, it is worth noting that the Surgical Safety Checklist is a useful reminder when members of the perioperative team adhere to safety protocols, however it does not solve all safety problems; among them, assertive and clear communication between the team in intraoperative procedures, the team’s adherence to safety protocols and the reduction of sentinel effects. ( 2727. Haugen AS , Murugesh S , Haaverstad R , Eide GE , Søfteland E . A survey of surgical team members’ perceptions of near misses and attitudes towards Time Out protocols . BMC Surg . 2013 ; 13 ( 1 ): 46 . , 2828. Ragusa PS , Bitterman A , Auerbach B , Healy WA 3rd . Effectiveness of surgical safety checklists in improving patient safety . Orthopedics . 2016 ; 39 ( 2 ): e307 – 10 . )

Regarding Criterion 4 (sensitive measures for quality of practice in the Surgical Safety Checklist have been used to identify areas for improvement in the implementation) of the performed audit, gaps in the complete filling of this list are evident, especially in the initial part, as it was observed that the inpatient sectors did not fill it in. There was a dialogue with the nursing manager about this issue in our educational process approach, pointing to the possible resolution of the daily conferences on the list in the electronic medical record before the patient entered the operating room reception. The rate of filling out the list after the follow-up audit was 54%, which is in accordance with the literature, and showed incompleteness of the records on the Surgical Safety Checklist of 76% at the sign out time among the 660 surgical observations performed. ( 1616. Ambulkar R , Ranganathan P , Salunke K , Savarkar S . The World Health Organization Surgical Safety Checklist: an audit of quality of implementation at a tertiary care high volume cancer institution . J Anaesthesiol Clin Pharmacol . 2018 ; 34 ( 3 ): 392 – 8 . ) The completion rates of records for the Surgical Safety Checklist in another study ranged between 53.2% and 60.6%, with inference of carrying out quality audits for possible changes in the items of the list, as well as a constant involvement of the surgical team, as it is realized that each criterion can favor adherence and therefore a safe environment for both patients and the surgical team. ( 2929. Mayer EK , Sevdalis N , Rout S , Caris J , Russ S , Mansell J , et al . Surgical checklist implementation project: the impact of variable WHO checklist compliance on risk-adjusted clinical outcomes after national implementation: a longitudinal study . Ann Surg . 2016 ; 263 ( 1 ): 58 – 63 . )

In this sense, it is common to have a certain misunderstanding about the proper use of the Surgical Safety Checklist and who would be responsible for asking and filling in its items, since health services generally have a significant number of checks, and the list can cause checking fatigue, reducing the reliability of the recorded data. ( 2323. Levy SM , Senter CE , Hawkins RB , Zhao JY , Doody K , Kao LS , et al . Implementing a surgical checklist: more than checking a box . Surgery . 2012 ; 152 ( 3 ): 331 – 6 . ) Also, there is the adoption of inadequate training or standardized videos or posters, which can be impeding factors in adhering to its use, because studies suggest that team training anchored by team-based learning improves perception, knowledge and compliance in adhering to the execution of the surgical list. ( 1515. Sendlhofer G , Lumenta DB , Leitgeb K , Kober B , Jantscher L , Schanbacher M , et al . The gap between individual perception and compliance: a qualitative follow-up study of the surgical safety checklist application . PLoS One . 2016 ; 11 ( 2 ): e0149212 . , 3030. Rakoff D , Akella K , Guruvegowda C , Chhajwani S , Seshadri S , Sola S . lmproved compliance and comprehension of a surgical safety checklist with customized versus standard training: a randomized trial . J Patient Saf . 2018 ; 14 ( 3 ): 138 – 42 . ) Although it was not proposed to discuss Criterion 3 due to the high compliance achieved by criteria of the JBI (93%), it is necessary to express that the list provides the team with the opportunity to review events and intraoperative results and discuss postoperative plans for the successful recovery of patients. ( 3131. Bartz-Kurycki MA , Anderson KT , Abraham JE , Masada KM , Wang J , Kawaguchi AL , et al . Debriefing: the forgotten phase of the surgical safety checklist . J Surg Res . 2017 ; 213 : 222 – 7 . ) It is necessary to have continuous training before, during and after implementing the Surgical Safety Checklist to obtain high compliance percentages with its use in order to provide quality documentation and efficiency of human and material resources.

Conclusion

The objectives of this study on evaluating adherence to the use of the Surgical Safety Checklist by the surgical team of a cardiac reference hospital were partially achieved based on the criteria audited by the Joanna Briggs Institute. In addition, the failure to achieve full compliance with some criteria was due to the fact that this was a one-off audit, meaning it was only conducted during the project’s execution period. There was no research evaluating adherence to the use of the Surgical Safety Checklist before its implementation process. The literature shows signs that adherence is possible over time, as long as there is more investment in training surgical teams to foster an evidence-based safety culture and thus redefine this scenario, along with higher compliance rates with auditable criteria. The proactive participation of all members of the surgical team, especially of the perioperative nurse, should be established in the safety culture, since our study did not obtain full involvement of the surgeon in the intraoperative period. Therefore, we aim to use a standardized and systematized approach to guide the team on the pertinent information of the patient, since adherence to the use of a checklist enhances improvement in patient safety as this individual moves to the next phase of treatment, ensuring that all team members are aware of intraoperative events. In this sense, it is possible to obtain a safer surgical process based on teamwork, internalization and expansion strategies, effective management of processes and the full engagement of people. Overall, the study was assessed as having moderate compliance, which provides key elements to sustain clinical change through evidence-based practice. Thus, it is necessary to carry out additional audits to maintain clinical practice based on the best scientific evidence for safe surgery.

Acknowledgements

The study was funded by the State University of Santa Catarina through the Graduate Education Support Program - PRAPEG (PROEN no.01/2017) in which the researcher took the Evidence-Based Clinical Fellowship Program (EBCFP) promoted by the University of São Paulo School of Nursing (EEUSP). We would also like to thank the Santa Catarina Research and Innovation Support Foundation ( FAPESC ), under the grant term no. 2019TR706 - FAPESC 895/2019, which provided funding for disseminating the research.

Referências

  • 1
    World Health Organization (WHO) . WHO guidelines for safe surgery 2009: safe surgery saves lives [ Internet ]. Geneva : WHO ; 2009 . [ cited 2020 Jul 29 ]. Available from: https://www.who.int/patientsafety/safesurgery/tools_resources/9789241598552/en/
    » https://www.who.int/patientsafety/safesurgery/tools_resources/9789241598552/en/
  • 2
    Martins GF , Silva AX , Silva Júnior AO , Gomes JA , Gomes TJ . [ Patient safety and systematization of nursing care in the postoperative period of cardiac transplantation: a systematic review ]. Braz J Health Rev . 2019 ; 2 ( 2 ): 727 – 41 . Portuguese .
  • 3
    Carvalho PA , Göttems LB , Pires MR , de Oliveira ML . Safety culture in the operating room of a public hospital in the perception of healthcare professionals . Rev Lat Am Enfermagem . 2015 ; 23 ( 6 ): 1041 – 8 .
  • 4
    Panesar SS , Noble DJ , Mirza SB , Patel B , Mann B , Emerton M , et al . Can the surgical checklist reduce the risk of wrong site surgery in orthopaedics?—can the checklist help? Supporting evidence from analysis of a national patient incident reporting system . J Orthop Surg Res . 2011 ; 6 ( 1 ): 18 .
  • 5
    Grigoleto A , Gimenes F , Avelar M . Segurança do cliente e as ações frente ao procedimento cirúrgico . Rev Eletr Enf . 2011 ; 13 ( 2 ): 347 – 54 .
  • 6
    Maziero EC , de Camargo Silva AE , de Fátima Mantovani M , de Almeida Cruz ED . [ Adherence to the use of the surgical checklist for patient safety ]. Rev Gaúcha Enferm . 2015 ; 36 ( 4 ): 14 – 20 . Portuguese .
  • 7
    Tostes MF , Galvão CM . Implementation process of the Surgical Safety Checklist: integrative review . Rev Lat Am Enfermagem . 2019 ; 27 ( 3104 ): e3104 .
  • 8
    Motta Filho GD , Neves da Silva LF , Ferracini AM , Bähr GL . The WHO Surgical Safety Checklist: knowledge and use by Brazilian orthopedists . Rev Bras Ortop . 2013 ; 48 ( 6 ): 554 – 62 .
  • 9
    Biccard BM , Rodseth R , Cronje L , Agaba P , Chikumba E , Du Toit L , et al . A meta-analysis of the efficacy of preoperative surgical safety checklists to improve perioperative outcomes . S Afr Med J . 2016 ; 106 ( 6 ): 592 – 7 .
  • 10
    Treadwell JR , Lucas S , Tsou AY . Surgical checklists: a systematic review of impacts and implementation . BMJ Qual Saf . 2014 ; 23 ( 4 ): 299 – 318 .
  • 11
    Sewell M , Adebibe M , Jayakumar P , Jowett C , Kong K , Vemulapalli K , et al . Use of the WHO surgical safety checklist in trauma and orthopaedic patients . Int Orthop . 2011 ; 35 ( 6 ): 897 – 901 .
  • 12
    Kearns RJ , Uppal V , Bonner J , Robertson J , Daniel M , McGrady EM . The introduction of a surgical safety checklist in a tertiary referral obstetric centre . BMJ Qual Saf . 2011 ; 20 ( 9 ): 818 – 22 .
  • 13
    Taylor B , Slater A , Reznick R . The surgical safety checklist effects are sustained, and team culture is strengthened . Surgeon . 2010 ; 8 ( 1 ): 1 – 4 .
  • 14
    Tostes MF , Haracemiw A , Mai LD . Surgical Safety Checklist: considerations on institutional policies . Esc Anna Nery . 2016 ; 20 ( 1 ): 203 – 9 .
  • 15
    Sendlhofer G , Lumenta DB , Leitgeb K , Kober B , Jantscher L , Schanbacher M , et al . The gap between individual perception and compliance: a qualitative follow-up study of the surgical safety checklist application . PLoS One . 2016 ; 11 ( 2 ): e0149212 .
  • 16
    Ambulkar R , Ranganathan P , Salunke K , Savarkar S . The World Health Organization Surgical Safety Checklist: an audit of quality of implementation at a tertiary care high volume cancer institution . J Anaesthesiol Clin Pharmacol . 2018 ; 34 ( 3 ): 392 – 8 .
  • 17
    Weiser TG , Haynes AB . Ten years of the Surgical Safety Checklist . Br J Surg . 2018 ; 105 ( 8 ): 927 – 9 .
  • 18
    Bergs J , Hellings J , Cleemput I , Vandijck D ; Flemish Safe Surgery Consortium . The World Health Organisation’s surgical safety checklist in Belgian operating theatres: a content-driven evaluation . Acta Chir Belg . 2015 ; 115 ( 2 ): 147 – 54 .
  • 19
    Tang R , Ranmuthugala G , Cunningham F . Surgical safety checklists: a review . ANZ J Surg . 2014 ; 84 ( 3 ): 148 – 54 .
  • 20
    Camargo FC , Iwamoto HH , Monteiro DA , Lorena LT , Pereira GA . Assessment of an intervention for the diffusion of evidence-based nursing in a teaching hospital . Rev. Gaúcha Enferm . 2016 ; 37 ( Spe ): 1 - 9 .
  • 21
    Dias M . JBI Evidence Summary. Evidence-informed practice at the point of care. Surgical safety checklists . The Joanna Briggs Institute EBP Database ; 2018 .
  • 22
    Styer KA , Ashley SW , Schmidt I , Zive EM , Eappen S . Implementing the World Health Organization surgical safety checklist: a model for future perioperative initiatives . AORN J . 2011 ; 94 ( 6 ): 590 – 8 .
  • 23
    Levy SM , Senter CE , Hawkins RB , Zhao JY , Doody K , Kao LS , et al . Implementing a surgical checklist: more than checking a box . Surgery . 2012 ; 152 ( 3 ): 331 – 6 .
  • 24
    Mascherek AC , Schwappach DL , Bezzola P . Frequency of use and knowledge of the WHO-surgical checklist in Swiss hospitals: a cross-sectional online survey . Patient Saf Surg . 2013 ; 7 ( 1 ): 36 .
  • 25
    Püchel VA , Lockwood C . Translating knowledge: Joanna Briggs Institute’s expertise . Rev Esc Enferm USP . 2018 ]; 52 : e03344 .
  • 26
    Conley DM , Singer SJ , Edmondson L , Berry WR , Gawande AA . Effective surgical safety checklist implementation . J Am Coll Surg . 2011 ; 212 ( 5 ): 873 – 9 .
  • 27
    Haugen AS , Murugesh S , Haaverstad R , Eide GE , Søfteland E . A survey of surgical team members’ perceptions of near misses and attitudes towards Time Out protocols . BMC Surg . 2013 ; 13 ( 1 ): 46 .
  • 28
    Ragusa PS , Bitterman A , Auerbach B , Healy WA 3rd . Effectiveness of surgical safety checklists in improving patient safety . Orthopedics . 2016 ; 39 ( 2 ): e307 – 10 .
  • 29
    Mayer EK , Sevdalis N , Rout S , Caris J , Russ S , Mansell J , et al . Surgical checklist implementation project: the impact of variable WHO checklist compliance on risk-adjusted clinical outcomes after national implementation: a longitudinal study . Ann Surg . 2016 ; 263 ( 1 ): 58 – 63 .
  • 30
    Rakoff D , Akella K , Guruvegowda C , Chhajwani S , Seshadri S , Sola S . lmproved compliance and comprehension of a surgical safety checklist with customized versus standard training: a randomized trial . J Patient Saf . 2018 ; 14 ( 3 ): 138 – 42 .
  • 31
    Bartz-Kurycki MA , Anderson KT , Abraham JE , Masada KM , Wang J , Kawaguchi AL , et al . Debriefing: the forgotten phase of the surgical safety checklist . J Surg Res . 2017 ; 213 : 222 – 7 .

Publication Dates

  • Publication in this collection
    26 Nov 2021
  • Date of issue
    2021

History

  • Received
    18 Mar 2020
  • Accepted
    15 Sept 2020
Escola Paulista de Enfermagem, Universidade Federal de São Paulo R. Napoleão de Barros, 754, 04024-002 São Paulo - SP/Brasil, Tel./Fax: (55 11) 5576 4430 - São Paulo - SP - Brazil
E-mail: actapaulista@unifesp.br