Prompt antibiotics have been shown to improve outcomes in pediatric sepsis, which continues to be a leading cause of death in children. We describe the quality improvement (QI) efforts of a single academic children’s hospital to improve antibiotic timeliness.
Using the electronic health record, we report time from order to the administration of stat intravenous (IV) antibiotics from 2012 to 2020 using statistical process control charts. We describe QI interventions initiated over the study period. These include the formation of a Pediatric Sepsis Committee, routine use of automated dispensing machines for stat IV antibiotics, creation of sepsis order sets, manual and automated sepsis screening implementation, participation in national sepsis QI collaboratives, creation of difficult intravenous access guidelines, and an automated notification system for charge nurses. As a balancing measure, we assessed stat IV antibiotic use normalized to total emergency department visits and inpatient days.
Multiple quality improvement interventions were initiated and sustained under the direction of the hospital Pediatric Sepsis Committee. We improved our stat IV antibiotics given within 1 hour of order from 33% in 2012 to 77% in 2019 and maintained this through the end of the study period in July 2020.
By using a multipronged quality improvement approach, we demonstrated consistent and sustained improvement in the timely administration of stat IV antibiotics over an 8-year period at our institution. Further study is needed to assess whether this is associated with reduced length of stay or improved survival in children with sepsis.
Prompt antibiotic administration improves outcomes in children with sepsis, a leading cause of death in this population worldwide.1,2 The Surviving Sepsis Campaign released pediatric guidelines in 2020 that reaffirm the recommendation for early antibiotic administration in severe sepsis, ideally within 1 hour.3 Past studies and quality improvement (QI) work have focused on improving time to antibiotics and early recognition of sepsis with interventions such as guideline implementation, making antibiotics more available on units in automated dispensing machines (ADMs), sepsis identification, and automated sepsis alerts.4–8 At our institution, delayed antibiotic administration was identified as an area for improvement after initial data revealed that <50% of stat intravenous (IV) antibiotics were administered in <1 hour. Stat antibiotics are commonly ordered in our setting because of concern for serious infection and risk of sepsis.
Our primary aim with this QI effort was to optimize the care of children with concern for serious infection and at risk for sepsis by shortening the time to stat IV antibiotic administration. Our specific initial goal was to administer 70% of all stat IV antibiotics within 1 hour of the order.
Methods
Context
Our institution is a tertiary children’s hospital within a large academic medical center. Care settings include a level I PICU, a level IV NICU, a pediatric emergency department (PED) associated with the level I pediatric trauma center, an acute care pediatrics (ACP) unit, and a newborn nursery. The hospital contains 189 inpatient beds with ∼350 NICU admissions, 2500 ACP admissions, 1000 PICU admissions, and 20 000 PED visits per year. Stat IV antibiotics are ordered in the electronic health record (EHR) by attending physicians, residents, fellows, and advanced practice providers. Clinicians determine if a stat IV antibiotic is warranted on the basis of a clinical presentation with concern for serious infection or sepsis.9
Interventions
Our QI team made multiple institutional changes and interventions over an 8-year period. Interventions addressed key drivers impacting time to antibiotics (Fig 1). Broad categories of interventions included the shared mental model, pharmacy, EHR utilization, and increasing bedside resources. These interventions were chosen on the basis of previously published QI work, membership in national sepsis collaboratives, and identification of barriers in our specific context.4–8 Table 1 includes additional institutional-level changes, as well as unit-specific timing of interventions during the study period.
Chronological List of Notable Institutional Changes and QI Interventions on Individual Pediatric Units Between January 2012 and July 2020
Intervention . | Unit . | Date . |
---|---|---|
QI group formed to address barriers to sepsis recognition and treatment | NICU | December 2012 |
Hospital-wide required online sepsis education module: This module was mandatory for all hospital providers and nurses working on pediatric units and included information on recognizing early signs of sepsis. | All Units | January 2013 |
QI effort for timely antibiotic delivery in pediatric oncology patients: Pediatric Oncology department launched a QI project for stat IV antibiotics delivery in <1 h in patients with concern for sepsis in the PED setting. | PED | August 2013 |
Chartered Pediatric Sepsis Committee: A multidisciplinary team made up of registered nurses, physicians,pharmacists, microbiologists, informaticists, and performance improvement specialists was formed. This group represents all pediatric units and assists with the communication of institution-wide goals, sharing progress, and challenges. | All Units | November 2013 |
Antibiotics available in ADMs: ampicillin, cefazolin, cefepime, ceftriaxone, clindamycin, gentamicin, meropenem, piperacillin-tazobactam, vancomycin. The PED had antibiotics present in ADMs starting at an earlier date. | PICU NICU ACP | January 2015 |
AAP Sepsis Shock Collaborative joined | PED | January 2015 |
Sepsis EHR order set: Included unit specific bundled orders for management of pediatric sepsis, including orders for fluid resuscitation, stat IV antibiotics, and laboratories. | NICU | May 2015 |
PICU | July 2015 | |
PED | June 2016 | |
ACP | April 2017 | |
Bar Code Scanning Medication Administration: Medications scanned before delivery to patients resulting in more accurate charting. | PED | June 2015 |
Pediatric Sepsis Committee started tracking time to stat IV antibiotics: Monthly data disseminated to specific units on the percentage of stat IV antibiotics delivered <1 h from time of order with a hospital-wide goal of 70%. | All Units | January 2016 |
Manual sepsis screen in PED triage | PED | January 2016 |
Improving Pediatric Sepsis Outcomes Collaborative: Joined the Children’s Hospital Association IPSO collaborative. This collaborative shares sepsis data across hospital systems. | All Units | January 2017 |
Manual sepsis screen and huddle: Paper forms were used to screen patients for sepsis with a reflex huddle for providers and bedside nursing if positive. | ACP | April 2017 |
PICU | June 2017 | |
Sepsis QI Group: QI group formed to specifically address sepsis. | NICU | September 2017 |
Safety Huddles: Unit charge nurse and provider team started meeting twice daily before morning and evening rounds. | NICU | January 2018 |
Automated charge nurse page for all stat IV antibiotic orders: Charge nurse receives automated page when a provider places an order for stat IV antibiotics to bring additional resources to assist bedside nurse. | ACP | April 2017 |
NICU PICU | August 2018 | |
Feedback emails to nursing staff: Bedside RNs received feedback for all stat IV antibiotic orders either inquiring about cause of delays for antibiotics administered in ≥1 h or praising efforts when delivered in <1 h. | ACP | August 2018 |
PED DIVA guideline published: Provided algorithm for escalation for nursing staff and providers for patients with difficult access in the ED setting. | PED | August 2018 |
Inpatient DIVA guideline published: Provided algorithm for escalation for nursing staff and providers for patients with difficult access. | ACP | October 2018 |
Feedback emails to providers: Ordering provider received feedback for all stat IV antibiotic orders either inquiring about cause of delays for antibiotics administered in >1 h or praising efforts when delivered in <1 h. | ACP | February 2019 |
EHR automatic sepsis alert roll-out: Pop up alert notified bedside nurse and prompted response when vital sign and laboratory criteria indicating possible sepsis were met. | ACP | February 2019 |
PED | September 2019 | |
PICU | November 2019 | |
Coronavirus disease 2019 response: Included a hold on elective surgeries and hospital admissions. | All Units | March 2020 |
PICU attending required at bedside for repeat sepsis rapid responses: PICU attending required at the bedside when the rapid response team is called to the bedside for a second rapid response alert within 24 h. | ACP | June 2020 |
Intervention . | Unit . | Date . |
---|---|---|
QI group formed to address barriers to sepsis recognition and treatment | NICU | December 2012 |
Hospital-wide required online sepsis education module: This module was mandatory for all hospital providers and nurses working on pediatric units and included information on recognizing early signs of sepsis. | All Units | January 2013 |
QI effort for timely antibiotic delivery in pediatric oncology patients: Pediatric Oncology department launched a QI project for stat IV antibiotics delivery in <1 h in patients with concern for sepsis in the PED setting. | PED | August 2013 |
Chartered Pediatric Sepsis Committee: A multidisciplinary team made up of registered nurses, physicians,pharmacists, microbiologists, informaticists, and performance improvement specialists was formed. This group represents all pediatric units and assists with the communication of institution-wide goals, sharing progress, and challenges. | All Units | November 2013 |
Antibiotics available in ADMs: ampicillin, cefazolin, cefepime, ceftriaxone, clindamycin, gentamicin, meropenem, piperacillin-tazobactam, vancomycin. The PED had antibiotics present in ADMs starting at an earlier date. | PICU NICU ACP | January 2015 |
AAP Sepsis Shock Collaborative joined | PED | January 2015 |
Sepsis EHR order set: Included unit specific bundled orders for management of pediatric sepsis, including orders for fluid resuscitation, stat IV antibiotics, and laboratories. | NICU | May 2015 |
PICU | July 2015 | |
PED | June 2016 | |
ACP | April 2017 | |
Bar Code Scanning Medication Administration: Medications scanned before delivery to patients resulting in more accurate charting. | PED | June 2015 |
Pediatric Sepsis Committee started tracking time to stat IV antibiotics: Monthly data disseminated to specific units on the percentage of stat IV antibiotics delivered <1 h from time of order with a hospital-wide goal of 70%. | All Units | January 2016 |
Manual sepsis screen in PED triage | PED | January 2016 |
Improving Pediatric Sepsis Outcomes Collaborative: Joined the Children’s Hospital Association IPSO collaborative. This collaborative shares sepsis data across hospital systems. | All Units | January 2017 |
Manual sepsis screen and huddle: Paper forms were used to screen patients for sepsis with a reflex huddle for providers and bedside nursing if positive. | ACP | April 2017 |
PICU | June 2017 | |
Sepsis QI Group: QI group formed to specifically address sepsis. | NICU | September 2017 |
Safety Huddles: Unit charge nurse and provider team started meeting twice daily before morning and evening rounds. | NICU | January 2018 |
Automated charge nurse page for all stat IV antibiotic orders: Charge nurse receives automated page when a provider places an order for stat IV antibiotics to bring additional resources to assist bedside nurse. | ACP | April 2017 |
NICU PICU | August 2018 | |
Feedback emails to nursing staff: Bedside RNs received feedback for all stat IV antibiotic orders either inquiring about cause of delays for antibiotics administered in ≥1 h or praising efforts when delivered in <1 h. | ACP | August 2018 |
PED DIVA guideline published: Provided algorithm for escalation for nursing staff and providers for patients with difficult access in the ED setting. | PED | August 2018 |
Inpatient DIVA guideline published: Provided algorithm for escalation for nursing staff and providers for patients with difficult access. | ACP | October 2018 |
Feedback emails to providers: Ordering provider received feedback for all stat IV antibiotic orders either inquiring about cause of delays for antibiotics administered in >1 h or praising efforts when delivered in <1 h. | ACP | February 2019 |
EHR automatic sepsis alert roll-out: Pop up alert notified bedside nurse and prompted response when vital sign and laboratory criteria indicating possible sepsis were met. | ACP | February 2019 |
PED | September 2019 | |
PICU | November 2019 | |
Coronavirus disease 2019 response: Included a hold on elective surgeries and hospital admissions. | All Units | March 2020 |
PICU attending required at bedside for repeat sepsis rapid responses: PICU attending required at the bedside when the rapid response team is called to the bedside for a second rapid response alert within 24 h. | ACP | June 2020 |
Shared Mental Model
Although some sepsis QI work started on individual units earlier, the formation of the Pediatric Sepsis Committee (PSC) in 2013 was the first institution-wide initiative to improve the treatment of patients with sepsis. The PSC is a multidisciplinary team with representation from inpatient and ambulatory care units. With regular monthly meetings, they planned and executed hospital-wide and unit-based interventions. In January 2016, the PSC started sharing unit-specific time-to-stat IV antibiotic data with individual units with a shared aim of increasing the percentage of stat IV antibiotics administered in <1 hour to >70%. Unit representatives analyzed and presented monthly data at PSC meetings. Unit-level run charts were frequently posted on units to help motivate improvement at the grassroots level.
The implementation of the American Academy of Pediatrics (AAP) Pediatric Septic Shock Collaborative (PSSC) sepsis screening tool targeted the prompt identification of patients with a serious infection but also promoted a shared mental model with triggered huddles between clinicians and nurses. In January 2016, a paper version of the screening tool was initiated in the PED and subsequently rolled out in the ACP unit and PICU. Between February and November 2019, the manual screening process transitioned to an automatic sepsis notification within the EHR.7
Pharmacy Interventions
Pharmacy delivery of IV antibiotics was a common reason for the delay of antibiotic administration. The PED had used ADMs for some time, and this was felt to be a significant driver of prompt antibiotic administration. Therefore, in January 2015, IV antibiotics, including ampicillin, cefazolin, cefepime, ceftriaxone, clindamycin, gentamicin, meropenem, piperacillin-tazobactam, and vancomycin were added to the ADMs in the PICU, NICU, and ACP.
Electronic Health Record Utilization
In September 2015, sepsis order sets were implemented to improve timely, goal-directed care. Order sets were created with input from the PSC and included unit-specific broad-spectrum antibiotics, fluids, laboratory, and monitoring orders. Automated sepsis alerts were rolled out in February 2019. In the months that followed implementation, screening criteria were refined to reduce false positive and negative alerts.
Increasing Bedside Resources
In April 2017, to increase resources for bedside nursing and increase unit awareness, an automated page was sent to the unit charge nurse when stat antibiotics were ordered. This provided additional support to the bedside nurse, both for the ill patient with new orders and to help shift resources to care for that nurse’s other patients so that they could focus on tasks such as difficult IV access and pulling urgent antibiotics from the ADM.
The Difficult Intravenous Access (DIVA) initiative formalized an escalation pathway for patients with difficult vascular access. This process limited access attempts and promoted early escalation to unit access experts and anesthesia team members who employed additional strategies for access, including ultrasound guidance. The first DIVA guideline created for the ED was published in August 2018, and an inpatient DIVA guideline followed in October 2018.
Measures and Analysis
Our primary outcome measure was the percentage of stat IV antibiotics delivered <1 hour from the time of order. Time to antibiotics was defined as the time from placement of a stat IV antibiotic order to charted medication administration. Time to antibiotics has previously been used as a process marker in QI work.10 There are limited single-center pediatric data and several adult studies that reveal an association between mortality and delayed antibiotics in sepsis.1,2,11–13 As a balancing measure, we assessed PED and inpatient antibiotic usage to monitor for unintended overutilization of stat antibiotics and prolonged inpatient length of stay. We obtained data from the her and included stat IV antibiotics orders from 2012 to 2020 for all patients <18 years of age admitted to dedicated pediatric units. We included sepsis-specific antibiotics and specifically excluded cefazolin because of its common use in the perioperative setting. The sepsis-specific antibiotics included were Ampicillin, Cefepime, Ceftriaxone, Clindamycin, Gentamicin, Meropenem, Piperacillin-Tazobactam, and Vancomycin. If an individual patient had multiple stat antibiotics ordered at a single time, only the first administered antibiotic in a 3-hour period was included. We analyzed the impact of interventions on the time to stat IV antibiotics with statistical process control (SPC) charts (Microsoft Excel 2016, Redmond, WA). We defined special cause variation using the rules suggested for the interpretation of Shewhart charts in health care.14
Ethical Considerations
The institutional review board at our institution determined that this project does not meet the criteria for human subject research.
Results
We used 20 months of historical data from January 2012 to August 2013 to establish a baseline. Our baseline frequency of stat IV antibiotics <1 hour was 33% in the 20 months before implementation. After the implementation of QI interventions between August 2013 and July 2020, the frequency increased to 77% (Fig 2 and Supplemental Table 2). A total of 5 centerline shifts occurred during the study period. Special cause variation first occurred in March 2014, 5 months after the chartering of the PSC, with improvement from 33% to 40% of antibiotics administered in <1 hour. The centerline again shifted to 47% in April 2015 after the introduction of antibiotics in ADMs on units and the joining of the AAP PSSC in January 2015. In January 2016, the PSC first began disseminating monthly time to antibiotic administration data, and manual sepsis screening was initiated. These interventions were followed by a centerline shift in May 2016 with an increase to 56% of stat antibiotics administered in <1 hour. Special cause variation was noted in April 2017 with the implementation of automated pages to charge nurses for all stat antibiotic orders with a centerline shift to 67%. The final shift to 77% was in September 2018 after PED DIVA guidelines were published and implemented. From September 2018 to the end of the study period in July 2020, the centerline remained stable with 77% of stat antibiotics administered in <1 hour. SPC charts for individual units all reveal improvement over the study period (Supplemental Fig 3).
All pediatric units: annotated control chart (p-chart) revealing the percentage of antibiotics delivered <60 minutes from time of order between January 2012 and July 2020. LCL, lower control limit; UCL, upper control limit.
All pediatric units: annotated control chart (p-chart) revealing the percentage of antibiotics delivered <60 minutes from time of order between January 2012 and July 2020. LCL, lower control limit; UCL, upper control limit.
Balancing Measures
Inpatient and PED antibiotic utilization and inpatient length of stay were tracked as balancing measures (Supplemental Table 3). The average length of stay ranged from 4.11 to 4.64 days. Inpatient antibiotic utilization ranged from 5.56 to 7.63 orders per 100 inpatient days, with the highest number of orders per 100 inpatient days in 2012 and 2013 and the lowest in 2017. PED antibiotic orders per 1000 PED discharges ranged from 11.79 to 15.56, with the most orders in 2017 and the fewest in 2012. Overall, the average length of stay and antibiotic utilization in PED and inpatient units did not increase over the study period.
Discussion
Summary and Interpretation
We describe a successful longitudinal QI effort in which interventions over an 8-year period were associated with decreased time to antibiotic administration across all pediatric units at a single institution. The goal of prompt antibiotic administration is supported by the most recent Surviving Sepsis guidelines.3 We improved our antibiotic delivery in <1 hour from 33% to 77% across all units over the 8-year study period.
The formation of the PSC in November 2013 was likely a significant driver in the improvement of timely antibiotic administration as part of work to elevate the care of children with sepsis. The interventions discussed were planned and conducted by this committee. The success of the interventions was made possible by the collaboration of pharmacists, nurses, physicians, microbiologists, clinical informaticists, and performance improvement specialists from across the hospital. The impact of this group is suggested not only by the overall improvement over time but also by the first centerline shift after the group’s formation in 2013 from 34% to 40% of antibiotics delivered in <1 hour.
In addition to the formation of the PSC, other interventions may have helped build a shared mental model among interprofessional team members. The implementation of manual sepsis screens in January 2016 brought bedside nurses and providers together to discuss patient care. In January 2016, the PSC also started sharing unit-specific time-to-stat antibiotic data. These 2 interventions were associated with a centerline shift in the months that followed to 56% of antibiotics administered in <1 hour. Although participation in national sepsis collaboratives such as the AAP PSSC and Children’s Hospital Association Improving Pediatric Sepsis Outcomes (IPSO) Collaborative in 2015 and 2017, respectively, were followed by centerline shifts, these shifts were likely due to other more direct interventions. AAP PSSC and IPSO collaboratives were powerful motivators for the adoption of innovative ideas and a continued drive toward improvement and likely had a more longitudinal impact.
Although pharmacists play a key role in order review and medication distribution, in serious infections, a delay in antibiotic administration may lead to harm. ADMs are a safe way to decrease the time from order to antibiotic administration in emergent situations.4 The inclusion of commonly ordered broad-spectrum antibiotics in ADMs in January 2015 was associated with a shift from 40% to 47% in March 2015.
EHRs are established tools for QI efforts. The use of EHR order sets and automated alerts may have improved adherence to guidelines and facilitated bundled care. Although order sets did not directly impact time from order to administration, the use of an order set may have led to increased bedside resources and team awareness of concern for serious infection. After recommendations from the Surviving Sepsis Campaign, the EHR was also used for the implementation of automated sepsis alerts. Data included in this project may not reflect the impact of the introduction of automated sepsis alerts on time from order to administration. However, recently published work supports the efficacy of this intervention and reveals automatic electronic sepsis alerts are useful in the early identification and prompt treatment of pediatric patients with sepsis.10,15
Bedside resources were identified as a barrier to timely antibiotics in our setting. We implemented difficult vascular access guidelines and automated charge nurse pages to address this gap. To our knowledge, automated paging of charge nurses for stat IV antibiotics orders is a novel intervention. The purpose of the automated page was to increase situational awareness and bring additional resources to the bedside in the form of additional nurses and support staff. Past QI work suggests that strategies to increase bedside nursing support are effective at reducing the time from recognition to first antibiotics.16 Special cause variation was noted in the first month of the implementation of this intervention.
Balancing measures of inpatient and PED antibiotic utilization and inpatient length of stay were chosen to assess for potential misidentification of sepsis. We hypothesize that increased sepsis awareness could potentially result in overutilization of antibiotics and longer hospital admissions. Within the study period of January 2012 to July 2020, there was no trend of increased utilization in any of the balancing measures selected.
The significance of this project is the sustained improvement over the course of the 8-year study period. Our most recent data reflects that 77% of stat IV antibiotics were administered in <1 hour. This achievement has been maintained over 22 months and reveals consistent and sustainable improvement. Although it is challenging to identify the single most effective intervention because of the number of institutional changes and interventions, we believe that the formation of a multidisciplinary PSC played an important role in both the overall success of the QI effort and the sustainable change.
Limitations
Our initiative is limited by our use of time from provider order of stat IV antibiotics as a proxy for time of sepsis recognition. Time from antibiotic order to administration does not necessarily reflect the time from sepsis onset or even detection of sepsis to the administration of antibiotics. In addition, many stat IV antibiotics orders are placed for the treatment of serious infections, which may not meet the criteria for sepsis. There have been efforts to decrease utilization of the stat order for nonemergent situations by direct e-mail feedback to providers on the overuse of “stat”-level priority on routine antibiotics. Notably, our balancing measures did not reveal an increase in antibiotic utilization with these QI efforts (Supplemental Fig 3). Although previous literature has revealed that delayed treatment leads to poor outcomes and care in concordance with national guidelines improves outcomes, our study does not include data on patient outcomes.1,17 The lack of additional process measures and outcome measures at the time of implementation makes it difficult to determine which interventions were most impactful. In addition, this QI effort spans a long timeframe. The interventions and institutional changes that are discussed here may not be all- inclusive, and there may be unidentified factors that contributed to improvements in timely antibiotic administration. The number of institutional changes and interventions and the overlapping nature of these events limit our ability to attribute improvement to specific interventions. Finally, these interventions were made at a single institution. These interventions in other contexts may not have the same results.
Conclusions and Future Directions
This project reveals how a series of focused QI initiatives were associated with sustained improvement in time from order to the administration of stat IV antibiotics. Our next steps include assessing whether our QI interventions may contribute to improved clinical outcomes in children with sepsis.
FUNDING: No external funding.
CONFLICT OF INTEREST DISCLOSURES: The authors have indicated they have no potential conflicts of interest relevant to this article to disclose.
Dr Miller conceptualized the study, conducted the initial data analysis, drafted the initial manuscript, and reviewed and revised the manuscript; Dr Silverman conceptualized the study, coordinated and supervised data collection, interpreted the data, and reviewed and revised the manuscript; Dr Tseng conceptualized the study, interpreted the data, and reviewed and revised the manuscript; Dr Schefft assisted with data analysis and reviewed and revised the manuscript; Ms Lowerre and Drs Pedigo and Muñoz assisted with data collection, provided key historical information, interpreted data, and reviewed and revised the manuscript; and all authors approved the final manuscript as submitted and agree to be accountable for all aspects of the work.
Comments