Previous studies reveal that ineffective communication contributes to patient-safety events. Structured handoffs improve communication during shift change and transfers from outpatient clinics to emergency departments. We aimed to improve the perceived quality of admission handoffs from a baseline of 22.2% to 50% by the end of the study period through use of a standardized template between urgent care (UC) and inpatient providers.
We used quality improvement methodology to identify key themes (clarity in illness severity, organization, completeness, and pace) that contribute to decreased quality communication. A survey to evaluate the perception of communication and key themes between the groups was administered. During the 15-month quality improvement study at a tertiary pediatric institution, we implemented a handoff tool with visual aids. Givers of information received formal training. Participants received iterative performance feedback. A control chart was used to monitor fidelity to the handoff tool. We used statistical analyses to compare changes in perceived communication between provider types before and after implementation of the handoff tool.
Both UC and inpatient providers had an increased rate of positive perceptions in the overall quality of communication after 12 months of using the admission handoff tool (22% vs 67.3%; P = .01). Complete fidelity to the admission handoff tool increased over time. There was no change in mean duration of handoff (4 minutes) after implementing the structured handoff.
A structured handoff during admission of pediatric patients from an off-site UC to inpatient setting improved the perception of the quality of admission handoff communication.
Ineffective handoff communication is recognized as a critical patient-safety problem in health care. Errors in communication result in increased patient morbidity and mortality and play a significant role in malpractice claims.1 An estimated 80% of serious medical errors involve miscommunication between providers during the transfer of patients from one medical provider to another with change of shift or change of care setting.2
Results of previous studies support the use of structured handoffs to decrease medical errors and preventable adverse events without negatively impacting workflow during shift changes.3,4 In addition to improving patient care and safety during shift changes, implementation of a structured handoff during emergency department to inpatient admissions results in increased staff satisfaction5 and improved communication during interdepartmental transfers within a hospital setting.6
Transitioning care of a patient from a location that is geographically separate from the next care team adds another level of complexity. This type of transfer requires effective communication to ensure the patient arrives safely to the appropriate unit and the accepting care team is prepared for the patient’s arrival. Huth et al describe how structured handoffs improve communication during transfer of care from off-site outpatient clinics to the emergency department.7 However, to our knowledge, the use of a structured handoff to improve communication for direct admission to an inpatient setting for pediatric acute illness or injury from an urgent care (UC) center has not been described.
We aimed to improve the percentage of positive perceptions of overall quality of the verbal admission handoffs between UC providers to inpatient-receiving physicians from a baseline of 22.2% to 50% by the end of the study period. To achieve our goal, we implemented multiple plan-do-study-act (PDSA) cycles to increase the use of an admission handoff tool to structure the handoff communication during the admission of pediatric UC patients to a geographically separate inpatient setting.
Methods
Context
The receiving facility was a tertiary care pediatric medical center with ∼186 medical-surgical beds8 across 2 freestanding pediatric hospitals with general inpatient units. The general inpatient units are staffed by pediatric hospital medicine (PHM) teams and separate resident physician teams. Inpatient physicians use illness severity, patient summary, action list, situation awareness, and synthesis by receiver. Inpatient physicians use an evidence-based template developed by Starmer et al9 as the standard format for handoffs during shift changes on the general inpatient units.
The organization also has 3 pediatric UC centers located throughout the metro area in which the index admissions were generated. These UC centers are staffed by general pediatricians and advanced practice registered nurses (APRNs) who together complete >90 000 encounters a year, of which ∼1% require admission.10 UC providers directly admit patients to the inpatient units. Because of the geographical separation between the UC centers and inpatient units, all admission handoffs occur via telephone between the admitting UC provider and accepting inpatient provider. All admission handoffs are recorded and stored for 10 years in a secure database.11 A PHM physician triages admissions from outside facilities to help determine patient placement. However, when a triage physician is not available, the admitting provider delivers the handoff directly to the PHM or resident team. Before the study period, there was no standard format for admission handoffs.
Developing the Survey
Before the start of the intervention, a team of UC and PHM physicians completed a fishbone diagram to identify key themes that contributed to admission handoff communication quality: clarity, completeness, organization, and pace (Fig 1). After identifying the key themes, the team developed a Research Electronic Data Capture (REDCap) survey (Supplemental Table 2) that was sent to all UC and PHM providers in July 2018.12,13 This survey was used to measure the impact of the key themes, as well as obtain a baseline perception of the overall quality of communication during admission handoffs between UC and inpatient providers. A free-text box at the end of the survey captured additional comments used to craft interventions. Provider perceptions of handoff communication were again assessed by using the same REDCap survey 12 months postimplementation (July 2019), and results were shared with the providers via e-mail and division meetings. We excluded resident physicians from the survey because the UC provider typically interacted with the PHM triage physician to communicate the admission handoff.
Interventions
With the key themes (Fig 1) in mind, the team collaborated to develop essential elements that should be included during an admission handoff. Because PHM physicians used illness severity, patient summary, action list, situation awareness, and synthesis for handoffs during shift change, this format was used as the template for the admission handoff tool between UC and inpatient providers. We added elements to each component to include information essential to the safe handoff of care from the off-site outpatient setting to inpatient (Fig 2A).
We completed multiple PDSA cycles during the study period. We launched the handoff tool July 1, 2018, via a campaign with educational presentations to UC and PHM providers. We displayed visual aids in UC and PHM work areas. UC providers participated in an interactive workshop in October 2018 in which they practiced using the handoff tool to deliver information from mock scenarios of common pediatric UC admissions. We modified the admission worksheet that PHM physicians used to take notes during handoffs in January 2019 to mirror the order, information, and cadence of the admission handoff tool. The project leader emailed UC providers individualized quarterly feedback on their admission handoffs. This included the percentage of complete fidelity to the handoff tool and the percentage of each component delivered. PHM physicians received quarterly feedback on their division’s overall performance by the PHM champion either by e-mail or during division meetings. By using feedback received from PHM and UC providers during the first 12 months of the intervention, the visual aid that was displayed in the work areas was updated for the final quarter of the intervention (Fig 2B).
Study of the Interventions
We evaluated all handoffs between core UC providers (physicians and APRNs) to PHM physicians and inpatient residents for patients who were successfully admitted to the general inpatient unit during the baseline (May 1, 2018, to June 30, 2018) and the intervention period (July 1, 2018, to September 30, 2019). We excluded the handoff if the patient was admitted to intensive care or a subspecialty team. Handoffs provided by moonlighting providers, whose primary employment was outside of the UC division, were excluded. We also excluded handoffs that did not result in admission (ie, deferred to emergency department, discharged from the hospital, or underwent further evaluation or in the UC before acceptance of the admission) because the decision to defer admission was often made before completion of the handoff.
In addition to the project leader, 15 study team members received instruction on how to review the admission recordings and record data during a training workshop. During the workshop, team members reviewed sample admission handoffs and discussed whether the handoff included each component. The team agreed that a handoff was considered to have a component of the tool if the provider mentioned at least 1 element from the description (Fig 2) of that component.
For each admission handoff recording, reviewers collected data variables, including UC provider type (physician or APRN) and inpatient physician type (PHM attending or resident), duration of handoff, and components of the handoff. The reviewers listened to recordings of the handoff admission phone call and entered the results into a REDCap database.12,13 To provide feedback, reviewers of the handoff recordings were not blinded to the identities of the givers or receivers. To evaluate for interrater variation, the project leader (A.N.) audited 10% of recordings for concordance of findings, and no discrepancies were found.
Measures
Our primary outcome measure evaluated the percentage of positive perceptions on the overall quality of the communication during admission handoffs. Our secondary outcome measures the percentages of positive perceptions of individual handoff themes: clarity of illness severity, pace, organization, and completeness. We obtained these by surveying UC providers and PHM physicians before and after the intervention period. We used a 4-point Likert scale to evaluate the perceived overall quality of admission handoffs. We used a 5-point Likert scale to measure the perceived clarity of illness severity, organization, completeness, and pace of handoffs.
Our primary process measure evaluated the percentage of handoff admissions that included all 5 components. As secondary process measures, we evaluated the percentage of each individual component included in the handoff to identify which components were omitted most often. These guided improvement opportunities for subsequent PDSA cycles.
We monitored duration of handoff as a balancing measure. We measured handoff time in minutes and rounded to the nearest whole integer. The measurement started from the initiation of the conversation to the last exchange between the 2 providers on the recording.
Data Analysis
To evaluate the percentage of positive perceptions on the overall quality of the admission handoff, we compared survey results from baseline to 12 months after introduction of the handoff tool. For this analysis of our primary outcome, we defined positive perception of quality in the handoff as above average or excellent. For the secondary outcome measures, we defined positive perceptions of clarity of illness severity, pace, organization, and completeness of handoff as most times or almost always. We calculated the frequencies of positive perception responses for preintervention and postintervention periods and compared differences in proportion (difference-in-difference). We used the Breslow-Day test for homogeneity to compare changes in perceived communication (baseline versus 12 months) between provider type. We defined statistical significance as a P value <.05.
For our primary process measure, we evaluated the percentage of handoffs that included all 5 components of the structured tool using a p-chart. This allowed us to account for variation in the number of monthly admissions. We evaluated the percentage of the individual components as a monthly run chart of the aggregate data. The average duration of handoff in minutes was compared across sites within each quarter and across the duration of the intervention period by using analysis of variance. Pearson’s χ2 test was used to evaluate differences across UC sites for each quarter.
Ethical Considerations
This study was deemed nonhuman subject research by our institutional review board.
Results
Outcome Measures
We distributed the preintervention and postintervention survey to 81 providers. We had 45 (55.6%) respondents to the preintervention survey (22 PHM and 23 UC providers). For the postintervention survey, sent 12 months after the start of the admission handoff tool, 46 providers (56.8%) responded (19 PHM and 27 UC).
The overall perception of quality of communication for all surveyed respondents increased from 22.2% at baseline to 67.3% (P = .01) after 12 months of implementing an admission handoff tool. Before the study period, UC providers were significantly more likely to report the quality of communication during admission handoffs to be above average or excellent when compared with PHM physicians (39.1% vs 4.6%; P = .01). Results of the 12-month postsurvey continued to reveal that a higher percentage of UC providers have a more positive perception on the quality of admission handoffs than PHM physicians. However, the difference was no longer significant (74.1% vs 57.9%; P = .34) (Table 1).
. | Preintervention . | Postintervention . | Δ . | Difference-in-Difference . | ||||||
---|---|---|---|---|---|---|---|---|---|---|
PHM (N = 22), n (%) . | UC (N = 23), n (%) . | P . | PHM (N = 19), n (%) . | UC (N = 27), n (%) . | P . | PHM, % . | UC, % . | χ2 . | P . | |
How often is illness severity clearly stated? | 13 (59) | 18 (78.3) | .21 | 14 (73.7) | 27 (100) | .01 | 14.7 | 21.7 | 2.85 | .09 |
How often is handoff delivered in an organized manner? Responded with almost always or most times. | 2 (9.1) | 11 (47.8) | .01 | 13 (68.4) | 22 (81.5) | .48 | 59.3 | 33.7 | 1.94 | .16 |
How often are all pertinent details discussed? Responded with almost always or most times. | 12 (54.6) | 19 (82.6) | .06 | 18 (94.7) | 26 (96.3) | .99 | 40.1 | 13.7 | 0.41 | .52 |
How often is the pace of delivery just right (not too slow, does not feel pressured)? Responded with almost always or most times. | 6 (27.3) | 15 (65.2) | .02 | 15 (78.9) | 20 (74.1) | .99 | 51.6 | 8.9 | 3.91 | .05 |
Overall, how would you rate UC providers’ and inpatient providers’ communication during admission handoffs? Responded with above average or excellent. | 1 (4.6) | 9 (39.1) | .01 | 11 (57.9) | 20 (74.1) | .34 | 53.3 | 35.0 | 2.35 | .12 |
. | Preintervention . | Postintervention . | Δ . | Difference-in-Difference . | ||||||
---|---|---|---|---|---|---|---|---|---|---|
PHM (N = 22), n (%) . | UC (N = 23), n (%) . | P . | PHM (N = 19), n (%) . | UC (N = 27), n (%) . | P . | PHM, % . | UC, % . | χ2 . | P . | |
How often is illness severity clearly stated? | 13 (59) | 18 (78.3) | .21 | 14 (73.7) | 27 (100) | .01 | 14.7 | 21.7 | 2.85 | .09 |
How often is handoff delivered in an organized manner? Responded with almost always or most times. | 2 (9.1) | 11 (47.8) | .01 | 13 (68.4) | 22 (81.5) | .48 | 59.3 | 33.7 | 1.94 | .16 |
How often are all pertinent details discussed? Responded with almost always or most times. | 12 (54.6) | 19 (82.6) | .06 | 18 (94.7) | 26 (96.3) | .99 | 40.1 | 13.7 | 0.41 | .52 |
How often is the pace of delivery just right (not too slow, does not feel pressured)? Responded with almost always or most times. | 6 (27.3) | 15 (65.2) | .02 | 15 (78.9) | 20 (74.1) | .99 | 51.6 | 8.9 | 3.91 | .05 |
Overall, how would you rate UC providers’ and inpatient providers’ communication during admission handoffs? Responded with above average or excellent. | 1 (4.6) | 9 (39.1) | .01 | 11 (57.9) | 20 (74.1) | .34 | 53.3 | 35.0 | 2.35 | .12 |
The difference-in-difference describes whether there is a statistically significant difference in the degree of change in perception between UC and PHM providers.
Before the intervention, a higher percentage of UC providers had positive perceptions on the organization (47.8% vs 9.1%; P = .01) and pace of the admission handoff compared with PHM physicians. The percentages of positive perception of completeness and clarity of illness severity were not statistically different between UC and PHM providers.
After the intervention, UC providers continued to have a higher percentage of positive perceptions for all key themes of communication (Fig 3). However, after 12 months of using an admission handoff tool, the only statistically significant difference between UC and PHM providers that persisted was the percentage of positive perceptions on clarity of illness severity (100% vs 73.7%; P > .01) (Table 1).
Process Measures
There were 57 admission handoff recordings reviewed during the 2-month baseline period. During the 15-month study period, there were 911 admission handoff recordings screened for inclusion criteria. Admissions by moonlighting UC physicians (97) and admissions to subspecialty or critical care (92) were excluded. An additional 41 were excluded because of technical errors, in which the recordings terminated prematurely. The remaining 681 admission handoffs were included (Supplemental Fig 5).
Before implementation of the admission handoff tool, no admission handoffs included all 5 of the components. During the intervention period, the percentage of handoffs that included all components of the structured handoff increased 31.0% (95% confidence interval 17.8%–44.2%) from 47% during the first quarter (July to September 2018) to 78% during the final quarter (July to September 2019) of the intervention period (Fig 4A). Patient summary, which was 100% at baseline, remained essentially unchanged (99.8%) during the intervention period. Synthesis by receiver was omitted most frequently. When compared with the baseline period, communication of illness severity, situation awareness, and synthesis by receiver increased significantly (Fig 4B). No significant difference in handoff duration occurred across sites within each quarter or throughout the study period (P = .40).
Discussion
The implementation of a structured admission handoff tool for admissions from an off-site outpatient setting to the general pediatric inpatient unit was successful in improving the perception of communication between UC and inpatient providers. Implementation of a structured admission handoff tool was associated with a significant improvement in PHM and UC providers’ perceptions of the organization and quality of communication during this critical point in patient care. PHM physicians’ positive perceptions of completeness also increased after implementation of the structured admission handoff. Aligning with the perception of improved communication during the study period, inclusion of all components of the structured handoff increased over time.
Omitted information has been identified as the root cause of most errors during transfers of care.14 Before the intervention, 83% of UC providers perceived that all pertinent details were discussed most times or always. However, only 55% of PHM physicians surveyed at baseline scored the completeness of the handoff with a positive perception. Although most handoffs in our study included patient summary (100%) and action list (91%) at baseline; providers often omitted the other components. Although we saw improvement in complete fidelity to the admission handoff tool after displaying visual aids and providing education, the greatest improvement occurred after an interactive workshop for UC providers that allowed for observed practice handoffs with real-time iterative feedback. Inclusion of synthesis by receiver increased when we modified the PHM admission worksheet to remind PHM physicians to provide a synthesis as the receiver of the handoff. This improvement is consistent with a previous study that revealed receiver-driven handoff communication interactions are effective in including more essential components of a handoff.7
Although our results support the use of a structured handoff during admission from an off-site location to an inpatient setting, postsurvey free-text comments from both UC and PHM providers noted the subjectivity of the terms used to describe illness severity (stable, watcher, and unstable). These terms are interpreted differently in the outpatient setting compared to the inpatient setting. Anecdotally, UC providers often described patients they admitted as watcher or stable watcher because, in the UC setting, patients who were stable are usually discharged from the hospital. This difference in interpretation of illness severity likely accounts for the persistent difference in perceptions between UC providers and PHM physicians. The next intervention will focus on clarity by making illness severity descriptions more objective.
Our preintervention and postintervention survey results are consistent with previous studies in which it is indicated that givers of information perceive communication to be better than the receivers of that information.15 UC providers perceived the handoffs to be more complete, organized, and overall better quality than did PHM physicians in both survey periods. Despite the persistent discrepancy between the givers and receivers of information, after the implementation of a structured admission handoff tool, there was a balanced increase in positive perception of communication in both groups. This finding is consistent with other studies that have revealed improved perception in communication after implementation of a structured handoff.3–7,15–17
This study was limited by implementation at a single institution. Although we implemented this project across 3 UC centers and 2 freestanding hospitals located in 5 different geographic locations within a large metro area, the generalizability of these results may be limited. The receivers were already familiar with the framework, which may have accelerated the successful launch of the intervention. In addition, providers were aware their handoffs were being reviewed, which may have altered their behavior.18 Those who reviewed the admission handoff recordings were not blinded to the identity of the giver or receiver, which may bias the results; however, no discrepancies were found during the audit.
The presurvey and postsurvey was limited to UC core providers and PHM physicians although these groups interact with UC moonlighters and pediatric residents. Although PHM physicians and core UC providers account for the majority of admission handoffs, interactions with resident physicians and moonlighters who did not have consistent exposure to the interventions may have influenced the survey responses. Surveys were only distributed twice during the study period because of the feasibility of asking providers to complete multiple surveys. Therefore, we cannot determine which intervention drove the greatest change to our outcome measures. We did not evaluate direct patient-safety metrics. However, because breakdown in communication is the most common factor in sentinel safety events, our improvements in the perception of communication during transfer from one facility to another is an important factor in patient safety.
Inpatient providers must receive clear and complete information to effectively assume care of admitted patients. Our study adds to the existing body of evidence revealing that structured handoffs improve interdepartmental communication.6,7 Inpatient providers can collaborate with outlying acute care facilities and primary clinics to identify essential elements that should be included in admission handoffs. Future interventions for our project include using an objective illness severity score to improve clarity. As more data are available, clinical outcomes of admitted patients can be compared to variation in adherence to the admission handoff tool.
Acknowledgments
We thank the divisions of UC and Hospital Medicine at Children’s Mercy Kansas City for their participation and feedback throughout the project. We acknowledge Mike Weckwerth and the Children’s Mercy Transport Center for their help in accessing the recordings for review. We also would like to thank the Medical Writing Center at Children’s Mercy Kansas City for editing this article.
FUNDING: Supported by Children’s Mercy Kansas City. There was no external funding for this article. The funder/sponsor did not participate in the work.
Dr Nedved conceptualized and designed the study, analyzed and interpreted the data, drafted the initial manuscript, and supervised the approval of the final manuscript; Dr Berg assisted in study design and critically reviewed the manuscript; Dr Lee provided data interpretation, assisted in data analysis, and critically reviewed the manuscript; Dr Montalbano mentored Dr Nedved throughout the project, from project design through methods, aided in data collection, management, and interpretation, and critically reviewed the manuscript; and all authors approved the final manuscript as submitted and agree to be accountable for all aspects of the work.
Deidentified individual data will not be made available.
References
Competing Interests
POTENTIAL CONFLICT OF INTEREST: The authors have indicated they have no relevant potential conflicts of interest to disclose.
FINANCIAL DISCLOSURE: The authors have indicated they have no financial relationships relevant to this article to disclose.
Comments