BACKGROUND AND OBJECTIVES

Pediatric health care encounters declined during the coronavirus disease 2019 (COVID-19) pandemic, and pediatric residency programs have adapted trainee schedules to meet the needs of this changing clinical environment. We sought to evaluate the impact of the pandemic on pediatric interns’ clinical exposure.

METHODS

In this retrospective cohort study, we quantified patient exposure among pediatric interns from a single large pediatric residency program at a freestanding children’s hospital. Patient encounters and shifts per pediatric intern in the inpatient and emergency department settings were evaluated during the COVID-19 pandemic, from March to June 2020, as compared with these 3 months in 2019. Patient encounters by diagnosis were also evaluated.

RESULTS

The median number of patient encounters per intern per 2-week block declined on the pediatric hospital medicine service (37.5 vs 27.0; P < .001) and intensive care step-down unit (29.0 vs 18.8; P = .004) during the pandemic. No significant difference in emergency department encounters was observed (63.0 vs 40.5; P = .06). The median number of shifts worked per intern per 2-week block also decreased on the pediatric hospital medicine service (10.5 vs 9.5, P < .001). Across all settings, there were more encounters for screening for infectious disease and fewer encounters for respiratory illnesses.

CONCLUSIONS

Pediatric interns at the onset of the COVID-19 pandemic were exposed to fewer patients and had reduced clinical schedules. Careful consideration is needed to track and supplement missed clinical experiences during the pandemic.

In the setting of social distancing measures during the coronavirus disease 2019 (COVID-19) pandemic, pediatric hospitals have reported lower pediatric patient volumes across hospital settings.15  In response to these changes and in an effort to minimize resident exposure, residency programs have altered resident schedules.6,7  We sought to evaluate the impact of the COVID-19 pandemic on pediatric interns’ exposure to different types and care settings of pediatric diseases, at the onset of the pandemic and amid the initial surge. We hypothesized that pediatric interns evaluated fewer patients and these patients had a different spectrum of disease during the COVID-19 pandemic.

We performed a retrospective cohort study at a freestanding children’s hospital of patients cared for by pediatric interns from a single large pediatric residency program. The study hospital’s institutional review board approved the study protocol. At the study hospital, interns rotate through the pediatric hospital medicine (PHM) service, an ICU step-down service, and emergency department (ED).8  These rotations were selected because they represent common settings through which pediatric residents across the country typically rotate during the intern year. At the onset of the pandemic, in response to perceived reductions in patient volumes and in an effort to minimize infectious risks, our residency program reduced intern clinical schedules. Shift length was not adjusted during the study period. Patient encounters from other affiliating hospitals where interns also rotate were excluded from the analysis, given their storage in different data warehouses that were not available for data extraction.

We queried the enterprise data warehouse at the study institution and identified patients and the pediatric interns who cared for them during the initial peak of the COVID-19 pandemic (March through June 2020) at the study location, as compared with March through June 2019. We included patient encounters in the hospital’s ED and inpatient setting, including the PHM and ICU step-down services. We included patient encounters in which an intern either wrote a note in the ED or wrote a note or placed an order in the inpatient setting. Patients for whom interns wrote orders during daily rounds were counted toward patient exposures, with the rationale that interns had the opportunity to learn about these patients. For the inpatient setting, a patient encounter may span multiple days, so documentation of a note or order on any day was counted as a single patient encounter exposure.

We evaluated the number of patient encounters per pediatric intern per 2-week block and per shift and number of shifts per intern per 2-week block. Shifts worked were determined by using the residency program’s online scheduling platform. International Classification of Diseases, 10th Revision, Clinical Modification, codes were collected for all patient encounters. We converted these International Classification of Diseases, 10th Revision, Clinical Modification, codes into a smaller group of clinically meaningful categories using the Clinical Classifications Software Refined (CCSR) database, developed by the Agency for Healthcare Research and Quality.9  We then evaluated the number of patient encounters with a given CCSR code seen per pediatric intern per 2-week block in the inpatient and ED settings.

Categorical descriptive statistics were used to summarize patient and encounter characteristics. Continuous variables were summarized by using median and interquartile range (IQR). Wilcoxon rank tests (for continuous data) and 2-sample Poisson tests (for incidence data, such as encounters per intern block) were performed to compare the differences in primary outcomes between 2019 and 2020.

The median patient encounters per intern per two-week block declined by 28.0% on the PHM service (37.5 [IQR: 36.0–43.0] vs 27.0 [IQR: 22.0–36.0]; P < .001) and 35.5% on the ICU step-down service (29.0 [IQR: 21.5–35.0] vs 18.75 [IQR: 14.0–22.0]; P = .004) during the pandemic, as compared with the year previous (Fig 1A). The median patient encounters per intern per 2-week block were not significantly different before versus during the pandemic in the ED (63.0 [IQR: 57.0–71.0] vs 40.5 [IQR: 32.0–57.0]; P = .06; Fig 1A). The median number of patient encounters per intern per shift declined in the ED (6.7 [IQR: 6.3–7.1] vs 4.5 [IQR: 3.2–5.7]; P = .04) and ICU step-down service (2.7 [IQR: 2.0-3.5] vs 1.8 [IQR: 1.6–2.2]; P = .03), whereas encounters per shift were not significantly different for interns on the PHM service during the pandemic (3.5 [IQR: 3.3–4.2] vs 3.3 [IQR: 2.7–3.9]; P = .13; Fig 1B). Importantly, the number of shifts worked per intern per 2-week block was significantly less during the pandemic on the PHM service, whereas there was no significant difference observed in the ED and the ICU step-down service (Fig 1C).

FIGURE 1

Box and whisker plot of patient encounters per intern per 2-week block (A), patient encounters per intern per shift (B), and shifts worked per intern per 2-week block (C) in the ED, PHM, and ICU step-down settings before versus during the COVID-19 pandemic.

FIGURE 1

Box and whisker plot of patient encounters per intern per 2-week block (A), patient encounters per intern per shift (B), and shifts worked per intern per 2-week block (C) in the ED, PHM, and ICU step-down settings before versus during the COVID-19 pandemic.

Close modal

The mean number of patient encounters per pediatric intern with a given diagnosis is compared before versus during the pandemic in Fig 2. In the inpatient and ED settings, there was an increase in mean encounters per intern per 2-week block for the CCSR code, “exposure, encounters, screening or contact with infectious disease.” On the PHM service, the average intern saw 80% fewer patients with acute bronchitis during the pandemic (Fig 2B), and reductions in encounters for respiratory illnesses were observed across all 3 settings. In the ED, there was also a 55% decrease in mean encounters per intern for abdominal pain (Fig 2A).

FIGURE 2

Encounters associated with common CCSR codes before versus during the COVID-19 pandemic for the ED (A), PHM (B), and ICU step-down (C) settings. Values are reported as mean encounters by CCSR code per intern per 2-week block. Common CCSR codes were identified by using the top 10 CCSR codes by setting for both the prepandemic and pandemic cohorts. *P < .05, the statistically significant difference between the prepandemic and pandemic cohorts.

FIGURE 2

Encounters associated with common CCSR codes before versus during the COVID-19 pandemic for the ED (A), PHM (B), and ICU step-down (C) settings. Values are reported as mean encounters by CCSR code per intern per 2-week block. Common CCSR codes were identified by using the top 10 CCSR codes by setting for both the prepandemic and pandemic cohorts. *P < .05, the statistically significant difference between the prepandemic and pandemic cohorts.

Close modal

During the COVID-19 pandemic, pediatric interns at a large pediatric residency program were exposed to fewer patients and worked fewer shifts in the inpatient and ED settings. Our findings are supported by several recent studies revealing reduced pediatric patient volumes across settings nationwide.4,5,1015  We observed declines in encounters for respiratory illnesses in support of other recent studies documenting similar trends.10,11  Although there have been few published studies in which researchers document the impact of COVID-19 on resident patient exposure, 1 study of an emergency medicine residency in Taiwan revealed that ED residents saw less than one-half the typical patient volume.16  Although our study is reflective of a single residency program’s experience early on in the pandemic, declines in pediatric patient census have been documented nationwide. Similarly, residency programs in other specialties have reported on reduced clinical schedules.7,17  Therefore, it is likely that pediatric interns across the country saw significantly fewer pediatric patients and worked reduced shifts on pediatric clinical services during the early COVID-19 pandemic.

These changes have heightened concerns among residency program leadership and trainees about whether reduced patient exposure may impact clinical competency.7,18  In a study of radiology residents in which researchers assessed the impact of exposure on performance, residents who interpreted more radiographic films had improved performance, as measured by accuracy of their diagnostic reads.19  In 2 other studies in which researchers evaluated family medicine and internal medicine residents, residents who saw more patients scored higher on in-training examinations.20,2123  Given this association between exposure and competency, it is, therefore, important for residency programs to consider tracking resident-level patient exposures during the pandemic. It is also important to recognize that concerns about competency may impact intern confidence in medical decision-making, particularly as they gain additional autonomy at the end of intern year. Acknowledging these concerns and addressing gaps in the clinical experience may alleviate this anxiety and provide interns with the tools to feel more confident and comfortable in their decision-making.

Throughout the pandemic, residency programs in specialties across the country have developed innovative strategies to augment resident clinic experience. Radiology and surgical programs have developed simulations to mimic regular workdays for residents.6,24  In our program, we developed a virtual work from home option for residents with heightened individual or family health risks.25  Although these strategies do not replace in-person clinical interactions, virtual learning and patient care play fundamental roles in advancing resident training while also minimizing infectious risks.

Our study has several important limitations. Our findings represent a single residency program’s experience during a 3-month period at the onset of the pandemic and amid a surge of cases within the community and, therefore, may not be generalizable to all institutions. However, given documentation of widespread reductions in pediatric patient volumes during the pandemic, pediatric residency programs across the country likely experienced similar trends. We were also unable to assess intern patient exposure during rotations outside the main study hospital that provided important additional training opportunities that were not quantified in this study. The next steps include evaluating intern’s clinical exposure through the 2020–2021 academic year as the pandemic has progressed and, also, assessing national trends outside of our single institution.

In a large pediatric residency program, the onset of the COVID-19 pandemic was associated with reductions in overall clinical exposure to patients and the breadth of pediatric disease. We identified a disproportionate decrease in patient exposures for respiratory and abdominal symptoms, common complaints that are key complaints for pediatrics residents to gain experience diagnosing and managing. If the COVID-19 pandemic or future pandemics continue to negatively impact pediatric patient volumes, it will be important for residency programs to track intern patient exposures and assess whether reduced volumes impact competency and the attainment of professional milestones during training. In addition, identifying reductions in patient exposures by specific setting or disease processes, as we have done in this study, would allow programs to develop targeted interventions through simulation or virtual teaching curricula to supplement the clinical experience.

FUNDING: Dr Michelson received funding through award 1K08HS026503 from the Agency for Healthcare Research and Quality. The funder/sponsor did not participate in the work. Funded by the National Institutes of Health (NIH).

Drs Geanacopoulos and Winn conceptualized and designed the study, collected data, conducted the data analyses, drafted the initial manuscript, reviewed and revised the manuscript, and had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis; Dr Sundheim contributed to the design of the study, drafted the initial manuscript, and reviewed and revised the manuscript; Ms Greco contributed to the design of the study, conducted the data analyses, and reviewed and revised the manuscript; Dr Michelson contributed to the design of the study, contributed to the data analysis, and reviewed and revised the manuscript; Dr Parsons contributed to the design of the study and reviewed and revised the manuscript; Dr Hron contributed to the design of the study, collected data, conducted the data analyses, and reviewed and revised the manuscript; and all authors approved the final manuscript as submitted and agree to be accountable for all aspects of the work.

COMPANION PAPER: A companion to this article can be found online at www.hosppeds.org/cgi/doi/10.1542/hpeds.2021-005970.

1.
Zachariah
P
,
Johnson
CL
,
Halabi
KC
, et al
;
Columbia Pediatric COVID-19 Management Group
.
Epidemiology, clinical features, and disease severity in patients with coronavirus disease 2019 (COVID-19) in a children’s hospital in New York City, New York
.
JAMA Pediatr
.
2020
;
174
(
10
):
e202430
2.
Dong
Y
,
Mo
X
,
Hu
Y
, et al
.
Epidemiology of COVID-19 among children in China
.
Pediatrics
.
2020
;
145
(
6
):
e20200702
3.
Tagarro
A
,
Epalza
C
,
Santos
M
, et al
.
Screening and severity of coronavirus disease 2019 (COVID-19) in children in Madrid, Spain [published correction appears in JAMA Pediatr. 2020;174(10):1009]
.
JAMA Pediatr
.
2021
;
175
(
3
):
e201346
4.
Isba
R
,
Edge
R
,
Jenner
R
,
Broughton
E
,
Francis
N
,
Butler
J
.
Where have all the children gone? Decreases in paediatric emergency department attendances at the start of the COVID-19 pandemic of 2020
.
Arch Dis Child
.
2020
;
105
(
7
):
704
5.
Wilder
JL
,
Parsons
CR
,
Growdon
AS
,
Toomey
SL
,
Mansbach
JM
.
Pediatric hospitalizations during the COVID-19 pandemic
.
Pediatrics
.
2020
;
146
(
6
):
e2020005983
6.
Johnson
J
,
Chung
MT
,
Carron
MA
,
Chan
EY
,
Lin
HS
,
Hotaling
J
.
Novel changes in resident education during a pandemic: strategies and approaches to maximize residency education and safety
.
Int Arch Otorhinolaryngol
.
2020
;
24
(
3
):
e267
e271
7.
Fero
KE
,
Weinberger
JM
,
Lerman
S
,
Bergman
J
.
Perceived impact of urologic surgery training program modifications due to COVID-19 in the United States
.
Urology
.
2020
;
143
:
62
67
8.
Miller
KA
,
Hillier
D
,
Russ
C
,
Luercio
M
,
Winn
AS
.
Applying self-determination theory to redesign an inpatient care team
.
Acad Pediatr
.
2019
;
19
(
3
):
351
353
9.
Healthcare Cost and Utilization Project
.
Clinical Classifications Software Refined (CCSR)
.
Available at: https://www.hcup-us.ahrq.gov/toolssoftware/ccsr/ccs_refined.jsp. Accessed November 15, 2020
10.
Kenyon
CC
,
Hill
DA
,
Henrickson
SE
,
Bryant-Stephens
TC
,
Zorc
JJ
.
Initial effects of the COVID-19 pandemic on pediatric asthma emergency department utilization
.
J Allergy Clin Immunol Pract
.
2020
;
8
(
8
):
2774
2776.e1
11.
Hatoun
J
,
Correa
ET
,
Donahue
SMA
,
Vernacchio
L
.
Social distancing for COVID-19 and diagnoses of other infectious diseases in children
.
Pediatrics
.
2020
;
146
(
4
):
e2020006460
12.
Bram
JT
,
Johnson
MA
,
Magee
LC
, et al
.
Where have all the fractures gone? The epidemiology of pediatric fractures during the COVID-19 pandemic
.
J Pediatr Orthop
.
2020
;
40
(
8
):
373
379
13.
Chaiyachati
BH
,
Agawu
A
,
Zorc
JJ
,
Balamuth
F
.
Trends in pediatric emergency department utilization after institution of coronavirus disease-19 mandatory social distancing
.
J Pediatr
.
2020
;
226
:
274
277.e1
14.
McDonnell
T
,
Nicholson
E
,
Conlon
C
, et al
.
Assessing the impact of COVID-19 public health stages on paediatric emergency attendance
.
Int J Environ Res Public Health
.
2020
;
17
(
18
):
6719
15.
Ferrero
F
,
Ossorio
MF
,
Torres
FA
,
Debaisi
G
.
Impact of the COVID-19 pandemic in the pediatric emergency department attendances in Argentina
.
Arch Dis Child
.
2020
;
106
(
2
):
e5
16.
Lo
HY
,
Lin
SC
,
Chaou
CH
,
Chang
YC
,
Ng
CJ
,
Chen
SY
.
What is the impact of the COVID-19 pandemic on emergency medicine residency training: an observational study
.
BMC Med Educ
.
2020
;
20
(
1
):
348
17.
Chick
RC
,
Clifton
GT
,
Peace
KM
, et al
.
Using technology to maintain the education of residents during the COVID-19 pandemic
.
J Surg Educ
.
2020
;
77
(
4
):
729
732
18.
Oshiro
KT
,
Turner
ME
,
Torres
AJ
,
Crystal
MA
,
Vincent
JA
,
Barry
OM
.
Non-elective pediatric cardiac catheterization during COVID-19 pandemic: a New York center experience
.
J Invasive Cardiol
.
2020
;
32
(
7
):
E178
E181
19.
Agarwal
V
,
Bump
GM
,
Heller
MT
, et al
.
Resident case volume correlates with clinical performance: finding the sweet spot
.
Acad Radiol
.
2019
;
26
(
1
):
136
140
20.
Iglar
K
,
Murdoch
S
,
Meaney
C
,
Krueger
P
.
Does clinical exposure matter? Pilot assessment of patient visits in an urban family medicine residency program
.
Can Fam Physician
.
2018
;
64
(
1
):
e42
e48
21.
Mizuno
A
,
Tsugawa
Y
,
Shimizu
T
, et al
.
The impact of the hospital volume on the performance of residents on the general medicine in-training examination: a multicenter study in Japan
.
Intern Med
.
2016
;
55
(
12
):
1553
1558
22.
Kwan
C
,
Pusic
M
,
Pecaric
M
,
Weerdenburg
K
,
Tessaro
M
,
Boutis
K
.
The variable journey in learning to interpret pediatric point-of-care ultrasound images: a multicenter prospective cohort study
.
AEM Educ Train
.
2019
;
4
(
2
):
111
122
23.
Lee
MS
,
Pusic
M
,
Carrière
B
,
Dixon
A
,
Stimec
J
,
Boutis
K
.
Building emergency medicine trainee competency in pediatric musculoskeletal radiograph interpretation: a multicenter prospective cohort study
.
AEM Educ Train
.
2019
;
3
(
3
):
269
279
24.
Recht
MP
,
Fefferman
NR
,
Bittman
ME
, et al
.
Preserving radiology resident education during the COVID-19 pandemic: the simulated daily readout
.
Acad Radiol
.
2020
;
27
(
8
):
1154
1161
25.
Luercio
M
,
Ward
VL
,
Sectish
TC
,
Mateo
CM
,
Michelson
CD
.
One size does not fit all: implementation of an equitable and inclusive strategic response to address needs of pediatric resident physicians during the coronavirus disease 2019 (COVID-19) crisis
.
J Pediatr
.
2020
;
229
:
8
10

Competing Interests

POTENTIAL CONFLICT OF INTEREST: The authors have no conflicts of interest relevant to this article to disclose.

FINANCIAL DISCLOSURE: The authors have indicated they have no financial relationships relevant to this article to disclose.