Video Abstract
To derive and internally validate a prediction model for the identification of febrile infants ≤60 days old at low probability of invasive bacterial infection (IBI).
We conducted a case-control study of febrile infants ≤60 days old who presented to the emergency departments of 11 hospitals between July 1, 2011 and June 30, 2016. Infants with IBI, defined by growth of a pathogen in blood (bacteremia) and/or cerebrospinal fluid (bacterial meningitis), were matched by hospital and date of visit to 2 control patients without IBI. Ill-appearing infants and those with complex chronic conditions were excluded. Predictors of IBI were identified with multiple logistic regression and internally validated with 10-fold cross-validation, and an IBI score was calculated.
We included 181 infants with IBI (155 [85.6%] with bacteremia without meningitis and 26 [14.4%] with bacterial meningitis) and 362 control patients. Twenty-three infants with IBI (12.7%) and 138 control patients (38.1%) had fever by history only. Four predictors of IBI were identified (area under the curve 0.83 [95% confidence interval (CI): 0.79–0.86]) and incorporated into an IBI score: age <21 days (1 point), highest temperature recorded in the emergency department 38.0–38.4°C (2 points) or ≥38.5°C (4 points), absolute neutrophil count ≥5185 cells per μL (2 points), and abnormal urinalysis results (3 points). The sensitivity and specificity of a score ≥2 were 98.8% (95% CI: 95.7%–99.9%) and 31.3% (95% CI: 26.3%–36.6%), respectively. All 26 infants with meningitis had scores ≥2.
Infants ≤60 days old with fever by history only, a normal urinalysis result, and an absolute neutrophil count <5185 cells per μL have a low probability of IBI.
Commonly used risk-stratification criteria for febrile infants were either developed >2 decades ago in studies that included relatively few infants with bacteremia and/or bacterial meningitis or include procalcitonin, which is not readily available in some hospitals.
A newly derived score is highly sensitive for the identification of non–ill-appearing febrile infants ≤60 days old with invasive bacterial infection. Infants with fever by history only, normal urinalysis results, and an absolute neutrophil count <5185 cells per μL had a low probability of infection.
Febrile infants ≤60 days of age are at high risk for serious bacterial infections.1 Because neither clinical appearance nor individual laboratory tests are reliable indicators of which infants have serious bacterial infections,2,3 several criteria (eg, Boston, Philadelphia, Rochester) are used to stratify infants as being at low or not low risk for infection.4,–6 However, these criteria were developed >25 years ago, and the epidemiology of serious bacterial infections has changed considerably since that time.7,8 Additionally, the specific low-risk predictors (eg, normal white blood cell [WBC] cutpoint) were determined by expert opinion rather than statistical derivation.1 In studies that evaluated the performance of these criteria, with the exception of a recent investigation conducted by our research collaborative,9 most infants with serious bacterial infections had urinary tract infections (UTIs) rather than invasive bacterial infections (IBIs) (ie, bacteremia and/or bacterial meningitis).1,5,6,10,11 Because most infants with UTIs will be identified by using urinalysis,12 and because IBIs are more likely to result in adverse outcomes,13 an updated clinical prediction model derived in a contemporary sample that includes a large number of infants with IBI would impact the clinical care of febrile infants.
The Step-by-Step approach, a risk-stratification algorithm that includes age, clinical appearance, urinalysis, procalcitonin, C-reactive protein (CRP), and absolute neutrophil count (ANC), was recently validated in a cohort of febrile infants ≤90 days of age that included 87 infants with IBI.14 Although the Step-by-Step approach had a sensitivity of 92% for identification of infants with IBI,14 procalcitonin results are not readily available in some hospitals and primary care offices in the United States. Additionally, a prediction model that, similar to the Step-by-Step approach, identifies which febrile infants are at low risk for IBI without cerebrospinal fluid (CSF) testing may reduce unnecessary lumbar punctures in low-risk infants, many of whom currently undergo this procedure.15 Our objective was to derive and internally validate a clinical prediction model for IBI in a sample that included a large number of non–ill-appearing febrile infants ≤60 days of age with IBI.
Methods
Study Design
We conducted a case-control study of non–ill-appearing infants ≤60 days of age with a documented rectal temperature ≥38.0°C evaluated in the emergency departments (EDs) of 11 children’s hospitals between July 1, 2011 and June 30, 2016. Infants with IBI (case patients) were matched by hospital and date of visit to 2 febrile infants without IBI (control patients). The study protocol was approved by each hospital’s institutional review board.
Case Patients
Infants ≤60 days of age with IBI were identified through query of each hospital’s microbiology laboratory database or electronic medical record system for blood (bacteremia) and/or CSF (bacterial meningitis) cultures with growth of a pathogen, as described previously.8,9 Infants were excluded if the culture was documented to have been treated as a contaminant by the medical team.8,16
Infants with IBI were eligible for inclusion if they presented to a participating hospital’s ED either from home or from an outpatient clinic (ie, were not transferred from another ED) and if the infant was (1) febrile, defined as a rectal temperature ≥38.0°C (100.4°F) at home, in an outpatient clinic, or in the ED1,5,11; (2) not ill appearing, as documented on the ED physical examination17; and (3) without a complex chronic condition.18,19 Ill-appearing infants and those with complex chronic conditions were excluded because the prevalence of IBI may be higher in these infants,2 and these infants would not be classified as low risk.
Control Patients
Potentially eligible control patients were identified through query of the Pediatric Health Information System for infants ≤60 days of age with an ED visit during the 5-year study period and who had both urine and blood cultures obtained.9,15 For 1 participating site that did not contribute data to the Pediatric Health Information System, potential control patients were identified through query of the hospital’s electronic medical record by using the same search criteria.
Each case patient was matched to 2 control infants at the same hospital with the closest date of visit to the case patient. If >2 infants were eligible as control patients on the basis of date of visit, a random number generator was used to select which control patients to include. Medical records were then reviewed for each potential control patient to assess for eligibility. Control patients were eligible if they met the same inclusion criteria as case patients with the exception that (1) their blood and, if obtained, CSF culture had no growth of a pathogen and (2) they had not received antibiotics within 7 days before the ED visit. Control patients were not excluded on the basis of peripartum maternal antibiotic exposure. Febrile infants with UTIs8,12 without concomitant IBI were eligible for inclusion as control patients. Encounters subsequent to the index ED visit were reviewed to ensure that the control patient was not ultimately diagnosed with an IBI. If a potentially eligible control patient was deemed ineligible after medical record review, the infant with the next-closest date of visit was selected, and the process was repeated until 2 eligible control patients were identified for each case patient.
Data Collection
For each case patient and control patient, we extracted data from the medical record on variables that we hypothesized to be associated with the presence of IBI.4,–6,14,20 These variables included the following: demographics (age and sex); past medical history (gestational age); historical features (household sick contacts, symptoms of upper respiratory infection [URI], and duration of fever); measured temperature (at home or in an outpatient clinic, in triage, and highest recorded in the ED); physical examination findings (triage heart rate and respiratory rate and signs of URI and/or bronchiolitis); laboratory data (WBC count, ANC, CRP, procalcitonin, and urinalysis results12); and bacterial culture results (urine, blood, and CSF). CSF parameters were not assessed as predictors. Data were entered into a secure Research Electronic Data Capture tool21 that was pilot tested at each site and on which investigators were trained before data collection.
Statistical Analyses
A risk-prediction model for IBI was constructed by using a weighted multiple logistic regression approach with weights determined by the 2% prevalence of IBI in the population.7,22 Each predictor of interest was first considered in the model by itself. For continuous predictors, we used a graphical aid to assess whether the relationship was linear with the logit (loge[Pr(IBI = 1)/(1−Pr(IBI = 1))]) and followed up with the Box-Tidwell test.23 An α level of 0.10 was used to select candidate predictors for the model. Before building an adjusted model, we used Spearman rank correlation (|ρ| ≥0.90) to assess for potential multicollinearity among continuous predictors and compared the distributions of continuous predictors by categorical predictors using the Wilcoxon rank test. All possible 2-way interactions were considered in the final multiple logistic regression model. Adjusted odds ratios (aORs) with 95% confidence intervals (CIs) were used to quantify the magnitude of the association between each predictor and the primary outcome (IBI). Analyses were adjusted for study site by using this variable as a fixed effect in the model. An α level of 0.05 was required for the retention of a variable in the final adjusted model. For continuous predictors, we determined the cutoff values that maximized the area under the receiver operating characteristic curve (AUC) and in turn provided the optimal combination of sensitivity and specificity. The cutoff values were the same regardless of the prevalence of IBI used in the weighted model (eg, 2% vs 3% prevalence).
The performance of our prediction model was assessed by using calibration and discrimination metrics.24 The former is evaluated by using a qualitative aid, a calibration curve, to assess how well the model predicts the absolute risk relative to the observed probability of an outcome.25,26 The latter is a measure of how well the model discriminates between infants with and without IBI; an AUC was used to quantify this measure.27 Given that predictions from a model for a sample of observations used to create the model itself will result in the underestimation of prediction error, we used k-fold cross-validation for internal validation.28,29 We randomly divided the data into 10 folds (sets) to refit the model on any given 9 folds by leaving 1 fold out and obtaining predictions for the held-out fold. This internal validation approach provides a new estimate of the precision interval around the AUC, which is corrected for the estimated prediction error.
By using the predictors identified in the final model, an IBI score was developed with points assigned on the basis of the strength of the association of the predictor and the outcome (ie, presence of IBI) as expressed by the aOR for each predictor. The predictor with the aOR of the smallest magnitude was assigned 1 point, and the other predictors were assigned points on the basis of the relative magnitude of their aORs.30 Infants with missing data for any of the components of the score were excluded from the main analysis, but the IBI score was applied to case patients with missing data in a sensitivity analysis.
Statistical analyses were implemented by using Stata Data Analysis and Statistical Software version 15.0 (Stata Corp, College Station, TX) and SAS 9.4 (SAS Institute, Inc, Cary, NC).
Results
Study Sample
Of the 394 infants with IBI who presented to the 11 participating EDs during the 5-year study period, 181 (45.9%) met inclusion criteria as case patients and were matched to 362 control patients (Fig 1). Among the 181 infants with IBI, 155 (85.6%) had bacteremia without meningitis, and 26 (14.4%) had bacterial meningitis (19 [73.1%] with concomitant bacteremia). The pathogens are listed in Supplemental Table 5. Seventy-seven infants with IBI (42.5%) had a concomitant UTI compared with 21 of 362 control patients (5.8%). Twenty-three case patients (12.7%) and 138 control patients (38.1%) had a history of a rectal temperature ≥38.0°C but did not have a fever recorded in the ED.
Compared with controls, case patients with IBI were younger and had higher triage heart rates, maximum temperatures recorded in the ED, median WBC counts, and median ANCs. A higher proportion of infants with IBI had an abnormal urinalysis result, although a lower proportion had household sick contacts or symptoms or signs of URI (Table 1).
Demographic and Clinical Characteristics of Case Patients With IBI and Matched Control Patients
. | Case Patients With IBI, n = 181 . | Control Patients, n = 362 . | Pa,b . |
---|---|---|---|
Demographics | |||
Age, d, median (IQR) | 28 (16–43) | 35.5 (23–47) | <.001 |
Female sex, n (%) | 80 (44.2) | 161 (44.5) | .95 |
History, n of N (%) | |||
Prematurityc | 13 of 177 (7.3) | 20 of 339 (5.9) | .52 |
Duration of fever ≤24 hd | 141 of 153 (92.2) | 288 of 309 (93.2) | .68 |
Household sick contactse | 47 of 146 (32.2) | 141 of 290 (48.6) | .001 |
Vital signs, median (IQR) | |||
Triage temperature, °C | 38.4 (38.0–38.9) | 38.0 (37.5–38.4) | <.001 |
Highest ED temperature, °C | 38.6 (38.2–39.0) | 38.1 (37.6–38.5) | <.001 |
Triage HR | 177 (160–190) | 164 (152–180) | <.001 |
Triage RR | 44 (38–56) | 44 (36–52) | .14 |
Physical examination, n of N (%) | |||
URI symptoms or signsf,g | 41 of 172 (23.8) | 167 of 342 (48.8) | <.001 |
Bronchiolitish | 5 of 181 (2.8) | 21 of 362 (5.8) | .12 |
Laboratory | |||
Abnormal urinalysis, n of N (%)i,j | 90 of 171 (52.6) | 42 of 337 (12.5) | <.001 |
WBC, cells per μL, median (IQR) | 11 600 (8200–15 300) | 10 000 (7700–13 000) | .001 |
ANC, cells per μL, median (IQR) | 6322 (4119–9535) | 3524 (2056–5358) | <.001 |
. | Case Patients With IBI, n = 181 . | Control Patients, n = 362 . | Pa,b . |
---|---|---|---|
Demographics | |||
Age, d, median (IQR) | 28 (16–43) | 35.5 (23–47) | <.001 |
Female sex, n (%) | 80 (44.2) | 161 (44.5) | .95 |
History, n of N (%) | |||
Prematurityc | 13 of 177 (7.3) | 20 of 339 (5.9) | .52 |
Duration of fever ≤24 hd | 141 of 153 (92.2) | 288 of 309 (93.2) | .68 |
Household sick contactse | 47 of 146 (32.2) | 141 of 290 (48.6) | .001 |
Vital signs, median (IQR) | |||
Triage temperature, °C | 38.4 (38.0–38.9) | 38.0 (37.5–38.4) | <.001 |
Highest ED temperature, °C | 38.6 (38.2–39.0) | 38.1 (37.6–38.5) | <.001 |
Triage HR | 177 (160–190) | 164 (152–180) | <.001 |
Triage RR | 44 (38–56) | 44 (36–52) | .14 |
Physical examination, n of N (%) | |||
URI symptoms or signsf,g | 41 of 172 (23.8) | 167 of 342 (48.8) | <.001 |
Bronchiolitish | 5 of 181 (2.8) | 21 of 362 (5.8) | .12 |
Laboratory | |||
Abnormal urinalysis, n of N (%)i,j | 90 of 171 (52.6) | 42 of 337 (12.5) | <.001 |
WBC, cells per μL, median (IQR) | 11 600 (8200–15 300) | 10 000 (7700–13 000) | .001 |
ANC, cells per μL, median (IQR) | 6322 (4119–9535) | 3524 (2056–5358) | <.001 |
HR, heart rate; RR, respiratory rate.
Unadjusted comparisons between case patients and control patients used the Mann-Whitney U test for continuous variables and the χ2 test for categorical variables.
Characteristics with P ≤ .10 were considered for inclusion in the prediction model.
Four case patients and 23 control patients were missing gestational age.
Twenty-eight case patients and 53 control patients were missing documentation of duration of fever.
Thirty-five case patients and 72 control patients were missing documentation of household sick contacts.
Nine case patients and 20 control patients were missing documentation of URI symptoms or signs.
URI symptoms or signs (eg, congestion, rhinorrhea, and cough) as documented in the history or on ED physical examination.
Signs of bronchiolitis (eg, rales, wheeze, and coarse breath sounds) as documented on ED physical examination.
Eleven case patients and 25 control patients were missing urinalysis.
Urine dipstick with positive leukocyte esterase or positive nitrites or urine microscopy with >5 WBCs per high-power field or >5 WBCs per mm3 on enhanced urinalysis.
Multiple Logistic Regression Analysis
Four predictors were associated with the presence of IBI: age, highest temperature recorded in the ED, abnormal urinalysis result, and ANC (Table 2). To identify the cutoff value for ANC, the ANC level was incrementally varied to evaluate the effect on the discriminatory ability of the model; an ANC value of 5185 cells per μL was determined to be optimal. The model fit the observed data well, as shown by the calibration plot, in which the calibration curve overlapped with the diagonal reference line of perfect calibration (Fig 2). The AUC was 0.83 (95% CI: 0.79–0.86) for the weighted model. On 10-fold cross-validation, the AUC was 0.83 (95% CI: 0.78–0.87).
Multiple Logistic Regression Model to Predict IBI in Febrile Infants
. | Adjusted Odds of IBIa (95% CI) . |
---|---|
Age, d | |
≥21 | Reference |
<21 | 2.07 (1.14–3.76) |
Highest temperature in the ED, °C | |
<38.0 | Reference |
38.0–38.4 | 2.31 (1.08–4.95) |
≥38.5 | 6.57 (3.25–13.29) |
Urinalysis result | |
Normal | Reference |
Abnormalb | 5.71 (3.24–10.06) |
ANC, cells per μL | |
<5185 | Reference |
≥5185 | 3.15 (1.83–5.43) |
. | Adjusted Odds of IBIa (95% CI) . |
---|---|
Age, d | |
≥21 | Reference |
<21 | 2.07 (1.14–3.76) |
Highest temperature in the ED, °C | |
<38.0 | Reference |
38.0–38.4 | 2.31 (1.08–4.95) |
≥38.5 | 6.57 (3.25–13.29) |
Urinalysis result | |
Normal | Reference |
Abnormalb | 5.71 (3.24–10.06) |
ANC, cells per μL | |
<5185 | Reference |
≥5185 | 3.15 (1.83–5.43) |
Adjusted for age, highest temperature recorded in the ED, urinalysis, and ANC, with study site as a fixed effect.
Urine dipstick with positive leukocyte esterase or positive nitrites or urine microscopy with >5 WBCs per high-power filed or >5 WBCs per mm3 on enhanced urinalysis.
Calibration plot for the IBI prediction model with the estimated probability of IBI (x-axis) plotted against the outcome (presence of IBI). The calibration curve (solid line), with a 95% confidence band, overlaps with the diagonal reference line of perfect calibration (hashed line), indicating that the prediction model fit the observed data well.
Calibration plot for the IBI prediction model with the estimated probability of IBI (x-axis) plotted against the outcome (presence of IBI). The calibration curve (solid line), with a 95% confidence band, overlaps with the diagonal reference line of perfect calibration (hashed line), indicating that the prediction model fit the observed data well.
IBI Score
Using the 4 predictors identified in the final model, an IBI score was developed with a range of possible scores of 0 to 10 points (Table 3). Among the 492 infants (90.6% of the sample) for whom data were available for each of the predictors (169 case patients and 323 control patients), the sensitivity and specificity of a score ≥2 were 98.8% (95% CI: 95.8%–99.9%) and 31.3% (95% CI: 26.3%–36.6%), respectively (Table 4). The 2 case patients with fever by history only and a low-risk score of <2 were a 3-day-old and a 40-day-old, both of whom had bacteremia due to Enterococcus spp. Moderate-risk IBI scores of ≥3 and ≥4 had higher specificity (52.0% and 57.3%, respectively) but lower sensitivity (92.9% and 88.2%, respectively). Of 12 infants with IBI who had missing data, 11 (91.7%) had scores ≥2, and one 27-day-old infant with group B streptococcal bacteremia and a missing urinalysis result had a score of 0.
IBI Score
Predictor . | Pointsa . |
---|---|
Age <21 d | 1 |
Highest temperature in the ED 38.0–38.4°C | 2 |
Highest temperature in the ED ≥38.5°C | 4 |
Abnormal urinalysis resultb | 3 |
ANC ≥5185 cells per μL | 2 |
Predictor . | Pointsa . |
---|---|
Age <21 d | 1 |
Highest temperature in the ED 38.0–38.4°C | 2 |
Highest temperature in the ED ≥38.5°C | 4 |
Abnormal urinalysis resultb | 3 |
ANC ≥5185 cells per μL | 2 |
Total possible scores range from 0 to 10.
Urine dipstick with positive leukocyte esterase or positive nitrites or urine microscopy with >5 WBCs per high-power field or >5 WBCs per mm3 on enhanced urinalysis.
Performance Characteristics of the IBI Score for Identification of Febrile Infants With IBI
Points . | Case Patients (N = 169),a n (%) . | Control Patients (N = 323),b n (%) . | IBI Score . | Sensitivity (95% CI) . | Specificity (95% CI) . | LR+ (95% CI) . | LR− (95% CI) . |
---|---|---|---|---|---|---|---|
Low risk | |||||||
0 | 1 (0.6) | 81 (25.1) | ≥1 | 99.4 (96.7–100.0) | 25.1 (20.4–30.2) | 1.33 (1.24–1.41) | 0.02 (0–0.17) |
1 | 1 (0.6) | 20 (6.2) | ≥2 | 98.8 (95.8–99.9) | 31.3 (26.3–36.6) | 1.44 (1.33–1.55) | 0.04 (0.01–0.15) |
Moderate risk | |||||||
2 | 10 (5.9) | 67 (20.7) | ≥3 | 92.9 (87.9–96.3) | 52.0 (46.4–57.6) | 1.94 (1.72–2.18) | 0.14 (0.08–0.24) |
3 | 8 (4.7) | 17 (5.3) | ≥4 | 88.2 (82.3–92.6) | 57.3 (51.7–62.7) | 2.06 (1.80–2.37) | 0.21 (0.14–0.32) |
Higher risk | |||||||
4 | 26 (15.4) | 58 (18.0) | ≥5 | 72.8 (65.4–79.3) | 75.2 (70.2–79.8) | 2.94 (2.38–3.63) | 0.36 (0.28–0.47) |
5 | 20 (11.8) | 30 (9.3) | ≥6 | 60.9 (53.2–68.3) | 84.5 (80.1–88.3) | 3.94 (2.97–5.22) | 0.46 (0.38–0.56) |
6 | 27 (16.0) | 20 (6.2) | ≥7 | 45.0 (37.3–52.8) | 90.7 (87.0–93.6) | 4.84 (3.31–7.08) | 0.61 (0.53–0.70) |
7 | 31 (18.3) | 21 (6.5) | ≥8 | 26.6 (20.1–34.0) | 97.2 (94.8–98.7) | 9.56 (4.79–19.07) | 0.75 (0.69–0.83) |
8 | 4 (2.4) | 0 (0) | ≥9 | 24.3 (18.0–31.4) | 97.2 (94.8–98.7) | 8.71 (4.34–17.48) | 0.78 (0.71–0.85) |
9 | 30 (17.8) | 7 (2.2) | 10 | 6.5 (3.3–11.3) | 99.4 (97.8–99.9) | 10.51 (2.36–46.88) | 0.94 (0.90–0.98) |
10 | 11 (6.5) | 2 (0.6) | — | — | — | — | — |
Points . | Case Patients (N = 169),a n (%) . | Control Patients (N = 323),b n (%) . | IBI Score . | Sensitivity (95% CI) . | Specificity (95% CI) . | LR+ (95% CI) . | LR− (95% CI) . |
---|---|---|---|---|---|---|---|
Low risk | |||||||
0 | 1 (0.6) | 81 (25.1) | ≥1 | 99.4 (96.7–100.0) | 25.1 (20.4–30.2) | 1.33 (1.24–1.41) | 0.02 (0–0.17) |
1 | 1 (0.6) | 20 (6.2) | ≥2 | 98.8 (95.8–99.9) | 31.3 (26.3–36.6) | 1.44 (1.33–1.55) | 0.04 (0.01–0.15) |
Moderate risk | |||||||
2 | 10 (5.9) | 67 (20.7) | ≥3 | 92.9 (87.9–96.3) | 52.0 (46.4–57.6) | 1.94 (1.72–2.18) | 0.14 (0.08–0.24) |
3 | 8 (4.7) | 17 (5.3) | ≥4 | 88.2 (82.3–92.6) | 57.3 (51.7–62.7) | 2.06 (1.80–2.37) | 0.21 (0.14–0.32) |
Higher risk | |||||||
4 | 26 (15.4) | 58 (18.0) | ≥5 | 72.8 (65.4–79.3) | 75.2 (70.2–79.8) | 2.94 (2.38–3.63) | 0.36 (0.28–0.47) |
5 | 20 (11.8) | 30 (9.3) | ≥6 | 60.9 (53.2–68.3) | 84.5 (80.1–88.3) | 3.94 (2.97–5.22) | 0.46 (0.38–0.56) |
6 | 27 (16.0) | 20 (6.2) | ≥7 | 45.0 (37.3–52.8) | 90.7 (87.0–93.6) | 4.84 (3.31–7.08) | 0.61 (0.53–0.70) |
7 | 31 (18.3) | 21 (6.5) | ≥8 | 26.6 (20.1–34.0) | 97.2 (94.8–98.7) | 9.56 (4.79–19.07) | 0.75 (0.69–0.83) |
8 | 4 (2.4) | 0 (0) | ≥9 | 24.3 (18.0–31.4) | 97.2 (94.8–98.7) | 8.71 (4.34–17.48) | 0.78 (0.71–0.85) |
9 | 30 (17.8) | 7 (2.2) | 10 | 6.5 (3.3–11.3) | 99.4 (97.8–99.9) | 10.51 (2.36–46.88) | 0.94 (0.90–0.98) |
10 | 11 (6.5) | 2 (0.6) | — | — | — | — | — |
LR+, positive likelihood ratio; LR−, negative likelihood ratio; —, not applicable.
Twelve case patients with IBI for whom score could not be calculated because of missing data.
Thirty-nine control patients without IBI for whom score could not be calculated because of missing data.
Eighty-one of 169 case patients (47.9%) and 282 of 323 control patients (87.3%) with available data for all the predictors had a normal urinalysis result. Among infants with a normal urinalysis result, the sensitivity of an IBI score ≥2 was 97.5% (95% CI: 91.4%–99.7%), and the specificity was 35.8% (95% CI: 30.2%–41.7%). Among 129 infants with abnormal urinalysis results and available data, the sensitivity of a score ≥4 (ie, abnormal urinalysis result with any additional predictor) was 97.7% (95% CI: 92.0%–99.7%), but the specificity was 9.8% (95% CI: 2.7%–23.1%).
None of the 26 infants with bacterial meningitis had a low-risk IBI score <2. Two infants with meningitis had a moderate-risk score of 2, and none had a score of 3. The infants with scores of 2 both had group B streptococcal bacteremia and meningitis. One infant was a 36-day-old born at 31 weeks’ gestational age with 14% bands on complete blood count, and the other was a 54-day-old with 25% bands. Eight infants with meningitis had abnormal urinalysis results, and all had scores ≥5.
Discussion
In this multicenter study, we derived a highly sensitive clinical score to identify non–ill-appearing febrile infants ≤60 days old at low and moderate probability of IBI. Infants with fever by history only, a normal urinalysis result, and ANC <5185 cells per μL had a low probability of IBI. Because the IBI score does not incorporate results of CSF testing, this score could help clinicians avoid lumbar punctures for these infants.
Commonly cited low-risk criteria (eg, Boston, Philadelphia, and Rochester) risk stratify febrile infants using a combination of demographic, historical, physical examination, and laboratory factors determined by consensus.1,4,–6 The Step-by-Step approach includes predictors with commonly used cutoff values associated with IBI.31,32 The IBI score was derived statistically to find optimal cutpoints for each continuous predictor from a sample that included by far the largest number of non–ill-appearing infants with IBI to date.1,14 Because an IBI score ≥2 had a sensitivity of 98.8%, with a narrow 95% CI of 95.8% to 99.9%, the highly sensitive score has improved precision for the identification of non–ill-appearing febrile infants at low probability of IBI compared with other risk-stratification algorithms that also do not include CSF testing (Rochester, modified Philadelphia, Step-by-Step).9,14
Previous investigations have reported a similar prevalence of IBI among infants febrile in the ED when compared with those with only a history of fever.33,34 However, we observed that infants ≤60 days old with a history of fever, but no recorded fever in the ED, had a low probability of IBI if they additionally had a normal urinalysis result and an ANC <5185 cells per μL. The IBI score is the first algorithm to separately risk stratify infants with fever by history only and can be used to potentially avoid lumbar punctures and hospitalization for these low-risk infants, who are often managed similarly to infants with a measured fever in the ED.1,9,14 Specifically, with an IBI prevalence (or pretest probability) of 2% and a negative likelihood ratio of 0.04 for a score ≥2, infants with a score <2 would have a posttest probability of IBI of 0.08%. Therefore, among 1000 non–ill-appearing febrile infants, only 1 infant will have a score <2 and harbor an IBI, and lumbar punctures and hospitalization could be avoided in the ∼300 infants without IBI who have scores <2. Additionally, although age <21 days was a predictor of IBI, this age cutoff identified only 1 additional infant with IBI. Because neonates ≤28 days old evaluated in the ED routinely undergo CSF testing and admission,15,35 using an IBI score <2 to define low risk could have a significant impact by reducing lumbar punctures and hospitalization in neonates with a low probability of IBI.
Although the sensitivity of an IBI score ≥2 was 98.8%, the specificity (31.3%) is lower than the Rochester criteria (44.5%) and Step-by-Step approach (46.9%)14 although similar to that of the modified Philadelphia criteria (34.5%).9 Using scores of ≥3 or ≥4 increased the specificity to >50%. Although the sensitivities of these score cutoffs were reduced to 93% and 88%, respectively, they are similar to those of other risk-stratification algorithms that do not include CSF testing.9,14 Two infants with a score of 2 had meningitis, although both infants had substantial bandemia, and 1 was also premature. In assessing the need for lumbar puncture in moderate-risk infants, clinicians should weigh the full clinical picture and consider the use of shared decision-making with parents. Additionally, all 8 infants with abnormal urinalysis results and meningitis had scores ≥5. Overall, because of its low specificity and positive likelihood ratio, and because the presence of fever in the ED would achieve a score of 2, the IBI score alone should not be used to determine the need for lumbar puncture in infants with scores ≥2. Rather, a score <2 can be used to identify infants with a history of fever only, who have a low probability of having an IBI, and who may not require CSF testing.
Our study has several limitations. First, although we likely identified all infants with IBI using our search strategy for case patients, our case-control design prohibited the derivation of the IBI score among the entire population of febrile infants without IBI. Second, although we applied weights to the multiple logistic regression analysis to account for the 2% prevalence of IBI among all febrile infants in the population,7 our IBI score should be externally validated before being used in clinical practice. Third, clinical variables such as clinical appearance may not be accurately assessed by using medical records. Fourth, only 26 infants had bacterial meningitis. Nevertheless, our study included a larger number of non–ill-appearing infants with meningitis than previous investigations that derived or validated a prediction model for febrile infants.1,4,–6,14 Fifth, because the prevalence of IBI is higher among ill-appearing infants2 and there is consensus on the management of these infants, we excluded 98 febrile infants who were ill appearing. It is likely that ill appearance would be a significant predictor of IBI, and therefore, our results apply only to non–ill-appearing infants. Sixth, although ∼7% of case patients did not have data available for all predictors, all but 1 of these case patients still had IBI scores ≥2. Lastly, CRP and procalcitonin were obtained in only 22 and 4 infants in our study, respectively, and we were unable to evaluate these laboratory parameters as predictors of IBI. However, this low use of CRP and procalcitonin reflects their lack of availability or use at some hospitals.
Conclusions
A clinical score that includes age, highest temperature recorded in the ED, urinalysis, and ANC can be used by clinicians to identify infants with fever by history only who have a low probability of bacteremia and/or bacterial meningitis. A prospective investigation is needed to externally validate this IBI score.
Dr Aronson conceptualized and designed the study, supervised data collection locally and nationally, performed the data analyses, interpreted the data, drafted the initial manuscript, and critically reviewed and revised the manuscript for important intellectual content; Dr Shabanova contributed to design of the study, performed the data analyses, interpreted the data, and critically reviewed and revised the manuscript for important intellectual content; Dr Shapiro contributed to design of the study, interpreted the data, and critically reviewed and revised the manuscript for important intellectual content; Drs Wang, Nigrovic, Pruitt, DePorre, Leazer, Desai, Sartori, Marble, Rooholamini, McCulloh, Woll, and Balamuth collected local data, interpreted the data, and critically reviewed and revised the manuscript for important intellectual content; Drs Alpern, Shah, Williams, and Browning interpreted the data and critically reviewed and revised the manuscript for important intellectual content; Dr Shah collected local data and critically reviewed and revised the manuscript for important intellectual content; Dr Neuman contributed to conceptualization and design of the study, collected local data, interpreted the data, and critically reviewed and revised the manuscript for important intellectual content; and all authors approved the final manuscript as submitted and agree to be accountable for all aspects of the work.
FUNDING: Supported in part by Clinical and Translational Science Award grants KL2 TR001862 (Drs Aronson and Shapiro) and UL1TR0001863 (Dr Shapiro) from the National Center for Advancing Translational Science, a component of the National Institutes of Health. The content is solely the responsibility of the authors and does not represent the official views of the National Institutes of Health. Funded by the National Institutes of Health (NIH).
Acknowledgments
We acknowledge the following collaborators in the Febrile Young Infant Research Collaborative who collected data and contributed as group authors for this study: Elana A. Feldman, MD (Lucile Packard Children’s Hospital Stanford, Palo Alto, CA); Catherine E. Lumb, BS (University of Alabama at Birmingham School of Medicine, Birmingham, AL); Christine E. Mitchell, BSN (Children’s Hospital of Philadelphia, Philadelphia, PA); and Sarah J. Shin, BSN (Children’s Hospital of Philadelphia, Philadelphia, PA).
References
Competing Interests
POTENTIAL CONFLICT OF INTEREST: Drs Shapiro and Neuman have served as expert witnesses in malpractice cases involving the evaluation of infants with infections; the other authors have indicated they have no potential conflicts of interest to disclose.
FINANCIAL DISCLOSURE: The authors have indicated they have no financial relationships relevant to this article to disclose.
Comments
RE: Performing LP in the Evaluation of the Febrile Young Infant
I read with interest the recently published study1 entitled “A Prediction Model to Identify Febrile Infants ≤60 Days at Low Risk of Invasive Bacterial Infection”. It seeks to determine criteria to accurately identify febrile young infants [FYI] at “acceptably” low risk for serious bacterial infections [SBI]. Criteria do not include performing CSF analysis. Results show that all 26 infants with bacterial meningitis [BM] studied had an IBI Score >2. The authors concluded that “using an IBI Score <2 to define low risk could have a significant impact by reducing lumbar punctures and hospitalization in neonates with a low probability of IBI.”
It is concerning that this recommendation suggests to clinicians that BM risk in the FYI can accurately be determined without CSF analysis, even in those aged younger than 4 weeks old.
There appear to be several shortcomings in methodology that impair accurately reaching this conclusion:
1] Inclusion criteria for study included “non-ill appearing infants”. Yet this determination was not standardized, and it is unclear if grading was performed by experienced attending-level or relatively inexperienced resident physicians. Clinical appearance, although an essential component to the evaluation, is notoriously difficult to accurately grade in the FYI, in large part due to patient neurologic immaturity; a prior study showed that only 3 of 4 FYI with SBI “appeared to be ill” as graded by PEM attending physicians.2 The fact that all 26 infants with BM studied were judged by a physician to be “not ill appearing” supports this.1
2] Traditionally, parental report of having measured fever per rectum is considered indicative of the febrile state; and therefore actionable as such. An IBI Score factor used to recommend eliminating performance of LP is caretaker history of fever/patient afebrile in the ED. Yet this has been shown to lack validity as an accurate distinguisher for a lower risk subset - by a prior study documenting 20% with a history of fever who were afebrile in the ED who then manifested fever per rectum during their subsequent 48 hour hospitalization.3 It is also unclear how many study patients received antipyretics prior to evaluation, and whether a standard number of multiple rectal temperatures were performed during the ED stay.
Another recently published study4 likewise proposed SBI low risk criteria for FYI which did not include CSF analysis [10 patients with BM]. Although ED temperatures are not specified, it is of note that 2 infants with BM met the criteria of normal urinalysis and CBC ANC <4090/mm3.
In both studies, the implication is that a non-LP protocol utilizing surrogate blood test results [CBC ANC, serum procalcitonin] can reliably determine SBI risk [including BM]. Just as one would not solely use ancillary blood test results to determine UTI risk without performing urinalysis, clinicians should remember that the sole method to conclusively diagnose the most serious SBI, namely BM, is CSF analysis. A relatively small sample size of 36 FYI with BM in combining these 2 studies should prompt caution that further analysis with greater patient numbers is essential before recommending eliminating LP in the outpatient evaluation of the FYI.
References
1. Aronson P, Shabanova V, Shapiro E, et al: A Prediction Model to Identify Febrile Infants ≤60 Days at Low Risk of Invasive Bacterial Infection. Pediatrics 2019 Jun 5. pii: e20183604. doi: 10.1542/peds.2018-3604.
2. Bonadio, WA, Hennes, H, Smith, D, et al: Reliability Of Observation Variables In Distinguishing Infectious Outcome Of Febrile Young Infants. Pediatr Infect Dis J 1993;12:111-114.
3. Bonadio WA, Hegenbarth M, Zachariason M: Correlating Reported Fever In Young Infants With Subsequent Temperature Patterns And Rate Of Serious Bacterial Infections. Pediatr Infect Dis J 1990;9:158-160.
4. Kuppermann N, Dayan P, Levine D; et al: A Clinical Prediction Rule to Identify Febrile Infants 60 Days and Younger at Low Risk for Serious Bacterial Infections. JAMA Pediatr 2019;173(4):342-351.