Poor and minority children still lag behind wealthier, white children in vaccination coverage.1,2  Structural, logistic, cultural, and attitudinal barriers contribute to vaccination disparities.3,4  Vaccine hesitancy (VH) is an important attitudinal barrier and a growing challenge.5  We measured VH and its association with child average days undervaccinated (ADU) in English- and Spanish-speaking parents of children aged 2 years in 3 safety-net clinics, describing associations by language, race, and ethnicity.

We surveyed English- and Spanish-speaking parents bringing children aged 2 years to 3 pediatric clinics for well or sick care from August 2019 through February 2020. Parents were eligible if (1) English or Spanish was their first language, (2) their child turned 2 years in the last 12 months, and (3) the child had 1 previous well visit in the last 18 months. We excluded parents of children with medical contraindications to vaccination. A bilingual research assistant recruited dyads in waiting rooms; parents completed the survey on an iPad and received $5. The Colorado Multiple Institutional Review Board approved this study.

We measured parental VH with the Parent Attitudes about Childhood Vaccines (PACV) tool because of its previous validation studies,68  brevity and simplicity, and rigorous Spanish translation.9  We transformed responses into scaled (0–100) and dichotomized (<50 = not hesitant and ≥50 = hesitant) scores, as described in previous validation work.7  We collected parent demographics and extracted child vaccination data from electronic medical records. Our independent variable of interest was parental VH. Our outcome variable was child ADU at age 2 years (ie, 730 days), which calculates the difference between when vaccine doses are given and when they are due and ranges from 0 (immunized on time) to 638 (unvaccinated).10  We compared parents by VH status on independent variables and performed multivariable linear regression analyses to assess parental VH with child ADU associations. For a 2-sided α of .05, power of 0.80, population ADU mean of 36 ± 89,10  VH effect size of 55 ADU,8,9  and parental VH prevalence of 10%,8,9  we estimated needing 259 parents (24 hesitant and 235 not hesitant). Analyses were conducted by using R (R Foundation for Statistical Computing, Vienna, Austria).

Of 293 parents approached, 263 (90%) participated. Two surveys were incomplete, and 6 parents responded twice. In Table 1, we describe our final sample of 255 predominantly Hispanic, English-speaking dyads, stratified by parental VH status. Thirty-three (13%) parents were hesitant; 4 (4%) Spanish-speaking parents were hesitant versus 29 (19%) English-speaking parents (P < .01). PACV item responses also differed by language (Supplemental Table 3). Among all children, the mean ADU at age 2 was 66 days (SD 151). In adjusted analyses, children of English-speaking VH parents had a 114-day greater ADU compared with children of English-speaking non-VH parents (P = .02). Parental VH did not associate with changes in child ADU for Spanish-speaking dyads (P = .61). Children of Black parents (referent to non-Hispanic white) were significantly undervaccinated, independent of parental VH (Table 2).

TABLE 1

Parent Demographics and Mean Child ADU With SD, Stratified by Parental VH Status

VariableParental VH, n (%)P*
Not Hesitant (n = 222)Hesitant (n = 33)
Parent primary language   <.01* 
 English 124 (56) 29 (88) — 
 Spanish 98 (44) 4 (12) — 
Parent relationship to child   .64 
 Mother 199 (90) 29 (88) — 
 Father 12 (5) 3 (9) — 
 Other 11 (5) 1 (3) — 
Parent age   .35 
 <30 106 (48) 19 (58) — 
 ≥30 116 (52) 14 (42) — 
Parent marital status   .48 
 Married and/or living with partner 105 (47) 14 (42) — 
 Other 102 (46) 15 (46) — 
 Prefer not to answer 15 (7) 4 (12) — 
Parent highest education level   .22 
 Less than GED 67 (30) 6 (18) — 
 GED or more 155 (70) 27 (82) — 
Parent yearly income   .06 
 <$25 000 103 (46) 19 (58) — 
 ≥$50 000 13 (6) 3 (9) — 
 Don’t know 65 (29) 3 (9) — 
 Prefer not to answer 41 (19) 8 (24) — 
Child’s insurance   .05 
 Public (eg, Medicaid) 209 (94) 28 (85) — 
 Private 9 (4) 5 (15) — 
 Other 4 (2) 0 (0) — 
Race and/or ethnicitya   <.01* 
 Black 20 (9) 6 (18) — 
 Hispanic 173 (78) 16 (48) — 
 Non-Hispanic white 22 (10) 6 (18) — 
 Other 7 (3) 5 (15) — 
No. children   .48 
 1 51 (23) 10 (30) — 
 ≥2 171 (77) 23 (70) — 
Clinic   .51 
 A 45 (20) 6 (18) — 
 B 81 (37) 16 (48) — 
 C 96 (43) 11 (33) — 
Parent country of origin   <.01* 
 United States 118 (53) 26 (79) — 
 Other 103 (46) 6 (18) — 
 Prefer not to answer 1 (1) 1 (3) — 
Parent lived in shelter since child born   .10 
 Yes 15 (7) 4 (12) — 
 No 206 (93) 28 (85) — 
 Prefer not to answer 1 (1) 1 (3) — 
Parent owns a car   .41 
 Yes 168 (76) 24 (73) — 
 No 52 (23) 8 (24) — 
 Prefer not to answer 2 (1) 1 (3) — 
Child received vaccines out of state   .13 
 Yes 12 (5) 3 (9) — 
 No 209 (94) 29 (88) — 
 Don’t know or not sure 1 (1) 1 (3) — 
Mean (SD) child ADU 51 (131) 167 (224) .01* 
VariableParental VH, n (%)P*
Not Hesitant (n = 222)Hesitant (n = 33)
Parent primary language   <.01* 
 English 124 (56) 29 (88) — 
 Spanish 98 (44) 4 (12) — 
Parent relationship to child   .64 
 Mother 199 (90) 29 (88) — 
 Father 12 (5) 3 (9) — 
 Other 11 (5) 1 (3) — 
Parent age   .35 
 <30 106 (48) 19 (58) — 
 ≥30 116 (52) 14 (42) — 
Parent marital status   .48 
 Married and/or living with partner 105 (47) 14 (42) — 
 Other 102 (46) 15 (46) — 
 Prefer not to answer 15 (7) 4 (12) — 
Parent highest education level   .22 
 Less than GED 67 (30) 6 (18) — 
 GED or more 155 (70) 27 (82) — 
Parent yearly income   .06 
 <$25 000 103 (46) 19 (58) — 
 ≥$50 000 13 (6) 3 (9) — 
 Don’t know 65 (29) 3 (9) — 
 Prefer not to answer 41 (19) 8 (24) — 
Child’s insurance   .05 
 Public (eg, Medicaid) 209 (94) 28 (85) — 
 Private 9 (4) 5 (15) — 
 Other 4 (2) 0 (0) — 
Race and/or ethnicitya   <.01* 
 Black 20 (9) 6 (18) — 
 Hispanic 173 (78) 16 (48) — 
 Non-Hispanic white 22 (10) 6 (18) — 
 Other 7 (3) 5 (15) — 
No. children   .48 
 1 51 (23) 10 (30) — 
 ≥2 171 (77) 23 (70) — 
Clinic   .51 
 A 45 (20) 6 (18) — 
 B 81 (37) 16 (48) — 
 C 96 (43) 11 (33) — 
Parent country of origin   <.01* 
 United States 118 (53) 26 (79) — 
 Other 103 (46) 6 (18) — 
 Prefer not to answer 1 (1) 1 (3) — 
Parent lived in shelter since child born   .10 
 Yes 15 (7) 4 (12) — 
 No 206 (93) 28 (85) — 
 Prefer not to answer 1 (1) 1 (3) — 
Parent owns a car   .41 
 Yes 168 (76) 24 (73) — 
 No 52 (23) 8 (24) — 
 Prefer not to answer 2 (1) 1 (3) — 
Child received vaccines out of state   .13 
 Yes 12 (5) 3 (9) — 
 No 209 (94) 29 (88) — 
 Don’t know or not sure 1 (1) 1 (3) — 
Mean (SD) child ADU 51 (131) 167 (224) .01* 

—, not applicable.

a

By race/ethnicity, our sample had more Hispanic children (74.1%) than in empaneled children aged <18 years at Denver Health (65.2%; n = 61 069). There are proportionately more Black (14.8%), white (12.8%), and other (7.2%) children at Denver Health than those in our sample (10.2%, 11.0%, and 4.7%, respectively). χ2P = .02.

*

P < .05.

TABLE 2

Multivariable Linear Regression Model, Examining the Influence of Several Covariates, Including Parental VH, on the Outcome Variable of Child ADU

VariableLevelChange in ADUsP
Parent languagea hesitancyb Spanish, not hesitant Referent — 
 Spanish, hesitant −8 .61 
 English, not hesitant Referent — 
 English, hesitant +114 .02* 
Parent language Spanish Referent — 
 English +58 <.01* 
Parent age <30 Referent — 
 ≥30 +27 .09 
Parent highest education Less than GED Referent — 
 GED or more +8 .66 
Child’s insurance Public Referent — 
 Private +10 .81 
 Other +46 .50 
Parent race and/or ethnicity Non-Hispanic white Referent — 
 Black +133 .01* 
 Hispanic +60 .04* 
 Other +12 .84 
No. children Referent — 
 ≥2 −4 .90 
Child vaccinated out of statec Yes Referent — 
 No −95 .12 
VariableLevelChange in ADUsP
Parent languagea hesitancyb Spanish, not hesitant Referent — 
 Spanish, hesitant −8 .61 
 English, not hesitant Referent — 
 English, hesitant +114 .02* 
Parent language Spanish Referent — 
 English +58 <.01* 
Parent age <30 Referent — 
 ≥30 +27 .09 
Parent highest education Less than GED Referent — 
 GED or more +8 .66 
Child’s insurance Public Referent — 
 Private +10 .81 
 Other +46 .50 
Parent race and/or ethnicity Non-Hispanic white Referent — 
 Black +133 .01* 
 Hispanic +60 .04* 
 Other +12 .84 
No. children Referent — 
 ≥2 −4 .90 
Child vaccinated out of statec Yes Referent — 
 No −95 .12 

We prespecified covariates of interest: VH status, parent language, parent race and/or ethnicity, parent age, parent education, insurance provider, family size, and child vaccine received out of state. —, not applicable.

a

Parent-preferred language.

b

Language and hesitancy were analyzed by using an interaction term to account for possible differences in the effect of VH by parent-preferred language.

c

Two children were excluded because the participant marked “Don’t Know” for this question.

*

P < .05

In a safety-net system sample, we found VH in 1 in 8 parents of children aged 2 years, with differential impacts by language, race, and ethnicity. In previous studies, researchers described VH in wealthier, privately insured clinics; in our study, we found VH in clinics serving minority, publicly insured, and Spanish-speaking children, with a prevalence (13%) similar to that previously reported (8%–25%).8,9,11  Nearly 1 in 4 Black parents had VH, and Black children aged 2 years were additionally undervaccinated, independent of parental VH. Parental VH should be explored as an important vaccination barrier along with others identified for Black toddlers, such as public insurance, access, distrust of health care, and missed opportunities.1215  Parental VH was not associated with ADU changes among Spanish-speaking families, perhaps because of respeto, the cultural value by which Spanish-speaking parents may deferentially subjugate their concerns to clinical expertise.16  This finding bolsters existing work showing how language and culture impact pediatric care.17 

As a single-site retrospective study of parents of children aged 2 years, our conclusions should be explored in other systems and with other age and language groups. Furthermore, trust between staff and patients may have caused a social desirability bias to participate, and we were unable to recruit dyads who failed to present for care. Still, our work highlights the need to explore VH by language and culture and pursue implementation studies to adapt evidence-based interventions for families in safety-net systems.

We acknowledge Jason Glanz, PhD, and the Kaiser Permanente Institute for Health Research for providing us with the algorithm for ADU and instructing us in its use.

Dr Williams conceptualized and designed the study, drafted the initial manuscript, and reviewed and revised the manuscript; Drs Rice and Lou performed the data analysis, contributed to the methods section of the initial manuscript, and reviewed and revised the manuscript; Drs Federico and O’Leary conceptualized and designed the study and reviewed and revised the manuscript; Drs Bayliss and Hambidge critically reviewed the manuscript for important intellectual content and assisted with manuscript revisions; and all authors approved the final manuscript as submitted and agree to be accountable for all aspects of the work.

FUNDING: Supported by a Denver Health Junior Investigator Pilot grant.

ADU

average days undervaccinated

PACV

Parent Attitudes about Childhood Vaccines

VH

vaccine hesitancy

1
Hill
HA
,
Elam-Evans
LD
,
Yankey
D
,
Singleton
JA
,
Kang
Y
.
Vaccination coverage among children aged 19-35 months - United States, 2017
.
MMWR Morb Mortal Wkly Rep
.
2018
;
67
(
40
):
1123
1128
2
Hill
HA
,
Singleton
JA
,
Yankey
D
,
Elam-Evans
LD
,
Pingali
SC
,
Kang
Y
.
Vaccination coverage by age 24 months among children born in 2015 and 2016 - National Immunization Survey-Child, United States, 2016-2018
.
MMWR Morb Mortal Wkly Rep
.
2019
;
68
(
41
):
913
918
3
Lannon
C
,
Brack
V
,
Stuart
J
, et al
.
What mothers say about why poor children fall behind on immunizations. A summary of focus groups in North Carolina
.
Arch Pediatr Adolesc Med
.
1995
;
149
(
10
):
1070
1075
4
Hambidge
SJ
,
Davidson
AJ
,
Phibbs
SL
, et al
.
Strategies to improve immunization rates and well-child care in a disadvantaged population: a cluster randomized controlled trial
.
Arch Pediatr Adolesc Med
.
2004
;
158
(
2
):
162
169
5
McClure
CC
,
Cataldi
JR
,
O’Leary
ST
.
Vaccine hesitancy: where we are and where we are going
.
Clin Ther
.
2017
;
39
(
8
):
1550
1562
6
Opel
DJ
,
Mangione-Smith
R
,
Taylor
JA
, et al
.
Development of a survey to identify vaccine-hesitant parents: the parent attitudes about childhood vaccines survey
.
Hum Vaccin
.
2011
;
7
(
4
):
419
425
7
Opel
DJ
,
Taylor
JA
,
Mangione-Smith
R
, et al
.
Validity and reliability of a survey to identify vaccine-hesitant parents
.
Vaccine
.
2011
;
29
(
38
):
6598
6605
8
Opel
DJ
,
Taylor
JA
,
Zhou
C
,
Catz
S
,
Myaing
M
,
Mangione-Smith
R
.
The relationship between parent attitudes about childhood vaccines survey scores and future child immunization status: a validation study
.
JAMA Pediatr
.
2013
;
167
(
11
):
1065
1071
9
Cunningham
RM
,
Kerr
GB
,
Orobio
J
, et al
.
Development of a Spanish version of the parent attitudes about childhood vaccines survey
.
Hum Vaccin Immunother
.
2019
;
15
(
5
):
1106
1110
10
Glanz
JM
,
Newcomer
SR
,
Narwaney
KJ
, et al
.
A population-based cohort study of undervaccination in 8 managed care organizations across the United States
.
JAMA Pediatr
.
2013
;
167
(
3
):
274
281
11
Williams
SE
,
Morgan
A
,
Opel
D
,
Edwards
K
,
Weinberg
S
,
Rothman
R
.
Screening tool predicts future underimmunization among a pediatric practice in Tennessee
.
Clin Pediatr (Phila)
.
2016
;
55
(
6
):
537
542
12
Wood
D
,
Donald-Sherbourne
C
,
Halfon
N
, et al
.
Factors related to immunization status among inner-city Latino and African-American preschoolers
.
Pediatrics
.
1995
;
96
(
2 pt 1
):
295
301
13
Daniels
D
,
Jiles
RB
,
Klevens
RM
,
Herrera
GA
.
Undervaccinated African-American preschoolers: a case of missed opportunities
.
Am J Prev Med
.
2001
;
20
(
suppl 4
):
61
68
14
Jamison
AM
,
Quinn
SC
,
Freimuth
VS
.
“You don’t trust a government vaccine”: narratives of institutional trust and influenza vaccination among African American and white adults
.
Soc Sci Med
.
2019
;
221
:
87
94
15
Freimuth
VS
,
Jamison
AM
,
An
J
,
Hancock
GR
,
Quinn
SC
.
Determinants of trust in the flu vaccine for African Americans and Whites
.
Soc Sci Med
.
2017
;
193
:
70
79
16
Flores
G
.
Culture and the patient-physician relationship: achieving cultural competency in health care
.
J Pediatr
.
2000
;
136
(
1
):
14
23
17
Flores
G
,
Abreu
M
,
Schwartz
I
,
Hill
M
.
The importance of language and culture in pediatric care: case studies from the Latino community
.
J Pediatr
.
2000
;
137
(
6
):
842
848

Competing Interests

POTENTIAL CONFLICT OF INTEREST: The authors have indicated they have no potential conflicts of interest to disclose.

FINANCIAL DISCLOSURE: The authors have indicated they have no financial relationships relevant to this article to disclose.

Supplementary data