Video Abstract

Video Abstract

Close modal
OBJECTIVES:

Standing orders are an effective way to increase vaccination rates, yet little is known about how pediatricians use this strategy for childhood immunizations. We assessed current use of, barriers to using, and factors associated with use of standing orders for vaccination among pediatricians.

METHODS:

Internet and mail survey from June 2017 to September 2017 among a nationally representative sample of pediatricians. In the principal component analysis of barrier items, we identified 2 factors: physician responsibility and concerns about office processes. A multivariable analysis that included barrier scales and physician and/or practice characteristics was used to identify factors associated with use of standing orders.

RESULTS:

The response rate was 79% (372 of 471); 59% of respondents reported using standing orders. The most commonly identified barriers among nonusers were concern that patients may mistakenly receive the wrong vaccine (68%), concern that patients prefer to speak with the physician about a vaccine before receiving it (62%), and belief that it is important for the physician to be the person who recommends a vaccine to patients (57%). These 3 items also made up the physician responsibility barrier factor. Respondents with higher physician responsibility scores were less likely to use standing orders (risk ratio: 0.59 [95% confidence interval: 0.53–0.66] per point increase). System-level decision-making about vaccines, suburban or rural location, and lower concerns about office processes scores were each associated with use of standing orders in the bivariate, but not the multivariable, analysis.

CONCLUSIONS:

Among pediatricians, use of standing orders for vaccination is far from universal. Interventions to increase use of standing orders should address physicians’ attitudinal barriers as well as organizational factors.

What’s Known on This Subject:

Standing orders are an evidence-based strategy to improve immunization uptake that allows nonphysician personnel to vaccinate patients without physician involvement. Patterns of and barriers to use of standing orders have been described among adult immunization providers but not among pediatricians.

What This Study Adds:

Fifty-nine percent of pediatricians use standing orders for immunizations. Respondents with concerns about physician responsibility for vaccination were less likely to use standing orders. Barriers to use of standing orders included concerns about removing physicians from vaccine communication and about efficiency and errors.

Standing orders for vaccination are defined as protocols allowing nonphysician personnel (eg, nurses, medical assistants) to vaccinate patients without direct involvement of a physician at the time of vaccination.1  Systematic reviews reveal strong evidence that standing orders are an effective strategy for increasing immunization rates2  and are cost-effective.3  Although there are fewer studies of standing orders in pediatric settings,48  the most recent systematic review conducted by the Community Preventive Services Task Force revealed that use of standing orders for childhood immunizations was associated with higher vaccination rates.9  On the basis of this evidence, the Centers for Disease Control and Prevention,10  the Advisory Committee on Immunization Practices,11  the Community Preventive Services Task Force,3,9  the National Vaccine Advisory Committee,12  and the American Academy of Pediatrics (AAP)13  recommend use of standing orders to increase access to and reduce missed opportunities for vaccination among adults and children.

Studies reveal that many adult immunization providers do not use standing orders for immunization despite widespread recommendations for this evidence-based strategy. A nationally representative 2015 survey of obstetrician-gynecologists revealed that 66% of respondents used standing orders for the influenza vaccine and 39% for the tetanus toxoid, reduced diphtheria toxoid, and acellular pertussis, adsorbed vaccine.14  A similar survey of primary care internists and family physicians conducted in 2000 revealed that 33% of respondents used standing orders for influenza or pneumococcal vaccines.15 

Several facilitators of and barriers to use of standing orders for adult immunization have been identified; however, less is known about the pediatric context. In adult practice, including primary care and long-term care facilities, structural factors are both facilitators of (facility ownership, payment sources) and barriers (clinical leadership structure, legal and payment issues) to use of standing orders.16,17  Additional barriers to use of standing orders for adult immunization include challenges determining indications for vaccination, concern about whether standing orders save time,18  and patient and family concerns about whether a vaccination is: recommended by their physician.19  Some electronic medical records (EMRs) include features to incorporate standing orders for immunization; however, little is known about how many practices or health systems use these features.

Standing orders are an evidence-based strategy to increase immunization uptake; therefore, understanding their use is critical to improving immunization delivery in pediatric settings as well. Although pediatric immunization rates are generally higher than adult immunization rates, standing orders may be helpful for pediatric immunizations with lower uptake such as influenza and adolescent vaccines. A national assessment of pediatricians’ use of standing orders is lacking. In this study, we sought to understand current practices and experiences related to use of standing orders among a nationally representative sample of pediatricians. Our objectives were to assess among pediatricians (1) current use of standing orders for vaccination, (2) barriers to use of standing orders, and (3) factors associated with use of standing orders for vaccination.

We conducted an Internet and mail survey on several topics related to childhood vaccination in June 2017 to September 2017 among pediatricians in a sentinel network of members of the AAP who spent ≥50% of their time practicing primary care. The Colorado Multiple Institutional Review Board reviewed and approved the study as exempt research not requiring written informed consent.

We developed this survey as part of the Vaccine Policy Collaborative Initiative, a collaboration with the Centers for Disease Control and Prevention to assess physician attitudes and practices related to vaccination. We developed a national network of pediatricians by recruiting from the AAP membership list and conducted quota sampling to develop a sentinel network of physicians. By using demographic data from the AAP membership list, quotas were established for a representative sample with respect to region (Northeast, South, Midwest, and West), practice location (urban, suburban, and rural), and practice setting (private practice, hospital or clinic, and health maintenance organization).20  A random sample of primary care physicians were selected from the AAP membership list and invited to participate as sentinel physicians for the survey network. After enough physicians had been recruited to meet described quota categories, additional respondents within those full categories were excluded to maintain representativeness of the network. We have shown previously that sentinel network physicians were similar to physicians sampled randomly from the American Medical Association physician database when comparing demographics, practice characteristics, and attitudes about vaccination.20 

Survey items were developed by incorporating barriers to use of standing orders identified in published literature and expert opinion, including from key stakeholders at the AAP. In the survey, standing orders were defined as “a written or verbal policy that persons other than a medical provider, such as a nurse or medical assistant, may consent and vaccinate a person without speaking with the physician or advanced care provider first,” and in such cases, “a vaccine may be given before or after a physician encounter or in the absence of a physician encounter altogether.” Response options for the item measuring use of standing orders were “yes, for all routinely recommended vaccines,” “yes, for some vaccines,” or “no.” We did not assess use of standing orders in greater detail or for individual vaccinations (such as influenza). We used 4-point scales to assess barriers to the use of standing orders (“major barrier” to “not at all a barrier”). A national advisory panel of pediatricians pretested the survey. Then the survey was piloted among 41 other pediatricians and modified on the basis of feedback. The survey instrument is presented in Supplemental Fig 2.

The survey was sent via Internet (link to Web-based survey e-mailed to participants; Verint, Melville, NY [http://www.verint.com]) or by mail on the basis of physician preference. Using methods from previous surveys, we sent the Internet group up to 9 e-mail reminders, followed by 2 reminders sent to nonrespondents by postal mail.21  We sent the mail group an initial mailing, followed by a reminder postcard and up to 2 additional reminders with replacement questionnaires. The mail protocol was patterned on the tailored design method by Dillman et al.22 

We combined Internet and mail survey responses for analyses because studies have demonstrated that respondent attitudes are similar when obtained by either method.2224  We compared respondents with nonrespondents using Student’s t tests, Wilcoxon rank tests, χ2 tests, and Fisher’s exact tests, as appropriate. We conducted a multivariable analysis with the dependent variable of using standing orders for any routinely recommended pediatric vaccination. For this analysis, using standing orders was defined as a response of “yes, for all routinely recommended vaccines,” or “yes, for some vaccines” to the survey item assessing use of standing orders. Independent variables assessed included physician and practice characteristics and responses to questions regarding barriers to use of standing orders.

Barrier items were coded as 0 (not at all a barrier), 1 (minor barrier), 2 (somewhat of a barrier) and 3 (major barrier). To reduce the number of barriers in the multivariable model, a principal components analysis with varimax rotation was performed. Two factors were retained by using the criteria of an eigenvalue ≥1. Three barriers grouped on 1 factor, which we called “physician responsibility” (Cronbach’s α = 0.81; Table 1). Four barriers grouped on another factor, which we called “concerns about office processes” (Cronbach’s α = 0.77). We generated mean scores of the items grouped on each factor and used these scores in the multivariable model. The barrier “in my state, there are restrictions that limit the use of standing orders” was left out of the principal component analysis because it did not clearly assess a personal concern or perception as the other barrier items did, and because we did not have the ability to verify whether responses reflected actual legal restrictions or physicians’ perceptions of such restrictions.

TABLE 1

Multivariable Model Used To Predict Use of Standing Orders for Any Routinely Recommended Vaccines

VariableDo Not Use Standing Orders (n = 148; 41%)Use Standing Orders (n = 214; 59%)Bivariate PMultivariable RR (95% CI)
Male sex, % 35 38 .45 — 
Age, y, mean (SD), median 52 (11), 51 51 (10), 51 .36 — 
Census location, %   .02  
 Urban 61 50  — 
 Suburban or rural 39 50  — 
How are decisions about purchasing and handling of vaccines made? %   .01  
 Our practice makes independent decisions 78 65  — 
 Decisions are made at a larger system level 22 35  — 
No. providers in practice, %   .07  
 1–9 80 71  — 
 ≥10 20 29  — 
Proportion of patients who are insured by Medicaid or CHIP, %   .06  
 0–9 26 18  — 
 ≥10 74 82  — 
Proportion of patients who are Hispanic, %   .20  
 0–24 77 71  — 
 ≥25 23 29  — 
Physician responsibility score, mean (SD) (range 0–3) 1.8 (0.9) 0.8 (0.7) <.0001 0.59 (0.53–0.66) per point increase 
 My concern that my patients would prefer to speak with me about a vaccine before receiving it (major barrier or somewhat of a barrier), % 62 24 <.0001 — 
 My belief that it is important for me to be the person who recommends a vaccine to my patients (major barrier or somewhat of a barrier), % 57 19 <.0001 — 
 My concern that patients may mistakenly receive the wrong vaccine if I do not personally assess their eligibility for vaccination (major barrier or somewhat of a barrier), % 68 20 <.0001 — 
Concerns about office processes score, mean (SD) (range 0–3) 0.9 (0.7) 0.5 (0.5) <.0001 — 
 Our staff members’ discomfort with standing orders because of having to answer questions about vaccines (major barrier or somewhat of a barrier), % 41 13 <.0001 — 
 The extra staff time that it would take to implement standing orders (major barrier or somewhat of a barrier), % 19 <.0001 — 
 My belief that having standing orders is less efficient than not having them (major barrier or somewhat of a barrier), % 22 <.0001 — 
 My belief that it is difficult to change processes around patient flow in my office (major barrier or somewhat of a barrier), % 26 14 .006 — 
In my state, there are restrictions that limit the use of standing orders (major barrier or somewhat of a barrier), % 10 .14 — 
VariableDo Not Use Standing Orders (n = 148; 41%)Use Standing Orders (n = 214; 59%)Bivariate PMultivariable RR (95% CI)
Male sex, % 35 38 .45 — 
Age, y, mean (SD), median 52 (11), 51 51 (10), 51 .36 — 
Census location, %   .02  
 Urban 61 50  — 
 Suburban or rural 39 50  — 
How are decisions about purchasing and handling of vaccines made? %   .01  
 Our practice makes independent decisions 78 65  — 
 Decisions are made at a larger system level 22 35  — 
No. providers in practice, %   .07  
 1–9 80 71  — 
 ≥10 20 29  — 
Proportion of patients who are insured by Medicaid or CHIP, %   .06  
 0–9 26 18  — 
 ≥10 74 82  — 
Proportion of patients who are Hispanic, %   .20  
 0–24 77 71  — 
 ≥25 23 29  — 
Physician responsibility score, mean (SD) (range 0–3) 1.8 (0.9) 0.8 (0.7) <.0001 0.59 (0.53–0.66) per point increase 
 My concern that my patients would prefer to speak with me about a vaccine before receiving it (major barrier or somewhat of a barrier), % 62 24 <.0001 — 
 My belief that it is important for me to be the person who recommends a vaccine to my patients (major barrier or somewhat of a barrier), % 57 19 <.0001 — 
 My concern that patients may mistakenly receive the wrong vaccine if I do not personally assess their eligibility for vaccination (major barrier or somewhat of a barrier), % 68 20 <.0001 — 
Concerns about office processes score, mean (SD) (range 0–3) 0.9 (0.7) 0.5 (0.5) <.0001 — 
 Our staff members’ discomfort with standing orders because of having to answer questions about vaccines (major barrier or somewhat of a barrier), % 41 13 <.0001 — 
 The extra staff time that it would take to implement standing orders (major barrier or somewhat of a barrier), % 19 <.0001 — 
 My belief that having standing orders is less efficient than not having them (major barrier or somewhat of a barrier), % 22 <.0001 — 
 My belief that it is difficult to change processes around patient flow in my office (major barrier or somewhat of a barrier), % 26 14 .006 — 
In my state, there are restrictions that limit the use of standing orders (major barrier or somewhat of a barrier), % 10 .14 — 

CHIP, Children’s Health Insurance Program; CI, confidence interval; —, not applicable.

Characteristics significant at P ≤. 25 in bivariate analyses were tested in multivariable models by using backward elimination, resulting in retention of factors that were significant at P <. 05 in the final model. Risk ratios (RRs) were calculated because of the tendency of odds ratios to overestimate effect sizes when outcomes are common. Calculation of adjusted RRs was conducted by using a log-Poisson model with robust error estimation (SAS PROC GENMOD; SAS Institute, Inc, Cary, NC).

On the basis of published literature showing an association between organizational factors and use of standing orders,16,17  we used Wilcoxon rank tests to compare scores for physician responsibility and concerns about office processes factors between respondents whose practices make decisions about vaccines independently and respondents whose practices make decisions at a larger system level. All analyses were performed by using SAS version 9.4 (SAS Institute, Inc).

The response rate was 79% (372 of 471). Respondents did not differ significantly from nonrespondents by sex, age, number of years in practice, practice setting, urban or rural location, region, or locus of decision-making about vaccines (independent versus larger system level) (Table 2).

TABLE 2

Comparison of Respondents and Nonrespondents

CharacteristicRespondents (n = 372)Nonrespondents (n = 99)P
Provider sex, %   .55 
 Male 37 33  
 Female 63 67  
Setting, %   .71 
 Private practice 80 77  
 Hospital or clinic 17 18  
 HMO  
Census location, %   .79a 
 Urban 55 51  
 Suburban 44 48  
 Rural  
Region, %   .06 
 Midwest 23 18  
 Northeast 22 14  
 South 37 38  
 West 19 29  
Decision-making, %   .63 
 Independent 70 68  
 Larger system level 30 32  
Provider age, y, mean (SD), median 50.9 (10.4), 51.0 50.7 (11.7), 50.0 .85b 
No. providers in practice, mean (SD), median 10.6 (25.5), 6.0 15.1 (51.2), 5.0 .83b 
CharacteristicRespondents (n = 372)Nonrespondents (n = 99)P
Provider sex, %   .55 
 Male 37 33  
 Female 63 67  
Setting, %   .71 
 Private practice 80 77  
 Hospital or clinic 17 18  
 HMO  
Census location, %   .79a 
 Urban 55 51  
 Suburban 44 48  
 Rural  
Region, %   .06 
 Midwest 23 18  
 Northeast 22 14  
 South 37 38  
 West 19 29  
Decision-making, %   .63 
 Independent 70 68  
 Larger system level 30 32  
Provider age, y, mean (SD), median 50.9 (10.4), 51.0 50.7 (11.7), 50.0 .85b 
No. providers in practice, mean (SD), median 10.6 (25.5), 6.0 15.1 (51.2), 5.0 .83b 

HMO, health maintenance organization.

a

Fisher’s exact test.

b

Wilcoxon rank test.

Fifty-nine percent of respondents reported using standing orders in their office, including 36% who use standing orders for all routinely recommended vaccines and 23% who use standing orders for some vaccines.

The most commonly reported barriers to use of standing orders among pediatricians who did not use standing orders were concern that patients may mistakenly receive the wrong vaccine (68% identified as a major barrier or somewhat of a barrier), concern that patients may prefer to speak with the physician about a vaccine before receiving it (62%), and belief that it is important for the physician to be the person who recommends a vaccine to his or her patients (57%). These top 3 barriers remained the same among all respondents and were reported as a major barrier or somewhat of a barrier by 40%, 39%, and 34%, respectively. Responses to additional barrier items are presented in Fig 1.

FIGURE 1

Barriers to use of standing orders (SOs) by respondent use of SOs for vaccination (N = 362). *P < .05 for comparison between “use SOs” and “do not use SOs” (Fisher’s exact test). Total percentages may not equal 100% because of rounding.

FIGURE 1

Barriers to use of standing orders (SOs) by respondent use of SOs for vaccination (N = 362). *P < .05 for comparison between “use SOs” and “do not use SOs” (Fisher’s exact test). Total percentages may not equal 100% because of rounding.

Close modal

In bivariate analyses, several practice characteristics (census location and locus of decision-making about vaccines) and barrier items were associated with use of standing orders for any routinely recommended vaccines (Table 1). In the multivariable model, the only factor retained at P <. 05 was the mean score of items contributing to the physician responsibility barrier factor (RR: 0.59 per point increase; 95% confidence interval: 0.53–0.66).

Wilcoxon rank tests revealed that physician responsibility scores were higher among respondents whose practices make independent decisions about vaccines than among respondents whose practices make larger system-level decisions (P =. 05). There was no association between decision-making level and concerns about office processes scores (P = .27).

In this nationally representative survey of pediatricians, a majority of pediatricians report use of standing orders for at least some vaccines; however, 41% still do not use standing orders for any routinely administered vaccines. Among respondents who did not use standing orders, the most commonly reported barriers were concern that patients may mistakenly receive the wrong vaccine, concern that patients may prefer to speak with a physician before receiving a vaccine, and belief that it is important for the physician to be the person who recommends a vaccine to their patients. In the principal component analysis, these 3 barriers grouped on 1 physician responsibility factor, and the physician responsibility score was the only factor that remained associated with use of standing orders in the multivariable model.

Many survey respondents identified concern that patients might receive the wrong vaccine and concern about removing physicians from the conversation with patients about vaccines as barriers to use of standing orders, and these physician responsibility barriers were associated with decreased use of standing orders. In a study of patients attending obstetrics and gynecology clinics, most patients surveyed were comfortable with the idea of using standing orders for human papillomavirus vaccination.25  In that survey, more patients supported the idea of using standing orders for human papillomavirus vaccination in adults (79%) than in adolescents (43%), suggesting that patient and parent attitudes about use of standing orders for childhood immunizations may differ from attitudes about adult vaccination. That survey also showed that acceptability of standing orders was greater if patients were first told that a provider strongly recommended the vaccine. Physician concern that patients or parents want to speak with the physician before receiving a vaccine may be well founded in some cases but could possibly be mitigated by having another staff member communicate the provider’s strong recommendation for vaccination. Although some pediatricians surveyed indicated the concern that patients would prefer to speak with a physician as a barrier, our survey did not include parents, and so we could not directly assess parental acceptability of standing orders for immunization. Studies showing that standing orders are associated with increased immunization uptake in pediatric settings would imply that standing orders were acceptable to many parents in those studies because more children were vaccinated when standing orders were in place.48  The acceptability of using standing orders for child and adolescent vaccines warrants additional study among parents and patients, noting that attitudes toward adult vaccination practices may not translate to the pediatric setting and that physician concern about parental acceptability may not accurately reflect perceptions among parents.

Working in a practice where decisions about vaccines are made on a system level was associated with use of standing orders in bivariate analyses. This finding is consistent with studies of adult vaccination that have revealed practice-level and organizational factors associated with use of standing orders.1618  Decision-making level was not associated with use of standing orders in our multivariable model; however, pediatricians reporting more independent decision-making about vaccines had higher physician responsibility barrier scores. Perhaps physicians who feel more personal responsibility about their role in vaccination are more likely to choose practice settings where they have more independent decision-making ability. Alternatively, knowing the level of decision-making about vaccines in the practice may influence the amount of personal responsibility that pediatricians feel about their role in vaccine delivery.

Physician concern about patients receiving the wrong vaccine if they did not personally assess eligibility for vaccination was another item within the physician responsibility factor that was associated with decreased use of standing orders. Although there is evidence for the use of standing orders to increase vaccination rates, published studies have not included systematic assessment of errors in vaccine administration under standing orders. Sixty-eight percent of pediatricians who did not use standing orders reported this concern about patients receiving the wrong vaccine as a major barrier” or somewhat of a barrier, compared with only 20% of pediatricians who did use standing orders. The significant difference in perceptions about this barrier suggests that pediatricians who do not use standing orders may overestimate the frequency of vaccination errors or that pediatricians who use standing orders have found ways to prevent such errors. Using the EMR to link standing orders for immunization with decision-support tools regarding immunization eligibility may be one way to address physician concern about the safety and accuracy of standing orders for immunization.

Few respondents (7% overall and 10% of those who did not use standing orders) reported that state restrictions limiting the use of standing orders was a major barrier or somewhat of a barrier to their use in practice. One review of state laws revealed significant variability regarding which types of nonphysician personnel are permitted to perform specific immunization delivery tasks (reviewing immunization status, prescribing vaccines, and administering vaccines independently or under delegated authority).26  In many cases, state law is silent on a particular task for a particular type of health care professional, making implementation of standing orders potentially challenging for practices. Incorporating a more detailed assessment of local legal and regulatory factors may add to the understanding of pediatricians’ use of standing orders and associated barriers.

Pediatricians who did use standing orders reported relatively few barriers. The most common concern was that patients would prefer to speak with their physician about a vaccine before receiving it, and this was identified as a major barrier or somewhat of a barrier by 24% of respondents. Two other items were identified as a major barrier or somewhat of a barrier by 20%, and the remaining items were less frequently endorsed as barriers. In contrast, 7 items were identified as a major barrier or somewhat of a barrier by >20% of respondents who did not use standing orders, including 3 barriers endorsed by >50% of respondents. Further study, potentially by using qualitative methods, is needed to understand the reasons for these differences in barriers and to identify strategies used to overcome perceived barriers.

Uptake of routine childhood immunizations is high compared with uptake of adolescent, adult, and maternal immunizations. Perhaps pediatricians do not view standing orders as necessary for routine childhood vaccines and are less likely to use the strategy for that reason. With this hypothesis in mind, efforts to promote use of standing orders among pediatricians may be more successful by focusing on areas of low vaccine uptake such as influenza or adolescent immunizations.

This study had several limitations. Although we found no difference in demographic and practice characteristics between respondents and nonrespondents, they may have differed in their use of and barriers to use of standing orders. We did not ask pediatricians about the age distribution or the number of patients in their practice, the proportion of their patients who were unvaccinated, or their EMR usage. We surveyed pediatricians for their reported use of standing orders but did not assess actual clinical practice. Neither use of other practice-level strategies to improve immunization (such as reminder and recall) nor differences in the use of standing orders for different specific vaccines were assessed. In addition, we did not verify specific local legal and regulatory factors related to standing orders for vaccination, and so we were not able to robustly interpret responses to the barrier item “in my state, there are restrictions that limit the use of standing orders.” Finally, we did not assess vaccination rates, so we were unable to evaluate whether use of standing orders was associated with higher vaccination rates.

Standing orders are an evidence-based strategy to increase uptake of recommended immunizations, yet >40% of pediatricians surveyed do not use standing orders. More information is needed about the acceptability of standing orders for pediatric vaccinations among patients and parents, although studies revealing improvement in vaccination rates with use of standing orders in pediatric practices suggest that acceptability is not a substantial barrier to success when standing orders are implemented. Future studies to better understand current practices and promote the use of standing orders should address physicians’ concerns related to their personal responsibility for vaccination as well as organizational factors.

We thank Lynn Olson, PhD, and Karen O’Connor (Department of Research, AAP); Arlene Weissman, PhD; and the leaders of the AAP for collaborating in the establishment of the sentinel network in pediatrics. We also thank all pediatricians in the network for participating and responding to this survey.

Dr Cataldi drafted the initial manuscript and reviewed and revised the manuscript; Drs O’Leary, Allison, Hurley, and Crane designed the data collection instruments and reviewed and revised the manuscript; Ms Lindley conceptualized and designed the study, designed the data collection instruments, and reviewed and revised the manuscript; Dr Brtnikova designed the data collection instruments, collected data, and reviewed and revised the manuscript; Ms Beaty designed the data collection instruments, conducted the initial analyses, and reviewed and revised the manuscript; Ms McBurney designed the data collection instruments and collected data; Dr Kempe conceptualized and designed the study, coordinated and supervised data collection, and critically reviewed the manuscript for important intellectual content; and all authors approved the final manuscript as submitted and agree to be accountable for all aspects of the work.

FUNDING: Funded by the Centers for Disease Control and Prevention and administered through the University of Colorado Denver (grant 1U01P000849-02). The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.

AAP

American Academy of Pediatrics

EMR

electronic medical record

RR

risk ratio

1
Centers for Disease Control and Prevention
. In:
Hamborsky
J
,
Kroger
A
,
Wolfe
C
, eds.
Epidemiology and Prevention of Vaccine-Preventable Diseases
, 13th ed.
Washington, DC
:
Public Health Foundation
;
2015
2
Briss
PA
,
Rodewald
LE
,
Hinman
AR
, et al;
Task Force on Community Preventive Services
.
Reviews of evidence regarding interventions to improve vaccination coverage in children, adolescents, and adults
.
Am J Prev Med
.
2000
;
18
(
suppl 1
):
97
140
3
Jacob
V
,
Chattopadhyay
SK
,
Hopkins
DP
,
Murphy Morgan
J
,
Pitan
AA
,
Clymer
JM
;
Community Preventive Services Task Force
.
Increasing coverage of appropriate vaccinations: a community guide systematic economic review
.
Am J Prev Med
.
2016
;
50
(
6
):
797
808
4
Zimmerman
RK
,
Hoberman
A
,
Nowalk
MP
, et al
.
Improving influenza vaccination rates of high-risk inner-city children over 2 intervention years
.
Ann Fam Med
.
2006
;
4
(
6
):
534
540
5
Connors
CM
,
Miller
NC
,
Krause
VL
.
Universal hepatitis B vaccination: hospital factors influencing first-dose uptake for neonates in Darwin
.
Aust N Z J Public Health
.
1998
;
22
(
1
):
143
145
6
Sobel
HL
,
Mantaring
JB
 III
,
Cuevas
F
, et al
.
Implementing a national policy for hepatitis B birth dose vaccination in Philippines: lessons for improved delivery
.
Vaccine
.
2011
;
29
(
5
):
941
945
7
Zweigoron
RT
,
Roberts
JR
,
Levin
M
,
Chia
J
,
Ebeling
M
,
Binns
HJ
.
Influence of office systems on pediatric vaccination rates
.
Clin Pediatr (Phila)
.
2017
;
56
(
3
):
231
237
8
O’Connor
ME
,
Everhart
RM
,
Berg
M
,
Federico
SG
,
Hambidge
SJ
.
Pediatric influenza immunization in an integrated safety net health care system
.
Vaccine
.
2012
;
30
(
19
):
2951
2955
9
Community Preventive Services Task Force
.
Increasing appropriate vaccination: standing orders. 2016. Available at: https://www.thecommunityguide.org/sites/default/files/assets/Vaccination-Standing-Orders.pdf. Accessed January 28, 2019
10
Ezeanolue
E
,
Harriman
K
,
Hunter
P
,
Kroger
A
,
Pellegrini
C
.
General Best Practice Guidelines for Immunization. Best Practices Guidance of the Advisory Committee on Immunization Practices (ACIP)
.
Atlanta, GA
:
Centers for Disease Control and Prevention
;
2017
11
McKibben
LJ
,
Stange
PV
,
Sneller
VP
,
Strikas
RA
,
Rodewald
LE
;
Advisory Committee on Immunization Practices
.
Use of standing orders programs to increase adult vaccination rates
.
MMWR Recomm Rep
.
2000
;
49
(
RR
):
15
16
12
Office of Infectious Diseases and HIV/AIDS Policy, US Department of Health and Human Services
.
The standards for pediatric immunization practice.
2016
. Available at: https://www.hhs.gov/vaccines/nvac/reports-and-recommendations/the-standards-for-pediatric-immunization-practice/index.html. Accessed March 12, 2020.
13
Wood
DL
;
American Academy of Pediatrics Committee on Community Health Services
;
American Academy of Pediatrics Committee on Practice and Ambulatory Medicine
.
Increasing immunization coverage
.
Pediatrics
.
2003
;
112
(
4
):
993
996
14
O’Leary
ST
,
Riley
LE
,
Lindley
MC
, et al
.
Immunization practices of US obstetrician/gynecologists for pregnant patients
.
Am J Prev Med
.
2018
;
54
(
2
):
205
213
15
Szilagyi
PG
,
Shone
LP
,
Barth
R
, et al
.
Physician practices and attitudes regarding adult immunizations
.
Prev Med
.
2005
;
40
(
2
):
152
161
16
Shefer
A
,
McKibben
L
,
Bardenheier
B
,
Bratzler
D
,
Roberts
H
.
Characteristics of long-term care facilities associated with standing order programs to deliver influenza and pneumococcal vaccinations to residents in 13 states
.
J Am Med Dir Assoc
.
2005
;
6
(
2
):
97
104
17
Yonas
MA
,
Nowalk
MP
,
Zimmerman
RK
,
Ahmed
F
,
Albert
SM
.
Examining structural and clinical factors associated with implementation of standing orders for adult immunization
.
J Healthc Qual
.
2012
;
34
(
3
):
34
42
18
Nowalk
MP
,
Nutini
J
,
Raymund
M
,
Ahmed
F
,
Albert
SM
,
Zimmerman
RK
.
Evaluation of a toolkit to introduce standing orders for influenza and pneumococcal vaccination in adults: a multimodal pilot project
.
Vaccine
.
2012
;
30
(
41
):
5978
5982
19
Middleton
DB
,
Fox
DE
,
Nowalk
MP
, et al
.
Overcoming barriers to establishing an inpatient vaccination program for pneumococcus using standing orders
.
Infect Control Hosp Epidemiol
.
2005
;
26
(
11
):
874
881
20
Crane
LA
,
Daley
MF
,
Barrow
J
, et al
.
Sentinel physician networks as a technique for rapid immunization policy surveys
.
Eval Health Prof
.
2008
;
31
(
1
):
43
64
21
Brtnikova
M
,
Crane
LA
,
Allison
MA
,
Hurley
LP
,
Beaty
BL
,
Kempe
A
.
A method for achieving high response rates in national surveys of U.S. primary care physicians
.
PLoS One
.
2018
;
13
(
8
):
e0202755
22
Dillman
DA
,
Smyth
JD
,
Christian
LM
.
Internet, Phone, Mail, and Mixed-Mode Surveys: The Tailored Design Method
, 4th ed.
Hoboken, NJ
:
John Wiley & Sons
;
2014
23
Atkeson
LR
,
Adams
AN
,
Bryant
LA
,
Zilberman
L
,
Saunders
KL
.
Considering mixed mode surveys for questions in political behavior: using the Internet and mail to get quality data at reasonable costs
.
Polit Behav
.
2011
;
33
:
161
178
24
McMahon
SR
,
Iwamoto
M
,
Massoudi
MS
, et al
.
Comparison of e-mail, fax, and postal surveys of pediatricians
.
Pediatrics
.
2003
;
111
(
4 pt 1
):
e299
e303
25
Dempsey
AF
,
Pyrzanowski
J
,
Brewer
S
,
Barnard
J
,
Sevick
C
,
O’Leary
ST
.
Acceptability of using standing orders to deliver human papillomavirus vaccines in the outpatient obstetrician/gynecologist setting
.
Vaccine
.
2015
;
33
(
15
):
1773
1779
26
Stewart
AM
,
Lindley
MC
,
Cox
MA
.
State law and standing orders for immunization services
.
Am J Prev Med
.
2016
;
50
(
5
):
e133
e142

Competing Interests

POTENTIAL CONFLICT OF INTEREST: The authors have indicated they have no potential conflicts of interest to disclose.

FINANCIAL DISCLOSURE: The authors have indicated they have no financial relationships relevant to this article to disclose.

Supplementary data