Video Abstract

Video Abstract

Close modal
BACKGROUND:

US immigration policy changes may affect health care use among Latinx children. We hypothesized that January 2017 restrictive immigration executive actions would lead to decreased health care use among Latinx children.

METHODS:

We used controlled interrupted time series to estimate the effect of executive actions on outpatient cancellation or no-show rates from October 2016 to March 2017 (“immigration action period”) among Latinx children in 4 health care systems in North Carolina. We included control groups of (1) non-Latinx children and (2) Latinx children from the same period in the previous year (“control period”) to account for natural trends such as seasonality.

RESULTS:

In the immigration action period, 114 627 children contributed 314 092 appointments. In the control period, 107 657 children contributed 295 993 appointments. Relative to the control period, there was an immediate 5.7% (95% confidence interval [CI]: 0.40%–10.9%) decrease in cancellation rates among all Latinx children, but no sustained change in trend of cancellations and no change in no-show rates after executive immigration actions. Among uninsured Latinx children, there was an immediate 12.7% (95% CI: 2.3%–23.1%) decrease in cancellations; however, cancellations then increased by 2.4% (95% CI: 0.89%–3.9%) per week after immigration actions, an absolute increase of 15.5 cancellations per 100 appointments made.

CONCLUSIONS:

There was a sustained increase in cancellations among uninsured Latinx children after immigration actions, suggesting decreased health care use among uninsured Latinx children. Continued monitoring of effects of immigration policy on child health is needed, along with measures to ensure that all children receive necessary health care.

What’s Known on This Subject:

Restrictive immigration policy can lead to decreased health care access and use by immigrant children and families. Reports suggest that appointment attendance decreased among Latinx children after the 2017 executive actions on immigration, but this has not been examined quantitatively.

What This Study Adds:

In this study, we show that restrictive immigration executive actions were associated with an increased trend in outpatient appointment cancellations among uninsured Latinx children, potentially reducing access to health care for a highly vulnerable population of children.

Latinx children constitute 25.4% of the US pediatric population.1  Most Latinx children in the United States are citizens, but 10.4 million live in immigrant families, meaning that the child or ≥1 parent was born outside of the United States,2  and 4.5 million live with an adult without legal documentation.3  Restrictive immigration policy can be harmful to Latinx children’s health because of stressors around immigration enforcement and risks associated with detention4  or family separation.5 

Since the 2016 presidential election, emerging immigration policies have been increasingly exclusionary. Multiple executive immigration actions were enacted in January 2017, including increased cooperation on immigration enforcement between local law officers and federal authorities via the 287(g) program. Restrictive immigration policies have previously led to mistrust and avoidance of health care among Latinx patients because of fears of immigration enforcement.611  Although immigrant parents report prioritizing children’s medical care despite heightened fear since the 2016 election, reports from the media and health care providers suggest a “chilling effect” of decreased health care use by Latinx families during this period.1217 

We examined the impact of national immigration policy changes on health care use among children in North Carolina, a state with one of the fastest-growing Latinx populations in the United States. We used a controlled interrupted time series (CITS) design to estimate changes in outpatient appointment attendance rates among Latinx children in the months after the immigration actions were enacted while controlling for seasonality and underlying trends. We hypothesized that all forms of visit nonattendance (no-shows and cancellations) would increase among Latinx children after the immigration actions. With the assumption that uninsured Latinx children are a proxy for undocumented children, we hypothesized that the policies would impact uninsured Latinx children more significantly than children with insurance. Finally, we hypothesized that preventive appointments would be more likely to be missed than acute visits.

Data from outpatient clinics affiliated with 4 health systems in North Carolina (Cone Health, Duke Health, UNC Health Care, and Wake Forest Baptist Health) were included. These systems provide care to children from all 100 counties in North Carolina. The institutional review boards at all institutions approved this study.

We used electronic medical record data from ≥1 clinic per health care system for pediatric appointments scheduled during the 6-month immigration action period (October 2016 to March 2017) and a 6-month control period (October 2015 to March 2016) (Fig 1). Primary care and specialty appointments for children (0–18 years) residing in North Carolina were included. Emergency department, urgent care, perinatal visits, and hospitalizations were excluded.

FIGURE 1

Study timeline depicting 26-week immigration action period (October 2016 to March 2017) and control period (October 2015 to March 2016). Executive actions (intervention) were enacted on January 25, 2017 (week 17). The intervention was simulated in the control period.

FIGURE 1

Study timeline depicting 26-week immigration action period (October 2016 to March 2017) and control period (October 2015 to March 2016). Executive actions (intervention) were enacted on January 25, 2017 (week 17). The intervention was simulated in the control period.

Close modal

A CITS analysis was used to test the hypothesis that visit no-shows and cancellations increased among Latinx children after the implementation of the immigration policies. Appointment outcomes included (1) completion, (2) cancellation, and (3) no-show, defined as the proportion of appointments completed, canceled, and no-showed out of all scheduled appointments in a given week. Standardized volume rates were calculated by summing the total scheduled weekly appointments and dividing by the estimated population of children in North Carolina.18  The policy intervention was the executive immigration actions enacted on January 25, 2017. We included data from October 1, 2016, to March 2017 for the immigration action period and October 2015 to March 2016 for the control period. Participants were defined as Latinx if their self-reported ethnicity was Hispanic or Latinx or their preferred language was Spanish.

In a single-series interrupted time series, a single population is followed longitudinally, and the outcome is compared before and after a given intervention while adjusting for underlying trends in the outcome variable. The major threats to the validity of interrupted time series designs are cointerventions and seasonal trends that may affect the outcome but are not accounted for in the underlying preintervention patterns. In CITS, the control group limits this threat and increase confidence in interpreting effects due to policy change. We included 2 control groups: (1) non-Latinx children during the immigration action period, whose visit attendance would not be impacted by the immigration policies, and (2) Latinx children from the same 6 month period in the previous year to account for seasonal or other temporal trends that might affect visit attendance.

Autoregressive integrated moving average regression was used to account for underlying patterns in weekly visit attendance in the immigration action (2016–2017) and control periods (2015–2016). We assessed both the immediate and gradual effects of the policy changes on visit attendance among Latinx children. In comparisons in which we saw a change in sustained appointment outcome trends after the intervention, we calculated the predicted values of visit attendance for the postintervention period as if the immigration actions were never passed. The predicted appointment outcomes were calculated as if the population followed the preintervention trend but then followed the control group’s postintervention trend. This hypothetical scenario was compared with the observed values of postintervention visit attendance to examine whether actual visit attendance among Latinx children differed from expected values. We report the absolute and relative change in visit attendance associated with immigration actions.

An example of the CITS model is shown below:

Here, time (t) is a continuous variable during the 26 week immigration action and control periods (52 observed outcome time points [weeks]); level is an indicator variable that represents the immigration action (postimmigration action enactment value is 1) or a simulated intervention in the control period; posttrend is an indicator variable that represents the time after the immigration actions (postimmigration action value is 1); and group distinguishes the groups being compared (eg, Latinx children compared with non-Latinx children in the immigration action period). The difference in level change (β6) and difference in trend change (β7) show the immediate and sustained impact of the executive actions, respectively.

We examined potential confounding and effect measure modification due to insurance status and appointment type. Primary care appointments were defined as acute (sick or same day), preventive (well child, physicals, immunizations), or chronic care (follow-up or return) visits. Insurance status, dichotomized as insured or uninsured, was a time-varying confounder and was included in the autoregressive integrated moving average models, except in comparisons among uninsured groups in which insurance status is accounted for as a time-fixed effect by using restriction. After inclusion of the aforementioned variables, addition of further first-order autoregressive (P = 1) and autoregressive moving average (q = 1) components to the model did not change the results substantively and reduced model fit. Therefore, these components were left out of final models.

In exploratory analyses, data were skewed at week 17 in the control period because of a winter storm causing clinic closure across North Carolina. Therefore, we censored week 17 from the final analyses. Additionally, the no-show outcome had an outlier at week 26, so this time point was censored in both time periods when analyzing the no-show outcome.

We included 610 085 appointments for 222 284 children (Table 1). Population characteristics in the immigration action period (314 092 appointments; 114 627 children) and control period (295 993 appointments; 107 657 children) were similar. The percentage of appointments scheduled by Latinx children was similar in the immigration action period (17%) and control period (18%). About 95% of children in each period contributed 1 appointment on a given day, ∼4% contributed 2, and <1% contributed ≥3. In both periods, ∼80% of appointments for Latinx children were covered by public insurance, 8% were covered by private insurance, and 10% were uninsured. Among the appointments by non-Latinx children, ∼45% had private insurance, nearly half had public insurance, and the remaining 7% were uninsured. In both periods, more than two-thirds of appointments were primary care visits for Latinx children, compared with 55% of encounters for non-Latinx children. Among primary care appointments, there was no change in the percentage of acute appointments or preventive appointments scheduled between the 2 periods, with acute appointments accounting for about a third of scheduled primary care appointments among Latinxs and a quarter of primary care appointments among non-Latinxs.

TABLE 1

Characteristics of the Study Population by Latinx Ethnicity and Time Period

CharacteristicAll EncountersLatinxNot Latinx
Immigration action time period (October 2016–March 2017) (n = 314 092 encounters, n = 114 627 individuals)    
 Encounters  52 235 261 857 
 Individuals (n114 627 20 055 94 572 
 Years of age, mean (SD) 7.6 (5.9) 7.3 (5.5) 7.7 (5.9) 
 Insurance status, n (%)    
  Private insurance 122 459 (39.0) 4631 (8.9) 117 828 (45.0) 
  Public insurance 171 875 (54.8) 42 993 (82.3) 128 882 (49.2) 
  Uninsured 19 576 (6.2) 4585 (8.8) 14 991 (5.7) 
 Clinic setting, n (%)    
  Primary care 178 621 (50.6) 34 556 (66.2) 144 065 (55.0) 
  Referral 135 471 (49.4) 17 679 (33.8) 117 792 (45.0) 
 Primary care visit type, n (%)a    
  Acute 42 906 (13.7) 8893 (17.0) 34 013 (13.0) 
  Preventive 67 806 (21.6) 13 487 (25.8) 54 319 (20.7) 
  Chronic disease 48 207 (15.3) 8498 (16.3) 39 709 (15.2) 
Control time period (October 2015–March 2016) (n = 295 993 encounters, n = 107 657 individuals)    
 Encounters  53 683 242 310 
 Individuals, n 107 657 19 988 87 669 
 Years of age, mean (SD) 7.4 (5.9) 6.8 (5.4) 7.5 (5.9) 
 Insurance status, n (%)b    
  Private insurance 109 564 (37.1) 4455 (8.3) 105 109 (43.4) 
  Public insurance 163 248 (55.2) 43 803 (81.6) 119 445 (49.4) 
  Uninsured 22 859 (7.7) 5398 (10.1) 17 461 (7.2) 
 Clinic setting, n (%)    
  Primary care 172 630 (58.3) 37 217 (69.3) 135 413 (55.9) 
  Referral 123 363 (41.7) 16 466 (30.7) 106 897 (44.1) 
 Primary care visit type, n (%)a    
  Acute 41 315 (14.0) 10 182 (19.0) 31 133 (12.8) 
  Preventive 64 796 (21.9) 14 656 (27.3) 50 140 (20.7) 
  Chronic disease 49 861 (16.8) 9333 (17.4) 40 528 (16.7) 
CharacteristicAll EncountersLatinxNot Latinx
Immigration action time period (October 2016–March 2017) (n = 314 092 encounters, n = 114 627 individuals)    
 Encounters  52 235 261 857 
 Individuals (n114 627 20 055 94 572 
 Years of age, mean (SD) 7.6 (5.9) 7.3 (5.5) 7.7 (5.9) 
 Insurance status, n (%)    
  Private insurance 122 459 (39.0) 4631 (8.9) 117 828 (45.0) 
  Public insurance 171 875 (54.8) 42 993 (82.3) 128 882 (49.2) 
  Uninsured 19 576 (6.2) 4585 (8.8) 14 991 (5.7) 
 Clinic setting, n (%)    
  Primary care 178 621 (50.6) 34 556 (66.2) 144 065 (55.0) 
  Referral 135 471 (49.4) 17 679 (33.8) 117 792 (45.0) 
 Primary care visit type, n (%)a    
  Acute 42 906 (13.7) 8893 (17.0) 34 013 (13.0) 
  Preventive 67 806 (21.6) 13 487 (25.8) 54 319 (20.7) 
  Chronic disease 48 207 (15.3) 8498 (16.3) 39 709 (15.2) 
Control time period (October 2015–March 2016) (n = 295 993 encounters, n = 107 657 individuals)    
 Encounters  53 683 242 310 
 Individuals, n 107 657 19 988 87 669 
 Years of age, mean (SD) 7.4 (5.9) 6.8 (5.4) 7.5 (5.9) 
 Insurance status, n (%)b    
  Private insurance 109 564 (37.1) 4455 (8.3) 105 109 (43.4) 
  Public insurance 163 248 (55.2) 43 803 (81.6) 119 445 (49.4) 
  Uninsured 22 859 (7.7) 5398 (10.1) 17 461 (7.2) 
 Clinic setting, n (%)    
  Primary care 172 630 (58.3) 37 217 (69.3) 135 413 (55.9) 
  Referral 123 363 (41.7) 16 466 (30.7) 106 897 (44.1) 
 Primary care visit type, n (%)a    
  Acute 41 315 (14.0) 10 182 (19.0) 31 133 (12.8) 
  Preventive 64 796 (21.9) 14 656 (27.3) 50 140 (20.7) 
  Chronic disease 49 861 (16.8) 9333 (17.4) 40 528 (16.7) 
a

Only specified for visits in the primary care setting (n = 178 621 in immigration action period and 172 630 in control period) that could be categorized as acute (same day or sick), preventive (well child, physicals, immunizations), or chronic (follow-up or return).

b

Missing insurance status: n = 322 (n = 27 Latinx, 295 non-Latinx).

After adjusting for the population size of Latinx children in North Carolina, the rate of appointments scheduled by Latinx children in the immigration action period (537 weekly scheduled visits per 100 000 Latinx children, 95% confidence interval [CI]: 504–570) was similar to the previous year (568 weekly scheduled visits per 100 000 Latinx children, 95% CI: 537–600), (P = 16).

There was no difference in immediate or sustained no-show rates after the enactment of executive immigration actions among Latinx children in the immigration action period compared with Latinx children in the control period (Table 2).

TABLE 2

Appointment Status Among Encounters for Latinx Children After Immigration Actions Were Passed in January 2017 Compared With Encounters for Latinx Children in the Previous Year

Immediate Change After Immigration Actions, % (SE)PSustained Trend Change After Immigration Actions, % (SE)P
No-show ratea 1.6 (1.6) .30 −0.27 (0.25) .29 
Cancellation ratea −5.7 (2.7) .04 0.37 (0.39) .35 
Uninsured no-show rate 4.6 (4.3) .29 −1.4 (0.67) .04 
Uninsured cancellation rate −12.7 (5.3) .02 2.4 (0.77) .003 
Insured no-show rate 1.6 (1.6) .34 −0.16 (0.25) .53 
Insured cancellation rate −5.1 (2.6) .06 0.17 (0.38) .67 
Acute visit no-show ratea 1.7 (2.7) .54 −1.0 (0.43) .02 
Acute visit cancellation ratea −3.3 (2.1) .13 0.36 (0.33) .28 
Chronic visit no-show ratea 3.6 (2.4) .14 0.38 (0.38) .33 
Chronic visit cancellation ratea −5.4 (3.6) .14 0.42 (0.52) .43 
Preventive visit no-show ratea 0.72 (2.5) .80 0.18 (0.44) .69 
Preventive visit cancellation ratea −4.8 (3.7) .19 0.87 (0.53) .11 
Immediate Change After Immigration Actions, % (SE)PSustained Trend Change After Immigration Actions, % (SE)P
No-show ratea 1.6 (1.6) .30 −0.27 (0.25) .29 
Cancellation ratea −5.7 (2.7) .04 0.37 (0.39) .35 
Uninsured no-show rate 4.6 (4.3) .29 −1.4 (0.67) .04 
Uninsured cancellation rate −12.7 (5.3) .02 2.4 (0.77) .003 
Insured no-show rate 1.6 (1.6) .34 −0.16 (0.25) .53 
Insured cancellation rate −5.1 (2.6) .06 0.17 (0.38) .67 
Acute visit no-show ratea 1.7 (2.7) .54 −1.0 (0.43) .02 
Acute visit cancellation ratea −3.3 (2.1) .13 0.36 (0.33) .28 
Chronic visit no-show ratea 3.6 (2.4) .14 0.38 (0.38) .33 
Chronic visit cancellation ratea −5.4 (3.6) .14 0.42 (0.52) .43 
Preventive visit no-show ratea 0.72 (2.5) .80 0.18 (0.44) .69 
Preventive visit cancellation ratea −4.8 (3.7) .19 0.87 (0.53) .11 
a

Adjusted for insurance status.

There was an immediate 5.7% (95% CI: 0.40%–10.9%) decrease in cancellation rates after the immigration actions among all Latinx children in the immigration action period compared with cancellations among all Latinx children in the control period (Table 2). There was no sustained difference in cancellation rates between the 2 periods.

Among uninsured Latinx children in the immigration action period, there was no immediate change in no-show rates after the immigration actions compared with uninsured Latinx children in the control period. The sustained trend in no-show rates decreased by 1.4% (95% CI: 0.10%–2.7%) per week after immigration actions.

There was an immediate 12.7% (95% CI: 2.3%–23.1%) decrease in cancellations after immigration actions compared with uninsured Latinx children in the control period. However, the sustained trend in cancellations among Latinx uninsured children then increased by 2.4% (95% CI: 0.89%–3.9%) per week after immigration actions (Table 2, Fig 2). The observed rate of cancellations for the Latinx uninsured at week 26 in 2017 was higher (33.33%) than predicted (17.79%). By week 26, there was an absolute increase in cancellation of 15.54 visits per 100 appointments made (relative increase of 87%).

FIGURE 2

Percentage of canceled visits among uninsured Latinx patients (0–18 years) in the immigration action period versus control period.

FIGURE 2

Percentage of canceled visits among uninsured Latinx patients (0–18 years) in the immigration action period versus control period.

Close modal

There was no difference in immediate or sustained no-shows or cancellations among insured Latinx children in the immigration action period compared with insured Latinx children in the control period (Table 2, Fig 3).

FIGURE 3

Percentage of canceled visits among uninsured Latinx patients (0–18 years) compared with insured Latinx patients in the immigration action period.

FIGURE 3

Percentage of canceled visits among uninsured Latinx patients (0–18 years) compared with insured Latinx patients in the immigration action period.

Close modal

There was no difference in immediate or sustained no-show or cancellation rates among all Latinx children compared with all non-Latinx children after the immigration actions enactment (Table 3). There was also no difference in attendance rates when comparing uninsured Latinx children to uninsured non-Latinx children after the immigration action enactment (Table 3).

TABLE 3

Appointment Status Among Encounters for Latinx Compared With Non-Latinx Children During the Immigration Action Period (October 2016–March 2017)

Immediate Change After Immigration Actions, % (SE)PSustained Trend Change After Immigration Actions, % (SE)P
No-show ratea 1.3 (1.1) .27 0.029 (0.18) .87 
Cancellation ratea −1.0 (3.0) .74 0.036 (0.43) .93 
Uninsured no-show rate 2.0 (4.0) .61 −0.029 (0.63) .96 
Uninsured cancellation rate −6.3 (5.2) .23 1.3 (0.75) .08 
Insured no-show rate 0.81 (1.2) .51 0.076 (0.19) .69 
Insured cancellation rate −0.71 (2.9) .81 −0.11 (0.42) .80 
Acute visit no-show ratea 1.7 (2.3) .47 −0.36 (0.36) .33 
Acute visit cancellation ratea −0.81 (2.0) .69 0.19 (0.29) .52 
Chronic visit no-show ratea 1.0 (1.8) .57 0.57 (0.28) .05 
Chronic visit cancellation ratea 4.6 (3.1) .15 −0.27 (0.45) .55 
Preventive visit no-show ratea 1.07 (2.4) .66 0.24 (0.38) .54 
Preventive visit cancellation ratea −0.97 (3.3) .77 −0.041 (0.48) .93 
Immediate Change After Immigration Actions, % (SE)PSustained Trend Change After Immigration Actions, % (SE)P
No-show ratea 1.3 (1.1) .27 0.029 (0.18) .87 
Cancellation ratea −1.0 (3.0) .74 0.036 (0.43) .93 
Uninsured no-show rate 2.0 (4.0) .61 −0.029 (0.63) .96 
Uninsured cancellation rate −6.3 (5.2) .23 1.3 (0.75) .08 
Insured no-show rate 0.81 (1.2) .51 0.076 (0.19) .69 
Insured cancellation rate −0.71 (2.9) .81 −0.11 (0.42) .80 
Acute visit no-show ratea 1.7 (2.3) .47 −0.36 (0.36) .33 
Acute visit cancellation ratea −0.81 (2.0) .69 0.19 (0.29) .52 
Chronic visit no-show ratea 1.0 (1.8) .57 0.57 (0.28) .05 
Chronic visit cancellation ratea 4.6 (3.1) .15 −0.27 (0.45) .55 
Preventive visit no-show ratea 1.07 (2.4) .66 0.24 (0.38) .54 
Preventive visit cancellation ratea −0.97 (3.3) .77 −0.041 (0.48) .93 
a

Adjusted for insurance status.

In analyses in which appointment type was considered as an effect measure modifier, compared with no-shows for acute visits among Latinx children in the control period, there was a sustained 1% (95% CI: 0.16%–1.8%) per week decrease in no-show rates for acute appointments among all Latinx children after immigration actions passage in the immigration action period (Table 2).

There was also a sustained 0.57% (95% CI: 0.02%–1.1%) per week increase in no-shows for chronic care appointments among all Latinx children compared with non-Latinx children after the immigration actions (Table 3).

In other analyses in which appointment type was considered, we found no difference in appointment outcomes.

In this analysis of health care use among Latinx children, we found a sustained increase in visit cancellation trends after the 2017 immigration actions among uninsured Latinx children, a unique population that serves as a proxy for undocumented children.19  We did not find a difference in appointment outcomes for insured Latinx children or for non-Latinx children. Our findings suggest that health care use may have decreased among uninsured Latinx children, who may be at greatest risk of immigration enforcement actions because of lack of legal documentation.

The threat of immigration enforcement and restrictive state-level immigration policies has many adverse effects on health care outcomes, including decreased birth weight, poorer mental health, higher rates of emergency care, food insecurity, and cardiovascular risk.2026  Few researchers have examined the impact of the 2017 federal immigration policy changes on the health of children. Researchers in 2 studies described an increase in preterm births among Latina women after the 2016 presidential election.27,28  Additionally, 400 US-born Latinx adolescents experienced increases in anxiety symptoms in the year after the presidential election.29  Our results add to this evidence, describing the negative effects of restrictive federal immigration policies on Latinx children and particularly those lacking legal documentation. Because undocumented immigrants are already at higher risk for worse health outcomes,30,31  these policy changes may magnify existing health disparities.

Appointment attendance for insured Latinx children was unchanged after immigration actions were passed, suggesting that Latinx families with presumably US-born citizen children continued to overcome potential barriers to attend scheduled visits. This is consistent with qualitative data suggesting that immigrant families prioritize children’s medical care despite heightened fear and deportation risk.16  Families may selectively curtail nonessential activities while prioritizing medical appointments9,10  and may exhibit “cautious citizenship” by reducing risk while interacting with institutions.32,33  However, families may perceive the risk as too high when children are not documented, explaining why results differ among uninsured Latinx children. Additionally, because immigration enforcement and anti-immigrant rhetoric have continued to heighten since the study period, stressors such as deportation or detention of family members may eventually spill over to affect US-born insured children in mixed-status families in which parents or caregivers may be undocumented. Previous analyses after similar state-level immigration actions have demonstrated decreased Medicaid use for Latinx patients over time3436  and reduced Special Supplemental Nutrition Program for Women, Infants, and Children participation with perceived deportation risk.37  Importantly, Medicaid enrollment for children in immigrant families had been increasing; however, these gains could be jeopardized by an adverse policy climate, especially as additional federal policy changes further limit access for immigrant families.38,39 

We found an unexpected gradual decrease in no-shows among uninsured Latinx children after immigration actions compared with the previous year. We also found immediate decreases in cancellation rates in the overall Latinx population after immigration actions compared with the previous year but higher immediate cancellation rates specifically in the uninsured Latinx. These findings taken together may be due to complex differences in the behavioral pathways that result in no-shows versus cancellations. Although these pathways are not well studied because most studies of visit attendance focus on no-shows, in a cohort of >40 000 pediatric patients, no-shows and cancellations were found to have distinct predictors.40  In our study, cancellations may have transiently decreased because of concern that canceled appointments might attract negative attention to families in the immediate aftermath of the passage of the executive actions. The gradually increasing cancellation rates could be attributable to rising fear in the face of increasing anti-immigration rhetoric and immigration raids, prompting undocumented families to gradually limit their activities.

No-shows did not increase during the immigration action period and, in fact, slowly decreased among uninsured Latinx children compared with the previous year. Families might have been more fearful of calling attention to themselves by deviating from scheduled appointments. Although cancelling scheduled appointments may be perceived as a low-risk way to curtail activities over time, no-shows may be perceived as riskier for undocumented families. Future work, particularly qualitative research, is needed to unravel the differences in health care use pathways in the face of restrictive immigration policy.

The rate of total appointments scheduled among Latinx children in the immigration action period was unchanged compared with the previous year. This may be in part because the included health systems had undertaken measures to facilitate health care access for children in immigrant families,22  including public reaffirmations of nondiscrimination policy and extensive services for refugees. Such measures may have helped to identify these health systems as safer spaces, partially mitigating families’ fears when scheduling appointments. Additionally, our methods may underestimate changes in appointment rate, because standard rates were calculated by using state population estimates in the denominator rather than Latinx children within the clinics’ catchment area. We also do not have population estimates of subgroups such as uninsured Latinx children, which would have allowed for evaluation of appointment rates in particular groups of interest. Given these potential estimation biases, we might not have captured all changes in scheduled appointment rates.

We used uninsured status of Latinx children as a proxy for undocumented children because most uninsured children in North Carolina would meet income eligibility for public insurance but are unable to enroll if they lack legal documentation status.19,41,42  The inclusion of uninsured children is unique because most population-level studies use administrative databases, which do not include undocumented patients. However, this proxy has limitations. For example, US citizen Latinx children may be uninsured if undocumented parents are fearful of engaging with safety net programs. The uninsured population impacted by immigration policies could therefore include a mix of undocumented children and US-born Latinx children in mixed-status families.

We used a rigorous quasiexperimental study design with robust control groups, which increase certainty that effects on visit attendance were due to immigration policy change rather than other co-occurring events. Although CITS is the gold standard for analyzing the impact of policy change at the population level,43,44  results cannot be used to infer changes in attendance for an individual Latinx child. Additionally, we recognize that the Latinx population includes heterogeneous subgroups who have been in the United States for varying lengths of time. Using electronic medical record data alone, we were not able to consider differential impacts on these subgroups. We had a limited number of weekly data points (26 weeks) in each time period, which may have limited our power to detect changes in visit attendance. The included time period also limits the ability to draw conclusions about trends in health care use beyond the 3 months after the immigration policies were implemented.

With our findings, we suggest a potential decrease in health care use among uninsured Latinx children after the 2017 immigration actions. Although immigration policy changes can have harmful effects on children’s health, policies have the potential to be beneficial, as demonstrated by the favorable effect of Deferred Action for Childhood Arrivals benefits for mothers on the well-being of their children.45  Continued rigorous evaluation of health care access and health outcomes of Latinx children is necessary to ensure that the health and well-being of children is integrated into rapidly evolving immigration policy.46,47 

Dr Cholera conceptualized and designed the study, coordinated data acquisition, conducted the data analysis, and drafted the initial manuscript; Drs Linton and Flower conceptualized and designed the study and reviewed and revised the manuscript; Dr Ranapurwala designed the study, conducted the data analysis, and reviewed and revised the manuscript; Dr Shmuel conducted the data analysis and reviewed and revised the manuscript; Drs Miller-Fitzwater, Best, and Simha contributed to data acquisition and revised the manuscript critically for important intellectual content; and all authors approved the final manuscript as submitted and agree to be accountable for all aspects of the work.

FUNDING: No external funding.

Dr Cholera’s current affiliation is National Clinician Scholars Program, Department of Pediatrics, Duke School of Medicine, and the Margolis Center for Health Policy, Duke University, Durham, North Carolina.

CITS

controlled interrupted time series

CI

confidence interval

1
America’s Children
.
Key National Indicators of Well-Being, 2019
.
Washington, DC
:
U.S. Government Printing Office
;
2019
2
Annie E. Casey Foundation Kids Count Data Center
. 0
3
Passell
JS
,
Cohn
DV
,
Krogstad
JM
,
Gonzalez-Barrera
A
.
As Growth Stalls, Unauthorized Immigrant Population Becomes More Settled
.
2014
4
Linton
JM
,
Griffin
M
,
Shapiro
AJ
;
Council on Community Pediatrics
.
Detention of immigrant children
.
Pediatrics
.
2017
;
139
(
5
):
e20170483
5
Dreby
J
.
U.S. immigration policy and family separation: the consequences for children’s well-being
.
Soc Sci Med
.
2015
;
132
:
245
251
6
Roche
KM
,
Vaquera
E
,
White
RMB
,
Rivera
MI
.
Impacts of immigration actions and news and the psychological distress of U.S. Latino parents raising adolescents
.
J Adolesc Health
.
2018
;
62
(
5
):
525
531
7
Berk
ML
,
Schur
CL
.
The effect of fear on access to care among undocumented Latino immigrants
.
J Immigr Health
.
2001
;
3
(
3
):
151
156
8
Rhodes
SD
,
Mann
L
,
Simán
FM
, et al
.
The impact of local immigration enforcement policies on the health of immigrant Hispanics/Latinos in the United States
.
Am J Public Health
.
2015
;
105
(
2
):
329
337
9
White
K
,
Yeager
VA
,
Menachemi
N
,
Scarinci
IC
.
Impact of Alabama’s immigration law on access to health care among Latina immigrants and children: implications for national reform
.
Am J Public Health
.
2014
;
104
(
3
):
397
405
10
Hacker
K
,
Chu
J
,
Leung
C
, et al
.
The impact of Immigration and Customs Enforcement on immigrant health: perceptions of immigrants in Everett, Massachusetts, USA
.
Soc Sci Med
.
2011
;
73
(
4
):
586
594
11
Perreira
KM
,
Pedroza
JM
.
Policies of exclusion: implications for the health of immigrants and their children
.
Annu Rev Public Health
.
2019
;
40
:
147
166
12
Page
KR
,
Polk
S
.
Chilling effect? Post-election health care use by undocumented and mixed-status families
.
N Engl J Med
.
2017
;
376
(
12
):
e20
13
Steube
A
.
For mothers, immigration enforcement is an unnatural disaster
.
Raleigh News and Observer
.
Marcy 4, 2017
14
Lowrey
A
.
Trump’s anti-immigrant policies are scaring eligible families away from the safety net
.
The Atlantic
.
March 24, 2017
15.
Bazar
E.
Some immigrants, fearful of political climate, shy away from medi-cal.
Kaiser Health News. February 2,
2017
. Available at: https://khn.org/news/some-immigrants-fearful-of-political-climate-shy-away-from-medi-cal/. Accessed April 15, 2020
16.
Artiga
SUP
. Living in an immigrant family in America: how fear and toxic stress are affecting daily life, well-being, & health.
2017
. Available at: https://www.kff.org/disparities-policy/issue-brief/living-in-an-immigrant-family-in-america-how-fear-and-toxic-stress-are-affecting-daily-life-well-being-health/. Accessed November 3, 2019
17
Fleming
PJ
,
Lopez
WD
,
Mesa
H
, et al
.
A qualitative study on the impact of the 2016 US election on the health of immigrant families in Southeast Michigan
.
BMC Public Health
.
2019
;
19
(
1
):
947
18
Annie E. Casey Foundation Kids Count Data Center
.
19
National Immigration Law Center
.
Health care coverage maps. Available at: https://www.nilc.org/issues/health-care/healthcoveragemaps/. Accessed November 6, 2019
20
Potochnick
S
,
Chen
JH
,
Perreira
K
.
Local-level immigration enforcement and food insecurity risk among hispanic immigrant families with children: national-level evidence
.
J Immigr Minor Health
.
2017
;
19
(
5
):
1042
1049
21
Torche
F
,
Sirois
C
.
Restrictive immigration law and birth outcomes of immigrant women
.
Am J Epidemiol
.
2019
;
188
(
1
):
24
33
22
Vargas
ED
,
Ybarra
VD
.
U.S. citizen children of undocumented parents: the link between state immigration policy and the health of Latino children
.
J Immigr Minor Health
.
2017
;
19
(
4
):
913
920
23
Hatzenbuehler
ML
,
Prins
SJ
,
Flake
M
, et al
.
Immigration policies and mental health morbidity among Latinos: a state-level analysis
.
Soc Sci Med
.
2017
;
174
:
169
178
24
Vargas
ED
,
Sanchez
GR
,
Juárez
M
.
Fear by association: perceptions of anti-immigrant policy and health outcomes
.
J Health Polit Policy Law
.
2017
;
42
(
3
):
459
483
25
Torres
JM
,
Deardorff
J
,
Gunier
RB
, et al
.
Worry about deportation and cardiovascular disease risk factors among adult women: the Center for the Health Assessment of Mothers and Children of Salinas study
.
Ann Behav Med
.
2018
;
52
(
2
):
186
193
26
Perreira
KM
,
Ornelas
IJ
.
The physical and psychological well-being of immigrant children
.
Future Child
.
2011
;
21
(
1
):
195
218
27
Gemmill
A
,
Catalano
R
,
Casey
JA
, et al
.
Association of preterm births among US Latina women with the 2016 presidential election
.
JAMA Netw Open
.
2019
;
2
(
7
):
e197084
28
Krieger
N
,
Huynh
M
,
Li
W
,
Waterman
PD
,
Van Wye
G
.
Severe sociopolitical stressors and preterm births in New York City: 1 September 2015 to 31 August 2017
.
J Epidemiol Community Health
.
2018
;
72
(
12
):
1147
1152
29
Eskenazi
B
,
Fahey
CA
,
Kogut
K
, et al
.
Association of perceived immigration policy vulnerability with mental and physical health among US-born Latino adolescents in California
.
JAMA Pediatr
.
2019
;
173
(
8
):
744
753
30
Castañeda
H
,
Holmes
SM
,
Madrigal
DS
,
Young
ME
,
Beyeler
N
,
Quesada
J
.
Immigration as a social determinant of health
.
Annu Rev Public Health
.
2015
;
36
:
375
392
31
Hacker
K
,
Anies
M
,
Folb
BL
,
Zallman
L
.
Barriers to health care for undocumented immigrants: a literature review
.
Risk Manag Healthc Policy
.
2015
;
8
:
175
183
32
Pedraza
FI
,
Nichols
VC
,
LeBrón
AMW
.
Cautious citizenship: the deterring effect of immigration issue salience on health care use and bureaucratic interactions among Latino US citizens
.
J Health Polit Policy Law
.
2017
;
42
(
5
):
925
960
33
Gulbas
LE
,
Zayas
LH
.
Exploring the effects of U.S. Immigration enforcement on the well-being of citizen-children in Mexican immigrant families
.
RSF
.
2017
;
3
(
4
):
53
69
34
Toomey
RB
,
Umaña-Taylor
AJ
,
Williams
DR
,
Harvey-Mendoza
E
,
Jahromi
LB
,
Updegraff
KA
.
Impact of Arizona’s SB 1070 immigration law on utilization of health care and public assistance among Mexican-origin adolescent mothers and their mother figures
.
Am J Public Health
.
2014
;
104
(
suppl 1
):
S28
S34
35
Watson
T
.
Inside the refrigerator: immigration enforcement and chilling effects in Medicaid participation
.
Am Econ J Econ Policy
.
2014
;
6
:
313
338
36
Beniflah
JD
,
Little
WK
,
Simon
HK
,
Sturm
J
.
Effects of immigration enforcement legislation on Hispanic pediatric patient visits to the pediatric emergency department
.
Clin Pediatr (Phila)
.
2013
;
52
(
12
):
1122
1126
37
Vargas
ED
,
Pirog
MA
.
Mixed-status families and wic uptake: the effects of risk of deportation on program use
.
Soc Sci Q
.
2016
;
97
(
3
):
555
572
38
Seiber
EE
,
Goldstein
EV
.
Disappearing Medicaid enrollment disparities for US citizen children in immigrant families: state-level trends from 2008 to 2015
.
Acad Pediatr
.
2019
;
19
(
3
):
333
341
39
Perreira
KM
,
Yoshikawa
H
,
Oberlander
J
.
A new threat to immigrants’ health - the public-charge rule
.
N Engl J Med
.
2018
;
379
(
10
):
901
903
40
Kalb
LG
,
Freedman
B
,
Foster
C
, et al
.
Determinants of appointment absenteeism at an outpatient pediatric autism clinic
.
J Dev Behav Pediatr
.
2012
;
33
(
9
):
685
697
41.
American Academy of Pediatrics
,
Medicaid Factsheet.
Available at: https://downloads.aap.org/AAP/PDF/CHIP%20Fact%20Sheets/federaladvocacy_medicaidfactsheet_northcarolina.pdf. Accessed November 6, 2019
42
National conference of state legislatures.
2017
Immigration Report. Available at: https://www.ncsl.org/research/immigration/2017-immigration-report.aspx. Accessed November 6, 2019
43
Penfold
RB
,
Zhang
F
.
Use of interrupted time series analysis in evaluating health care quality improvements
.
Acad Pediatr
.
2013
;
13
(
suppl 6
):
S38
S44
44
Bernal
JL
,
Cummins
S
,
Gasparrini
A
.
Interrupted time series regression for the evaluation of public health interventions: a tutorial
.
Int J Epidemiol
.
2017
;
46
(
1
):
348
355
45
Hainmueller
J
,
Lawrence
D
,
Martén
L
, et al
.
Protecting unauthorized immigrant mothers improves their children’s mental health
.
Science
.
2017
;
357
(
6355
):
1041
1044
46
Williams
DR
,
Medlock
MM
.
Health effects of dramatic societal events - ramifications of the recent presidential election
.
N Engl J Med
.
2017
;
376
(
23
):
2295
2299
47
Mendoza
FS
,
Cueto
V
,
Lawrence
D
,
Sanders
L
,
Weintraub
D
.
Immigration policy: valuing children
.
Acad Pediatr
.
2018
;
18
(
7
):
723
725

Competing Interests

POTENTIAL CONFLICT OF INTEREST: The authors have indicated they have no potential conflicts of interest to disclose.

FINANCIAL DISCLOSURE: The authors have indicated they have no financial relationships relevant to this article to disclose.