OBJECTIVES:

Among very low birth weight infants born from January 2015 to December 2017, the Massachusetts statewide quality improvement collaborative aimed to increase provision of (1) any mother’s milk at discharge or transfer from a baseline of 63% to ≥75%, (2) exclusive mother’s milk at discharge or transfer from a baseline of 45% to ≥55%, and (3) to reduce racial and ethnic disparities in provision of mother’s milk.

METHODS:

We used the Institute for Healthcare Improvement Breakthrough Series framework in which our main process measures were receipt of prenatal education regarding human milk education, first milk expression within 6 hours after birth, and any skin-to-skin care on 4 weekly audit days in the first month. We examined changes over time among all very low birth weight infants and for 3 racial and ethnic subgroups (non-Hispanic white, non-Hispanic black, and Hispanic) using control and run charts, respectively.

RESULTS:

Of 1670 infants eligible to receive mother’s milk at 9 hospitals, 43% of their mothers were non-Hispanic white, 19% were non-Hispanic black, 19% were Hispanic, 11% were of other races or ethnicities, and 7% were unknown. Hospital teams conducted 69 interventions. We found improvement in all 3 process measures but not for our main outcomes. Improvements in process measures were similar among racial and ethnic subgroups. Hospitals varied substantially in the rate of any mother’s milk at discharge or transfer according to race and ethnicity.

CONCLUSIONS:

Our collaborative achieved similar improvements in process measures focused within the first month of hospitalization among all racial and ethnic subgroups. Reduction in racial and ethnic disparities in mother’s milk at discharge was not reached. Future efforts will focus on factors that occur later in the hospitalization.

Provision of mother’s milk is recommended for very low birth weight (VLBW; ≤1500 g) infants1 because of its numerous health benefits, including reduced risk of necrotizing enterocolitis,2,4 late-onset bloodstream infections,5 chronic lung disease,6 and improved neurodevelopment.7,9 Despite these robust benefits, provision of any mother’s milk at hospital discharge was only 54% from 2012 to 2016 among VLBW infants or infants <30 weeks’ gestation cared for at US hospitals participating in the Vermont Oxford Network.10 Mothers of VLBW infants face tremendous barriers to making milk throughout the NICU hospitalization. Implementation of hospital breastfeeding practices may help mothers overcome such barriers, including family education,11,12 support of early and frequent milk expression,13,15 and skin-to-skin care.16,17 Hospitals vary widely in the rate of mother’s milk provision and breastfeeding support practices for VLBW infants or infants <30 weeks’ gestation.18,21 

Provision of mother’s milk also varies by maternal race and ethnicity, in which non-Hispanic black18,22,25 and, in some studies, Hispanic18,22 mothers are less likely to provide milk for their VLBW infants or infants <30 weeks’ gestation at the point of discharge, as compared with non-Hispanic white mothers. Racial and ethnic disparities in morbidities of VLBW infants are well recognized.26,29 Therefore, improvement in provision of mother’s milk represents a possible strategy to reduce racial and ethnic disparities in health outcomes of VLBW infants.

Statewide perinatal quality collaboratives (PQCs) are networks of perinatal care providers and public health agencies that join together to improve outcomes for mothers and infants at the state level through the sharing of ideas and data and collaborative quality improvement (QI).30,31 They may be most effective when addressing topics with considerable variability in practices and outcomes.30 Therefore, to assess the potential value of a human milk initiative within our Massachusetts PQC, we examined overall performance and hospital variation in mother’s milk provision among all VLBW infants and within racial and ethnic subgroups. Our baseline Massachusetts data from 2011 to 2014 revealed that the overall rate of any mother’s milk at discharge was 63%, with a range of 46% to 81% among the 9 level 3 NICUs with birth centers. The rate of any mother’s milk at discharge varied widely within racial and ethnic subgroups (31%–63% among non-Hispanic black mothers, 31%–57% among Hispanic mothers, and 44%–80% among non-Hispanic white mothers). A 2014 practice survey of our level 3 NICUs revealed inconsistent approaches to lactation support, staff and family education, and timing of skin-to-skin care. Considering this variability and the important health benefits of mother’s milk for VLBW infants, we launched the Massachusetts Human Milk QI Collaborative, in which we focused on VLBW infants born January 2015 to December 2017. The primary aims were to increase provision of (1) any mother’s milk at discharge or transfer from a baseline of 63% to ≥75%, (2) exclusive mother’s milk at discharge or transfer from a baseline of 45% to ≥55%, and (3) to reduce racial and ethnic disparities in provision of mother’s milk at discharge or transfer by any amount statewide.

Our Massachusetts PQC, the Neonatal Quality Improvement Collaborative (NeoQIC), includes all 10 level 3 NICUs in Massachusetts. All NICUs participated in the Human Milk QI Collaborative from January 2015 to December 2017. Hospital characteristics are shown in Table 1. Other stakeholders included the Massachusetts Department of Public Health, Mother’s Milk Bank Northeast, and Massachusetts Breastfeeding Coalition. Hospital team participation was voluntary with in-kind effort. Teams comprised multidisciplinary staff as well as patient family members.

TABLE 1

Hospital (1–10) Characteristics of Level 3 NICUs in Massachusetts

Hospital Characteristics12345678910
No. births in 2016a 3876 5319 2810 6373 3829 965 3449 1344 4073 
Hospital typeb           
 Academic   
 Teaching          
 Community          
Public insurance for prenatal carea, % 40 21 35b 87 27 26 37 25 49 38 
Race and ethnicity of mothers of VLBW infants, %           
 Non-Hispanic white 47 47 44 11 44 39 32 66 46 53 
 Non-Hispanic black 15 17 12 52 24 14 26 11 16 19 
 Hispanic, any race 28 24 19 26 24 22 23 
 Other race and ethnicity 13 15 15 10 22 
 Missing or unknown 15 21 
Donor milk for VLBW infants offered 
Baby-friendly designated or seeking designation        
% FTE lactation personnelc (inpatient) 2.75 3.35 2.0 3.4 5.9 N/Ad 1.0 5.2 1.0 3.3 
Any NICU-designated lactation personnel      
Hospital Characteristics12345678910
No. births in 2016a 3876 5319 2810 6373 3829 965 3449 1344 4073 
Hospital typeb           
 Academic   
 Teaching          
 Community          
Public insurance for prenatal carea, % 40 21 35b 87 27 26 37 25 49 38 
Race and ethnicity of mothers of VLBW infants, %           
 Non-Hispanic white 47 47 44 11 44 39 32 66 46 53 
 Non-Hispanic black 15 17 12 52 24 14 26 11 16 19 
 Hispanic, any race 28 24 19 26 24 22 23 
 Other race and ethnicity 13 15 15 10 22 
 Missing or unknown 15 21 
Donor milk for VLBW infants offered 
Baby-friendly designated or seeking designation        
% FTE lactation personnelc (inpatient) 2.75 3.35 2.0 3.4 5.9 N/Ad 1.0 5.2 1.0 3.3 
Any NICU-designated lactation personnel      

FTE, full-time equivalent; N/A, not applicable.

a

Obtained from Massachusetts Births 2016 report for all birth hospitals.

b

Obtained from the Center for Health Information and Analysis, Massachusetts Hospital Profiles, 2012–2016.

c

Internationally board-certified lactation consultants or certified lactation counselors.

d

This hospital has no designated lactation personnel FTEs but has staff nurses with internationally board-certified lactation consultants or certified lactation counselor training that work as lactation personnel on most shifts.

For this report, we included only the 9 level 3 birth centers and excluded 1 outborn-only level 4 NICU because virtually all infants cared for there were included in the data collection from other birth centers. From our centralized database, we included 1900 VLBW infants or infants <30 weeks’ gestation and excluded those who died (n = 118; 6%), infants who were ineligible to receive mother’s milk (ie, presumed milk protein allergy) (n = 64; 3%), infants with mothers who were ineligible to provide their own milk (ie, maternal substance abuse, HIV infection, and/or expected adoption or foster care placement) (n = 47; 2%), and when month of birth was missing (n = 1; 0.1%), leaving 1670 (88%) infants for this report (Table 2). This project was determined to be QI and not human subjects research by institutional review boards at NeoQIC leadership team hospitals. All participating hospitals completed a data use agreement with the coordinating center before submitting data.

TABLE 2

Characteristics and Outcomes of Mother-VLBW Infant Dyads Cared for in Level 3 Massachusetts NICUs With Birth Centers, 2015–2017

Exclusion Criterian (%) or Mean (SD)
Total VLBW infants, n 1900 
Infant died after admission, n (%) 118 (6) 
Infant ineligible to receive breast milka, n (%) 64 (3) 
Mother ineligible to provide breast milka, n (%) 47 (2) 
Month of birth unknown, n (%) 1 (0.1) 
Remaining mother-infant dyads for analysis, n (%) 1670 (88) 
Mother and infant characteristics  
 Maternal race and ethnicity, n (%)  
  Hispanic 323 (19) 
  Non-Hispanic white 712 (43) 
  Non-Hispanic black 313 (19) 
  Non-Hispanic Asian 90 (5) 
  Non-Hispanic other race 108 (6) 
  Missing or unknown 124 (7) 
 Infant sex, n (%)  
  Male 808 (48) 
  Female 833 (50) 
  Unknown 29 (2) 
 Plurality, n (%)  
  Singleton 1162 (70) 
  Multiple 473 (28) 
  Unknown or missing 35 (2) 
 Infant birth characteristics, mean (SD)  
  Gestational age, wk 29.1 (2.8) 
  Birth wt, g 1095.1 (290.6) 
  Head circumference, cm 25.9 (2.7) 
  Length at birth, cm 36.5 (3.9) 
Outcome, process, and balancing measures, n (%)  
 Discharge or transfer status  
  Discharged from the hospital 1074 (64) 
  Transferred 581 (35) 
  Unknown or missing 15 (1) 
 Main outcomes: mother’s milk 24 h before discharge or transfer  
  Any 1002 (62) 
  Exclusive 741 (46) 
 Process measures  
  Prenatal consultation with human milk educationb 729 (71) 
  First milk expression ≤6 h after birthc 627 (52) 
  Any skin-to-skin care on day 7, 14, 21, or 28d (35) 
 Other outcomes and balancing measures  
  Any necrotizing enterocolitis, medical or surgical 105 (7) 
  Any late-onset infection, bacterial or fungal 148 (9) 
  Small for gestational agee,f at discharge or transfer 557 (40) 
Hospital growth: weight for gestational age z scoree change from birth until discharge or transfer, mean (SD) −0.54 (0.73) 
Length of stay in days, mean (SD) 59.8 (36.9) 
Exclusion Criterian (%) or Mean (SD)
Total VLBW infants, n 1900 
Infant died after admission, n (%) 118 (6) 
Infant ineligible to receive breast milka, n (%) 64 (3) 
Mother ineligible to provide breast milka, n (%) 47 (2) 
Month of birth unknown, n (%) 1 (0.1) 
Remaining mother-infant dyads for analysis, n (%) 1670 (88) 
Mother and infant characteristics  
 Maternal race and ethnicity, n (%)  
  Hispanic 323 (19) 
  Non-Hispanic white 712 (43) 
  Non-Hispanic black 313 (19) 
  Non-Hispanic Asian 90 (5) 
  Non-Hispanic other race 108 (6) 
  Missing or unknown 124 (7) 
 Infant sex, n (%)  
  Male 808 (48) 
  Female 833 (50) 
  Unknown 29 (2) 
 Plurality, n (%)  
  Singleton 1162 (70) 
  Multiple 473 (28) 
  Unknown or missing 35 (2) 
 Infant birth characteristics, mean (SD)  
  Gestational age, wk 29.1 (2.8) 
  Birth wt, g 1095.1 (290.6) 
  Head circumference, cm 25.9 (2.7) 
  Length at birth, cm 36.5 (3.9) 
Outcome, process, and balancing measures, n (%)  
 Discharge or transfer status  
  Discharged from the hospital 1074 (64) 
  Transferred 581 (35) 
  Unknown or missing 15 (1) 
 Main outcomes: mother’s milk 24 h before discharge or transfer  
  Any 1002 (62) 
  Exclusive 741 (46) 
 Process measures  
  Prenatal consultation with human milk educationb 729 (71) 
  First milk expression ≤6 h after birthc 627 (52) 
  Any skin-to-skin care on day 7, 14, 21, or 28d (35) 
 Other outcomes and balancing measures  
  Any necrotizing enterocolitis, medical or surgical 105 (7) 
  Any late-onset infection, bacterial or fungal 148 (9) 
  Small for gestational agee,f at discharge or transfer 557 (40) 
Hospital growth: weight for gestational age z scoree change from birth until discharge or transfer, mean (SD) −0.54 (0.73) 
Length of stay in days, mean (SD) 59.8 (36.9) 
a

Among the mother-VLBW infant dyads in which the VLBW infant lived.

b

Percent calculated among dyads in which the mother received a prenatal consultation.

c

Percent calculated among dyads in which timing of first milk expression was known.

d

Composite of 4 chart audit days.

e

Less than or equal to 10th percentile for gestational age.

f

Calculated by using Fenton and Kim32 reference.

We used the Institute for Healthcare Improvement Breakthrough Series framework.33 A key driver diagram, including outcome, process, and balancing measures, was decided on collectively in early 2015, in-person meetings were held biannually, and webinars were held quarterly for the purposes of team sharing and delivery of QI education by QI experts. NeoQIC leaders conducted site visits approximately twice for each participating team. Site visits in years 1 to 2 were focused on QI education and propelling local QI work forward. Visits in years 2 to 3 were focused on increasing hospital leadership buy in and fostering collaboration between hospitals. Hospital teams collected data using standard definitions, submitted data to a centralized database, and received quarterly data reports of statewide and local team progress. Hospital names were reported openly at in-person meetings and webinars but were coded by letter for written reports.

Teams conducted interventions focused on key drivers (Table 3). Interventions were tracked by NeoQIC leaders in the form of completed monthly “plan-do-study-act (PDSA) homework” forms and team sharing at in-person meetings and webinars. Teams received detailed feedback on PDSA homework forms and live team sharing events by NeoQIC leaders. Interventions were focused on increasing availability of supplies (eg, colostrum collection kits, breast pumps, and skin-to-skin chairs), updating practice guidelines related to breastfeeding support (eg, skin-to-skin care), increasing staff awareness through education campaigns in which breastfeeding support practices were tracked closely (eg, “kangaroo-a-thons”), and use of automatic electronic medical record orders or visual cues to remind staff of breastfeeding support practices.

TABLE 3

Interventions Reported Formally by Teams and Statewide Leadership

Hospital Team Interventions
Key DriverIntervention Description201520162017Total
Parental education Electronic medical record checklist prompts — — 
 Lactation-specific prenatal consultations — — — 
Early initiation of milk expression Increase availability of “colostrum kits” or supplies (L&D, postpartum, and/or NICU) 12 — 33 
 Use of low-absorption swabs — — — 
 Increase availability of pumps (including postanesthesia care unit)  — — 
 Combined staff education campaigns with postpartum and L&D (eg, “Wee Pump” campaign) — 
 Visual reminders of timing of first pump for staff (cards, bracelets, checklist) — — 
 Automatic oral colostrum care orders in admission order set — — — 
 Automatic lactation consultant orders in admission order set — — 
 Increasing documentation of first milk expression and colostrum delivery — — 
Inadequate continuation of milk expression and skin-to-skin care Staff surveys on skin-to-skin and updating skin-to-skin protocols — 28 
 Family and staff education campaigns (kangaroo-a-thons) — 
 Visual reminders or skin-to-skin eligibility — — 
 Increasing availability of skin-to-skin chairs — — — 
 Increasing documentation of skin-to-skin — — — 
 Increasing availability of pumps (hospital and home) — — — 
 Providing insulated bags for milk transportation — — — 
 Increasing meal vouchers to encourage families to visit NICU — — — 
 Create and enhance family support groups — — — 
 Scheduled lactation visits at 28 d — — — 
 Lactation consultant tracking of visits or phone calls — — — 
 Campaigns to pump at the bedside and closing pump rooms — — — 
Transition to direct breastfeeding in the hospital and home Update guidelines on nonnutritive sucking and direct breastfeeding — — 
 Establish postdischarge lactation support groups specific to NICU mothers — — — 
Other Update guidelines on milk storage — — 
 Adding numbered stickers to frozen milk so that it is used in the order in was expressed or stickers to indicate colostrum — — 
 Statewide Interventions     
Addressing racial and ethnic disparities Created 4 multicultural education handouts for families in 9 languages; https://www.neoqicma.org/human-milk-educational-materials — — — 
Created 10 multicultural education videos for families, 5 in English and 5 in Spanish (released 2018); https://www.neoqicma.org/human-milk-educational-videos — — — — 
 Qualitative interviews with non-Hispanic black and Hispanic mothers — — — 
Hospital Team Interventions
Key DriverIntervention Description201520162017Total
Parental education Electronic medical record checklist prompts — — 
 Lactation-specific prenatal consultations — — — 
Early initiation of milk expression Increase availability of “colostrum kits” or supplies (L&D, postpartum, and/or NICU) 12 — 33 
 Use of low-absorption swabs — — — 
 Increase availability of pumps (including postanesthesia care unit)  — — 
 Combined staff education campaigns with postpartum and L&D (eg, “Wee Pump” campaign) — 
 Visual reminders of timing of first pump for staff (cards, bracelets, checklist) — — 
 Automatic oral colostrum care orders in admission order set — — — 
 Automatic lactation consultant orders in admission order set — — 
 Increasing documentation of first milk expression and colostrum delivery — — 
Inadequate continuation of milk expression and skin-to-skin care Staff surveys on skin-to-skin and updating skin-to-skin protocols — 28 
 Family and staff education campaigns (kangaroo-a-thons) — 
 Visual reminders or skin-to-skin eligibility — — 
 Increasing availability of skin-to-skin chairs — — — 
 Increasing documentation of skin-to-skin — — — 
 Increasing availability of pumps (hospital and home) — — — 
 Providing insulated bags for milk transportation — — — 
 Increasing meal vouchers to encourage families to visit NICU — — — 
 Create and enhance family support groups — — — 
 Scheduled lactation visits at 28 d — — — 
 Lactation consultant tracking of visits or phone calls — — — 
 Campaigns to pump at the bedside and closing pump rooms — — — 
Transition to direct breastfeeding in the hospital and home Update guidelines on nonnutritive sucking and direct breastfeeding — — 
 Establish postdischarge lactation support groups specific to NICU mothers — — — 
Other Update guidelines on milk storage — — 
 Adding numbered stickers to frozen milk so that it is used in the order in was expressed or stickers to indicate colostrum — — 
 Statewide Interventions     
Addressing racial and ethnic disparities Created 4 multicultural education handouts for families in 9 languages; https://www.neoqicma.org/human-milk-educational-materials — — — 
Created 10 multicultural education videos for families, 5 in English and 5 in Spanish (released 2018); https://www.neoqicma.org/human-milk-educational-videos — — — — 
 Qualitative interviews with non-Hispanic black and Hispanic mothers — — — 

Obtained through team reporting on monthly PDSA homework forms or live team sharing events. L&D, labor and delivery; —, not applicable.

Regarding racial and ethnic disparities, given limited racial and ethnic differences in process and outcome measures in year 1, we sought to determine more targeted interventions in years 2 and 3. We conducted in-depth qualitative interviews with non-Hispanic black and Hispanic mothers at 2 hospitals to better understand facilitators and barriers to prolonged lactation.34 Relevant facilitators included perceptions of strong practical and emotional support by NICU staff when delivered in a racially and ethnically unbiased manner in the mother’s primary language. Follow-up interventions included examination of variation in NICU family and breastfeeding support groups across hospitals and creation or enhancement of such groups. Relevant barriers included difficulties with NICU visitation due to transportation issues, sibling care, return to work, and exhaustion with pumping. Follow-up interventions included examination of variation in sibling visitation policies, parking costs, difficulty with hospital-grade pump acquisition, and meals for mothers. In response, teams increased lactation education and support (by phone or in person) and provided meal vouchers for breastfeeding mothers. The NeoQIC leadership team also created multicultural, multilingual family education materials that were available for team members (https://www.neoqicma.org/educational-materials).

Infant feeding information was abstracted from the medical record every 1 to 2 weeks and the 24 hours before discharge or transfer by using the following standard definitions: (1) exclusive mother’s milk (100% of “base” milk was from the mother, with or without a fortifier [bovine or human]), (2) any mother’s milk (any amount of mother’s milk, with or without the addition of donor milk, formula, and/or any fortifier), and (3) no mother’s milk (donor milk, formula, and/or bovine fortifier only). We considered provision of mother’s milk to occur when the infant was fed milk from the infant’s own mother, not donor milk. Our main outcomes were any and exclusive mother’s milk in the 24 hours before the initial disposition, which was either discharge from the hospital or transfer to another hospital for ongoing care. This measure mimics the human milk measure used by the Vermont Oxford Network, which has been widely used in QI and research publications.10,18,26,35,37 

Process measures included the following: (1) prenatal consultation with human milk education (which was mention of “human milk,” “breast milk,” “mother’s milk,” “mother’s own milk,” or “breastfeeding”) benefits in a written prenatal consultation note, by physicians or nurse practitioners only, among mothers who received prenatal consultations (yes or no); (2) first milk expression within 6 hours of birth, either by hand expression or pumping (yes or no); and (3) any skin-to-skin care with the mother on days of life 7, 14, 21, or 28 (yes or no).

Other outcomes were presence of medical or surgical necrotizing enterocolitis (yes or no) or late-onset bacterial or fungal sepsis (yes or no) per Vermont Oxford Network definitions38 and length of stay. Balancing measures were percent small for gestational age (<10th percentile) at discharge or transfer and infant growth over the course of the hospitalization, defined as birth weight for gestational age z score change, by using the sex-specific Fenton and Kim32 growth curves. Maternal race and ethnicity was categorized as non-Hispanic white, non-Hispanic black, and Hispanic of any race (which we hereafter refer to as white, black, and Hispanic, respectively), as well as other race and ethnicity, and unknown race and ethnicity.

Statistical process control charts were used to analyze monthly performance over time for the main outcome and process measures as well as additional outcome and balancing measures of length of stay and growth. Run charts were used to analyze quarterly performance over time for those measures with small sample sizes or rare outcomes, including the main outcomes and process measures by racial and ethnic subgroups and necrotizing enterocolitis and late-onset sepsis for the overall population. In a post hoc analysis, we used control charts to examine the secondary outcome measure of mother’s milk provision at 28 days after birth.

Control charts were created and analyzed by using established methods; initial limits were created after 20 data points and were then fixed or adjusted on the basis of the presence or absence of special cause variation and expected persistence of system change.39 Rules for determining special cause included the following: (1) a single point outside the control limits, (2) a run of 8 or more points in a row above or below the centerline, (3) 6 consecutive points increasing (trend up) or decreasing (trend down), (4) 2 out of 3 consecutive points near (outer one-third) a control limit, and (5) 15 consecutive points close (inner one-third of the chart) to the centerline.39 Because run charts had only 12 data points, centerlines were not adjusted on the basis of the presence of signal, given limited ability to assess persistence of change. We examined rates of any mother’s milk according to racial and ethnic subgroups at 1- to 2-week intervals during the hospitalization and hospital variation in racial and ethnic disparities using χ2 tests. We determined the coefficient of variation of race and ethnicity across hospitals in any mother’s milk at discharge. QI charts in Excel and SAS 9.4 (SAS Institute, Inc, Cary, NC) were used to conduct this analysis.

Our key driver diagram was updated throughout the collaborative, and the final version is presented in Supplemental Fig 5. Attendance at collaborative-wide webinars and in-person meetings was high, with ≥8 of 10 teams participating at each webinar and in-person meeting. One hospital collected data in year 1 only, and the rest collected data for all 3 years. Overall, 69 interventions were conducted. Team sharing was focused on prenatal education for year 1, first milk expression in all 3 years, and skin-to-skin care mostly in years 2 and 3 (Fig 1).

FIGURE 1

Process measures. Red star denotes that team sharing or a speaker directly addressed this topic. Blue star denotes an in-person meeting. A, Prenatal human milk education. B, First milk expression ≤6 hours of birth. C, Any skin-to-skin in first month (skin-to-skin was examined on day 7, 14, 21, and 28). LCL, lower confidence limit; UCL, upper confidence limit; Q1–Q12, quarter 1 through quarter 12.

FIGURE 1

Process measures. Red star denotes that team sharing or a speaker directly addressed this topic. Blue star denotes an in-person meeting. A, Prenatal human milk education. B, First milk expression ≤6 hours of birth. C, Any skin-to-skin in first month (skin-to-skin was examined on day 7, 14, 21, and 28). LCL, lower confidence limit; UCL, upper confidence limit; Q1–Q12, quarter 1 through quarter 12.

Close modal

In our analysis of 1670 infants, 1637 were ≤1500 g and 33 were >1500 g and <30 weeks. We found improvements in all 3 of our main process measures (Fig 1). Prenatal human milk education increased from 57.6% to 76.6%, first milk expression within 6 hours increased from 36.6% to 57.1%, and any skin-to-skin care in the first month increased from 31.2% to 39.0%. We found no change in any or exclusive mother’s milk at discharge or transfer (63.7% and 46.4%, respectively) (Fig 2) nor did we find changes in any necrotizing enterocolitis, late-onset sepsis, weight for gestational age z score change (growth), or length of stay (Supplemental Fig 6).

FIGURE 2

Main outcomes. Red star denotes an event in which vulnerable breastfeeding populations, racial and ethnic disparities, and family engagement were directly addressed. Blue star denotes an in-person meeting. A, Any mother’s milk at discharge or transfer. B, Exclusive mother’s milk at discharge or transfer. LCL, lower confidence limit; UCL, upper confidence limit; Q1–Q12, quarter 1 through quarter 12.

FIGURE 2

Main outcomes. Red star denotes an event in which vulnerable breastfeeding populations, racial and ethnic disparities, and family engagement were directly addressed. Blue star denotes an in-person meeting. A, Any mother’s milk at discharge or transfer. B, Exclusive mother’s milk at discharge or transfer. LCL, lower confidence limit; UCL, upper confidence limit; Q1–Q12, quarter 1 through quarter 12.

Close modal

Improvement ofprocess measures (Fig 1) and any mother’s milk for the first 3 weeks of hospitalization (Fig 3) did not differ among racial and ethnic subgroups. Disparities in mother’s milk emerged after week 3, such that, at the point of discharge or transfer, 69% of white mothers, 53% of black mothers, and 48% of Hispanic mothers provided any mother’s milk (P < .001) (Fig 3). Regarding the disparity between black and white mothers, white mothers had higher rates of mother’s milk provision compared with black mothers at discharge among all hospitals, but the degree of disparity between black and white mothers varied dramatically by hospital (2%–39% difference, median 16%) (Fig 4). Regarding the disparity between Hispanic and white mothers, white mothers had higher rates of mother’s milk provision compared with Hispanic mothers at all hospitals except hospital C. The degree of disparity between Hispanic and white mothers, among the 8 hospitals where white mothers had higher rates of mother’s milk provision compared with Hispanic mothers, varied from 9% to 48%, with a median of 15% (Fig 4). The coefficient of variation of race and ethnicity performance within hospitals was 26.6 among black mothers, 28.3 among Hispanic mothers, and 21.4 among white mothers, indicating substantial variation in racial and ethnic subgroups between hospitals.

FIGURE 3

Any mother’s milk provision over time according to race and ethnicity at all Massachusetts level 3 birth centers (according to day of hospitalization). The χ2P values are shown.

FIGURE 3

Any mother’s milk provision over time according to race and ethnicity at all Massachusetts level 3 birth centers (according to day of hospitalization). The χ2P values are shown.

Close modal
FIGURE 4

Centers ranked lowest to highest on overall rate of any mother’s milk at discharge or transfer. Hospital variation in provision of any mother’s milk at discharge or transfer according to maternal race and ethnicity is shown.

FIGURE 4

Centers ranked lowest to highest on overall rate of any mother’s milk at discharge or transfer. Hospital variation in provision of any mother’s milk at discharge or transfer according to maternal race and ethnicity is shown.

Close modal

We performed a post hoc analysis of any and exclusive mother’s milk provision at day 28 to determine if improvements in mother’s milk provision occurred earlier in the hospitalization than discharge; we did not find any change at day 28.

In a population-level Massachusetts PQC composed of all 10 level 3 NICUs, we tracked individual-level data on 1670 mother–VLBW infant dyads over 3 years. We found significant improvements in key hospital-based breastfeeding support practices focused on the first month of life that were similar among racial and ethnic subgroups. However, racial and ethnic disparities in provision of mother’s milk emerged after the first 3 weeks of hospitalization in our state. Although we did not find improvements in our main outcome or provision of mother’s milk at discharge or transfer, numerous aspects of our initiative can inform other hospitals and PQCs seeking to address similar goals.

We were pleased to find strong and sustained engagement from Massachusetts NICUs during the project time period, as evidenced by ongoing interventions, data submission, and ≥80% team participation in all webinars and in-person conferences, despite ongoing disrupting events such as changes in leadership, team lead absences, and electronic medical record rollouts. Numerous factors contributed to strong engagement, including the recognized importance of mother’s milk for VLBW infants and structure of PQC initiatives. Teams greatly appreciated the open sharing of data and ideas and receipt of basic QI education, which propelled their local work. The multidisciplinary teams also contributed to engagement, in which different disciplines championed different aspects of the work.

Across the state, significant improvements were noted in key process measures, prenatal human milk education, first milk expression within 6 hours after birth, and skin-to-skin care in the first month of life. Although these are important improvements in and of themselves, the lack of improvement in our main outcome measure of mother’s milk provision at discharge is notable and important. Several factors likely contributed to this inconsistency. First, it is possible that the magnitude of the improvements in our process measures were not great enough to yield improvement in mother’s milk provision at discharge. Next, we chose prenatal education,11 first milk expression within 6 hours,13,14 and skin-to-skin care40 as process measures because they are recommended in national nursing guidelines41 and have been associated with increased duration of mother’s milk provision until hospital discharge; however, many of the studies used to inform these guidelines are observational and/or from single centers, raising concerns of generalizability to NICUs in Massachusetts. We speculate that our process measures (focused on the early part of the hospitalization) may not have led to sustained improvements in mother’s milk provision until discharge in our state. Additionally, teams prioritized their interventions on key drivers differently; this variability may have limited the greater success of the collaborative as a whole. Finally, the baseline rate of any mother’s milk provision at discharge in Massachusetts was much higher than national rates,10 which may have made it more difficult to achieve further improvement. A previous California human milk collaborative of 11 hospitals started from a baseline rate of 55% any mother’s milk at discharge and improved to 64% in the postintervention period, using many of the same improvement strategies as our Massachusetts collaborative.19 California’s postintervention rate matches our Massachusetts baseline. Factors that impact mother’s milk for the duration of the NICU course are complex; processes driving improvement among hospitals that are below the national average may be different from those starting above average.

Reflecting on the efficacy of interventions our teams trialed, we have many “lessons learned.” Regarding prenatal education, prenatal consultation checklists in the electronic medical record were highly effective, especially in settings where trainees primarily perform prenatal consultations. Regarding early initiation, increasing accessibility of supplies (pumps and colostrum expression kits) and incorporating early milk expression support into the labor and delivery and postpartum nursing workflow were highly effective. Regarding continuation of milk production and skin-to-skin care, staff and family education campaigns with close tracking of skin-to-skin care and use of visual reminders for skin-to-skin eligibility, like crib cards, were successful in the short-term. Focusing on nursing staffing barriers and attitudes toward parent engagement in skin-to-skin care was helpful, whereas focusing on nursing knowledge of skin-to-skin care benefits was less helpful. Other successful interventions included pumping at the bedside (versus separate room), breastfeeding support groups, and meal vouchers.

To our knowledge, no previous human milk PQC focused on VLBW infants has made reducing racial and ethnic disparities a main aim of their project. We felt that clearly defining this goal and tracking all metrics by maternal race and ethnicity was critical because it greatly increased awareness of disparities in health outcomes within the Massachusetts PQC community. Among our teams, the open labeling of hospital names was well received and sparked conversation about the possible etiologies of the variation in racial and ethnic disparities between hospitals. When we conceived the project, we hypothesized that our key drivers would vary by maternal race and ethnicity and that focusing on reducing disparities in these key drivers would lead to reduction in racial and ethnic disparities in mother’s milk provision at discharge or transfer. This did not prove to be true. There were minimal differences by race and ethnicity in our key drivers, other than reduced skin-to-skin care among Hispanic mothers, compared with non-Hispanic white mothers.22 We examined our data in more depth in the beginning of year 2 of the project and realized that racial and ethnic disparities emerged after the first 3 weeks of hospitalization, which we have described in detail elsewhere,22 and that there was wide variation in disparities between hospitals. We consequently conducted qualitative interviews with black and Hispanic mothers at 2 hospitals and found that transportation and parking costs, family visitation policies, and returning to work were identified as significant barriers for maternal NICU visitation and ongoing pumping.34 Spanish-speaking mothers also emphasized the importance of communication in the primary language.34 We hypothesized that variation in NICU family engagement practices may explain, at least in part, the variation in disparities. We therefore performed a practice survey in year 2, in which we identified wide variation in the use of scheduled family or breastfeeding support groups, provision of hot meals for breastfeeding mothers, transportation vouchers, family visitation rules, and ease of use of in-person versus phone interpreters. The leadership team created multilingual family education materials that were released in 2016 and videos that were released in 2018. Many teams began to focus on improving family engagement practices in the latter half of our collaborative, which has continued into 2018.

Strengths of our statewide QI collaborative include engagement of all 10 NICUs and robust data collection on 1670 VLBW infants eligible to receive mother’s milk over several time points during the hospitalization. We differentiated mother’s milk from donor milk. Limitations include lack of many other variables that may potentially impact mother’s milk provision, such as maternal medical morbidities, mode of delivery, maternal intent to breastfeed, type of pump or pumping frequency, and sociodemographic variables. We did not track individual-level family engagement measures, such as presence at the bedside or participation in lactation consultations or breastfeeding support groups. We captured maternal education during the prenatal period only, whereas families likely received important education throughout the hospital stay, and our measure of skin-to-skin care was limited to 4 chart audit days in the first month only. A limitation is that we did not focus on etiologies of racial and ethnic disparities beyond the prenatal period and first month of hospitalization from the inception of the project. Instead, we focused on interventions targeted on racial and ethnic disparities that occurred later in the hospitalization, mainly in years 2 and 3, which may have provided less time to achieve reduction in racial and ethnic disparities in mother’s milk provision at discharge or transfer.

As disparities in quality of neonatal care have become more well described,26,28 PQCs focusing on reducing these disparities represent a promising approach to address this critical problem. In our Massachusetts PQC focused on reducing racial and ethnic disparities in provision of mother’s milk, we found wide hospital variation. Tracking metrics according to race and ethnicity and sharing transparently was well received and sparked interventions related to reduction in racial and ethnic disparities in provision of mother’s milk for VLBW infants at the local and statewide level.

Dr Parker conceptualized and designed the project, coordinated and supervised data collection, and drafted and revised the manuscript; Ms Burnham designed data collection instruments, coordinated and supervised data collection, conducted the initial data analysis, and reviewed and revised the manuscript; Ms Melvin conducted data analysis and reviewed and revised the manuscript; Dr Singh coordinated data collection and critically reviewed and revised the manuscript for important intellectual content; Ms Lopera coordinated data collection and quality improvement education and reviewed and revised the manuscript; Dr Belfort contributed to the conceptualization of the project as an expert in provision of human milk for very low birth weight infants, and critically reviewed the manuscript for important intellectual content; Dr Moses provided quality improvement education and contributed to conceptualization of the project and critically reviewed the manuscript for important intellectual content; Dr Gupta conceptualized and designed the project, provided quality improvement education and oversight, conducted data analysis, and revised the manuscript; and all authors approved the final manuscript as submitted and agree to be accountable for all aspects of the work.

FUNDING: This work was supported by the W.K. Kellogg Foundation (principal investigator Margaret Parker, P3031871).

We acknowledge the hospitals that participated: Baystate Medical Center, Beth Israel Deaconess Medical Center, Boston Children's Hospital, Boston Medical Center, Brigham and Women’s Hospital, Massachusetts General Hospital, St. Elizabeth’s Medical Center, Tufts Medical Center, South Shore Hospital, and UMass Memorial Hospital.

NeoQIC

Neonatal Quality Improvement Collaborative

PDSA

plan-do-study-act

PQC

perinatal quality collaborative

QI

quality improvement

VLBW

very low birth weight

1
Eidelman
AI
.
Breastfeeding and the use of human milk: an analysis of the American Academy of Pediatrics 2012 Breastfeeding Policy Statement.
Breastfeed Med
.
2012
;
7
(
5
):
323
324
[PubMed]
2
Sisk
PM
,
Lovelady
CA
,
Dillard
RG
,
Gruber
KJ
,
O’Shea
TM
.
Early human milk feeding is associated with a lower risk of necrotizing enterocolitis in very low birth weight infants.
J Perinatol
.
2007
;
27
(
7
):
428
433
[PubMed]
3
Colaizy
TT
,
Bartick
MC
,
Jegier
BJ
, et al;
Eunice Kennedy Shriver National Institute of Child Health and Human Development Neonatal Research Network
.
Impact of optimized breastfeeding on the costs of necrotizing enterocolitis in extremely low birthweight infants.
J Pediatr
.
2016
;
175
:
100
105.e2
4
Meinzen-Derr
J
,
Poindexter
B
,
Wrage
L
,
Morrow
AL
,
Stoll
B
,
Donovan
EF
.
Role of human milk in extremely low birth weight infants’ risk of necrotizing enterocolitis or death.
J Perinatol
.
2009
;
29
(
1
):
57
62
[PubMed]
5
Furman
L
,
Taylor
G
,
Minich
N
,
Hack
M
.
The effect of maternal milk on neonatal morbidity of very low-birth-weight infants.
Arch Pediatr Adolesc Med
.
2003
;
157
(
1
):
66
71
[PubMed]
6
Patel
AL
,
Johnson
TJ
,
Robin
B
, et al
.
Influence of own mother’s milk on bronchopulmonary dysplasia and costs.
Arch Dis Child Fetal Neonatal Ed
.
2017
;
102
(
3
):
F256
F261
[PubMed]
7
Belfort
MB
,
Anderson
PJ
,
Nowak
VA
, et al
.
Breast milk feeding, brain development, and neurocognitive outcomes: a 7-year longitudinal study in infants born at less than 30 weeks’ gestation.
J Pediatr
.
2016
;
177
:
133
139.e1
8
Vohr
BR
,
Poindexter
BB
,
Dusick
AM
, et al;
NICHD Neonatal Research Network
.
Beneficial effects of breast milk in the neonatal intensive care unit on the developmental outcome of extremely low birth weight infants at 18 months of age.
Pediatrics
.
2006
;
118
(
1
). Available at: www.pediatrics.org/cgi/content/full/118/1/e115
[PubMed]
9
Vohr
BR
,
Poindexter
BB
,
Dusick
AM
, et al;
National Institute of Child Health and Human Development National Research Network
.
Persistent beneficial effects of breast milk ingested in the neonatal intensive care unit on outcomes of extremely low birth weight infants at 30 months of age.
Pediatrics
.
2007
;
120
(
4
). Available at: www.pediatrics.org/cgi/content/full/120/4/e953
[PubMed]
10
Belfort
MB
,
Edwards
EM
,
Greenberg
LT
,
Parker
MG
,
Ehret
DY
,
Horbar
JD
.
Diet, weight gain, and head growth in hospitalized US very preterm infants: a 10-year observational study [published online ahead of print April 17, 2019].
Am J Clin Nutr
. doi:
11
Sisk
PM
,
Lovelady
CA
,
Dillard
RG
,
Gruber
KJ
.
Lactation counseling for mothers of very low birth weight infants: effect on maternal anxiety and infant intake of human milk.
Pediatrics
.
2006
;
117
(
1
). Available at: www.pediatrics.org/cgi/content/full/117/1/e67
[PubMed]
12
Miracle
DJ
,
Meier
PP
,
Bennett
PA
.
Mothers’ decisions to change from formula to mothers’ milk for very-low-birth-weight infants.
J Obstet Gynecol Neonatal Nurs
.
2004
;
33
(
6
):
692
703
[PubMed]
13
Parker
LA
,
Sullivan
S
,
Krueger
C
,
Mueller
M
.
Association of timing of initiation of breastmilk expression on milk volume and timing of lactogenesis stage II among mothers of very low-birth-weight infants.
Breastfeed Med
.
2015
;
10
(
2
):
84
91
[PubMed]
14
Furman
L
,
Minich
N
,
Hack
M
.
Correlates of lactation in mothers of very low birth weight infants.
Pediatrics
.
2002
;
109
(
4
). Available at: www.pediatrics.org/cgi/content/full/109/4/e57
[PubMed]
15
Hill
PD
,
Aldag
JC
,
Chatterton
RT
.
Initiation and frequency of pumping and milk production in mothers of non-nursing preterm infants.
J Hum Lact
.
2001
;
17
(
1
):
9
13
[PubMed]
16
Acuña-Muga
J
,
Ureta-Velasco
N
,
de la Cruz-Bértolo
J
, et al
.
Volume of milk obtained in relation to location and circumstances of expression in mothers of very low birth weight infants.
J Hum Lact
.
2014
;
30
(
1
):
41
46
[PubMed]
17
Sharma
D
,
Farahbakhsh
N
,
Sharma
S
,
Sharma
P
,
Sharma
A
.
Role of kangaroo mother care in growth and breast feeding rates in very low birth weight (VLBW) neonates: a systematic review.
J Matern Fetal Neonatal Med
.
2019
;
32
(
1
):
129
142
[PubMed]
18
Lee
HC
,
Gould
JB
.
Factors influencing breast milk versus formula feeding at discharge for very low birth weight infants in California.
J Pediatr
.
2009
;
155
(
5
):
657
662.e1–e2
19
Lee
HC
,
Kurtin
PS
,
Wight
NE
, et al
.
A quality improvement project to increase breast milk use in very low birth weight infants.
Pediatrics
.
2012
;
130
(
6
). Available at: www.pediatrics.org/cgi/content/full/130/6/e1679
[PubMed]
20
Lee
HC
,
Martin-Anderson
S
,
Dudley
RA
.
Clinician perspectives on barriers to and opportunities for skin-to-skin contact for premature infants in neonatal intensive care units.
Breastfeed Med
.
2012
;
7
(
2
):
79
84
[PubMed]
21
Lee
HC
,
Martin-Anderson
S
,
Lyndon
A
,
Dudley
RA
.
Perspectives on promoting breastmilk feedings for premature infants during a quality improvement project.
Breastfeed Med
.
2013
;
8
:
176
180
[PubMed]
22
Parker
MG
,
Gupta
M
,
Melvin
P
, et al
.
Racial and ethnic disparities in the use of mother’s milk feeding for very low birth weight infants in Massachusetts.
J Pediatr
.
2019
;
204
:
134
141.e1
[PubMed]
23
Pineda
RG
.
Predictors of breastfeeding and breastmilk feeding among very low birth weight infants.
Breastfeed Med
.
2011
;
6
(
1
):
15
19
[PubMed]
24
Sisk
PM
,
Lovelady
CA
,
Dillard
RG
,
Gruber
KJ
,
O’Shea
TM
.
Maternal and infant characteristics associated with human milk feeding in very low birth weight infants.
J Hum Lact
.
2009
;
25
(
4
):
412
419
[PubMed]
25
Riley
B
,
Schoeny
M
,
Rogers
L
, et al
.
Barriers to human milk feeding at discharge of very low-birthweight infants: evaluation of neighborhood structural factors.
Breastfeed Med
.
2016
;
11
:
335
342
[PubMed]
26
Profit
J
,
Gould
JB
,
Bennett
M
, et al
.
Racial/ethnic disparity in NICU quality of care delivery.
Pediatrics
.
2017
;
140
(
3
):
e20170918
[PubMed]
27
Howell
EA
,
Hebert
P
,
Chatterjee
S
,
Kleinman
LC
,
Chassin
MR
.
Black/white differences in very low birth weight neonatal mortality rates among New York City hospitals.
Pediatrics
.
2008
;
121
(
3
). Available at: www.pediatrics.org/cgi/content/full/121/3/e407
[PubMed]
28
Howell
EA
,
Janevic
T
,
Hebert
PL
,
Egorova
NN
,
Balbierz
A
,
Zeitlin
J
.
Differences in morbidity and mortality rates in black, white, and Hispanic very preterm infants among New York City hospitals.
JAMA Pediatr
.
2018
;
172
(
3
):
269
277
[PubMed]
29
Wallace
ME
,
Mendola
P
,
Kim
SS
, et al
.
Racial/ethnic differences in preterm perinatal outcomes.
Am J Obstet Gynecol
.
2017
;
216
(
3
):
306.e1
306.e12
30
Centers for Disease Control and Prevention
. Developing and sustaining perinatal quality collaboratives. Available at: https://www.cdc.gov/reproductivehealth/maternalinfanthealth/pdf/Best-Practices-for-Developing-and-Sustaining-Perinatal-Quality-Collaboratives_tagged508.pdf. Accessed November 9, 2018
31
Gupta
M
,
Donovan
EF
,
Henderson
Z
.
State-based perinatal quality collaboratives: Pursuing improvements in perinatal health outcomes for all mothers and newborns.
Semin Perinatol
.
2017
;
41
(
3
):
195
203
[PubMed]
32
Fenton
TR
,
Kim
JH
.
A systematic review and meta-analysis to revise the Fenton growth chart for preterm infants.
BMC Pediatr
.
2013
;
13
:
59
[PubMed]
33
Institute for Healthcare Improvement
.
The Breakthrough Series: IHI’s Collaborative Model for Achieving Breakthrough Improvement (IHI Innovation Series White Paper)
.
Boston, MA
:
Institute for Healthcare Improvement
;
2003
34
Parker
MG
,
Lopera
AM
,
Kalluri
NS
,
Kistin
CJ
.
“I felt like I was a part of trying to keep my baby alive”: perspectives of Hispanic and non-Hispanic black mothers in providing milk for their very preterm infants [published online ahead of print October 6, 2018].
Breastfeed Med
. doi:
[PubMed]
35
Horbar
JD
,
Carpenter
JH
,
Badger
GJ
, et al
.
Mortality and neonatal morbidity among infants 501 to 1500 grams from 2000 to 2009.
Pediatrics
.
2012
;
129
(
6
):
1019
1026
[PubMed]
36
Brownell
EA
,
Lussier
MM
,
Hagadorn
JI
,
McGrath
JM
,
Marinelli
KA
,
Herson
VC
.
Independent predictors of human milk receipt at neonatal intensive care unit discharge.
Am J Perinatol
.
2014
;
31
(
10
):
891
898
[PubMed]
37
Fleurant
E
,
Schoeny
M
,
Hoban
R
, et al
.
Barriers to human milk feeding at discharge of very-low-birth-weight infants: maternal goal setting as a key social factor.
Breastfeed Med
.
2017
;
12
:
20
27
[PubMed]
38
Vermont Oxford Network
.
Manual of Operations: Part 2 Data Definitions and Infant Data Forms
.
Hoboken, New Jersey
:
John Wiley & Sons
;
2011
39
Provost
LP
,
Murray
SK
.
The Health Care Data Guide Learning From Data for Improvement
.
San Francisco, CA
:
Jossey-Bass
;
2011
40
Conde-Agudelo
A
,
Díaz-Rossello
JL
.
Kangaroo mother care to reduce morbidity and mortality in low birthweight infants.
Cochrane Database Syst Rev
.
2014
;(
4
):
CD002771
[PubMed]
41
Spatz
DL
,
Edwards
TM
.
The use of human milk and breastfeeding in the neonatal intensive care unit: position statement 3065.
Adv Neonatal Care
.
2016
;
16
(
4
):
254
[PubMed]

Competing Interests

POTENTIAL CONFLICT OF INTEREST: The authors have indicated they have no potential conflicts of interest to disclose.

FINANCIAL DISCLOSURE: The authors have indicated they have no financial relationships relevant to this article to disclose.

Supplementary data