BACKGROUND AND OBJECTIVE

Transition from pediatric to adult care is associated with adverse health outcomes for many adolescents with chronic illness. We identified quality indicators for transition to adult care that are broadly applicable across chronic illnesses and health systems.

METHODS

Medline, Embase, and the Cumulative Index to Nursing and Allied Health Literature were searched, covering earliest available date to July 2021. The Gray Matters framework was used to search gray literature. Two independent reviewers screened articles by title and abstract, followed by full-text review. Disagreements were resolved by a third reviewer. Studies were included that identified quality indicators developed via consensus-building methods. Indicators were organized into a framework categorized by illness specificity, level of care, Donabedian model, and Institute of Medicine quality domain. Appraisal of Guidelines for Research and Evaluation tool was used for critical appraisal.

RESULTS

The search identified 4581 articles, of which 321 underwent full-text review. Eight peer-reviewed studies and 1 clinical guideline were included, identifying 169 quality indicators for transition. Of these, 56% were illness specific, 43% were at the patient level of care, 44% related to transition processes, and 51% were patient centered and 0% equity focused. Common indicator themes included education (12%), continuity of care (8%), satisfaction (8%), and self-management/self-efficacy (7%). The study was limited by quality indicators developed through consensus-building methodology.

CONCLUSIONS

Although most quality indicators for transition were patient-centered outcomes, few were informed by youth and parents/caregivers, and none focused on equity. Further work is needed to prioritize quality indicators across chronic illness populations while engaging youth and parents/caregivers in the process.

Transition from pediatric to adult health care services is a challenging process for many youth with chronic illness and their families.18  Transition is defined as the purposeful and planned movement from pediatric to adult health care services, often beginning in early adolescence and continuing into young adulthood.9  Up to 15% of youth in North America are living with a chronic condition and will transition to adult care.10  The age of transition in North America varies by jurisdiction, with most policies mandating youth transition between 16 and 19 years old.

Transition to adult care is associated with patient-safety risks across chronic conditions, including diabetes,11  inflammatory bowel disease,12  organ transplantation,13  congenital heart disease,14  and sickle cell disease.15  Several studies have reported deterioration in patient health status, disease complications, psychosocial distress, reduced medication and treatment adherence, and increased acute care usage after transition to adult care.5,1119  Youth simultaneously undergo developmental changes, such as gaining independence, new social relationships, and achieving educational or vocational milestones.21  The needs of youth during this critical period in their development are often inadequately met, risking dissatisfaction and disengagement from care.18,2226  Despite these challenges, there is no consistent and universal approach to evaluate and track performance and outcomes during transition for youths with chronic illness. Robust metrics are needed to evaluate transition and improve the quality of care delivered to youth and their families.

Quality indicators are metrics used to evaluate health care delivery.2023  They are developed through consensus-building methodologies, combining syntheses of the literature, expert opinion, and patient values.20,24,25  Several frameworks have been used to categorize quality indicators, including the Donabedian model and the Institute of Medicine’s (IOM) 6 Domains of Health care Quality.26,27  Using the Donabedian model, quality indicators can be categorized as structure (ie, measures assessing the characteristics of the care setting), process (ie, measures assessing the delivery of care), or outcome (ie, measures assessing the effect of health care services on the patient health).28  The IOM domains include patient-centeredness (ie, ensures patient values guide clinical decisions), equity (ie, provides high-quality care to all, regardless of personal characteristics) efficiency (ie, avoids waste), effectiveness (ie, practices evidence-based medicine), safety (ie, avoids harm), and timeliness (ie, reduces delays in receiving care).29,30 

Quality indicators are crucial for benchmarking, defined as a point of reference against which others may be measured.3133  They identify suboptimal aspects of care and evaluate, monitor, and compare performance across providers, clinical settings, and jurisdictions.34  Several studies have identified quality indicators for transition; however, they have been mainly limited to physical illnesses while excluding mental and developmental conditions.3537  Consequently, there is no key set of quality indicators to evaluate transition that are broadly applicable across all chronic disease populations. A 2021 position statement released by the Canadian Pediatric Society’s Adolescent Health Committee identified this lack of broadly applicable quality indicators as a barrier preventing the development of a universal transition benchmarking system.38  Hence, robust quality indicators applicable across chronic conditions and jurisdictions are needed to standardize measurement and benchmark performance in transition.

This systematic review aimed to identify quality indicators for transition from pediatric to adult health care services across physical, mental, and developmental conditions. Specifically, we aimed to answer the following research question: What illness-specific (ie, developed for use in patients with specific diseases/diagnoses, such as haemophilia, diabetes, cerebral palsy, anxiety etc) and non–illness-specific (ie, developed for use across patients with any disease/diagnosis) quality indicators have been developed via consensus-building methodology to evaluate transition from pediatric to adult care, based on patient, caregiver, provider, or health-system–level perspectives? We also aimed to classify quality indicators using the Donabedian model and IOM Domains of Health care Quality to identify gaps and areas where further study is needed.

This systematic review was registered with the International Prospective Register of Systematic Reviews (PROSPERO; CRD42020198030). The protocol has been published.39  Detailed search strategies, data extraction tables from included studies, and categorization framework used to classify quality indicators can be found in the Supplemental Information. Template data abstraction forms may be provided upon request to corresponding author.

The databases Medline, Embase, and the Cumulative Index to Nursing and Allied Health Literature were searched from the earliest available date to July 9, 2021. The search strategy (Supplemental Tables 5-7) incorporated 2 concepts: (1) transition from pediatric to adult care and (2) performance measurement and benchmarking, which was developed by a librarian from the Hospital for Sick Children, Toronto, Canada (QM). Titles and abstracts were exported to Microsoft Excel for study selection.

Study eligibility was determined in 2 stages: title and abstract screening (level 1) and full-text review (level 2). Each study was assessed by a set of 2 independent reviewers (K.B., S.L., T.D.L.R., or L.L.), with disagreements resolved by a third reviewer (A.T.). At level 1, studies were included if they (1) focused on transition from pediatric to adult care and (2) used process, structure, or outcome measures or indicators to evaluate transition. Studies were excluded if they were not peer-reviewed or not in English. The research team pilot-tested the level 1 screening form using a random sample of 200 study records (κ = 0.612). At level 1, overall κ ranged from 0.691 to 0.761 between 4 sets of reviewers. Studies were included at level 2 if they used robust consensus-building methodology (eg, Delphi survey, Rand/UCLA appropriateness methodology, or prioritization exercise) to develop quality indicators, in addition to meeting the inclusion criteria for level 1. Studies were excluded if (1) metrics were used to evaluate local or specific transition interventions (eg, clinic-specific quality improvement initiatives) rather than the transition process in general, (2) no description or evidence of a rigorous development process for quality indicators was provided, or (3) focused on key elements of successful transition, rather than measurable quality indicators. The team also piloted the level 2 screening form using a sample of 25 full-text articles until a similar level of agreement was achieved (κ = 0.65). At level 2, overall κ ranged from 0.47 to 0.62 between 2 sets of reviewers.

Studies meeting eligibility criteria in levels 1 and 2 underwent data abstraction (level 3) using a piloted abstraction form. Data abstracted included study-level characteristics (ie, author, title, year, and country of origin), study methodology (ie, study design, population, sample size, panel characteristics, data collection method, and clinical context or disease), and quality indicator characteristics (ie, description, illness, level of care, or measurement properties and instructions). The data abstraction form was developed based on previous reviews of quality indicators.40,41  Data were abstracted independently by 2 reviewers (S.L. and K.B.) and entered into a data abstraction form on Excel. Abstraction forms from both reviewers were collated.

A review of the gray literature was conducted from July 2021 to the earliest available date using the Canadian Agency for Drugs and Technologies in Health Gray Matters tool.42  Search terms included “transition to adult care” and “quality indicators”. Two independent reviewers (K.B. and L.L.) searched the gray literature websites provided in the Gray Matters tool, evaluated literature using the predefined eligibility criteria, and recorded findings in the Gray Matters checklist. Further information about the gray literature search strategy is provided in the Supplemental Information (Supplemental Table 10).

Following a literature search of previous syntheses of quality indicators in health care, the research team identified the Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument, a validated tool widely used to assess the quality of clinical practice guidelines.43  A modified version (AGREE II-QI) was created for evaluation of quality indicators.44  Although there is no agreement on which tool is most appropriate to appraise quality indicators, the AGREE II-QI has been applied in previous studies.41,45,46 

The AGREE II-QI instrument consists of 6 domains: scope and purpose (eg, clarity of study scope), stakeholder involvement (eg, representation from all relevant disciplines), rigor of development (eg, methods used to develop quality indicators), clarity of presentation (eg, measurement properties of quality indicators), applicability (eg, inclusion of tools for use), and editorial independence (eg, competing interests).44  The appraiser must rate the degree to which they believe the study achieves each core element of quality indicator development on a 7-point Likert scale (1 = strongly disagree and 7 = strongly agree). Total scores are calculated for each domain and an overall quality score for the quality indicator set. The AGREE II-QI uses the same scoring system as the original AGREE II instrument.43 

Two independent reviewers (K.B. and L.L.) pilot tested the AGREE II-QI instrument on 2 randomly selected articles included in level 3 to ensure its appropriateness for this review. Each study included in level 3 was appraised, and final scores from both reviewers were compiled into an Excel spreadsheet. Domain scores were calculated following the protocol in the AGREE II user manual, where a maximum score of 100% indicated both reviewers believed each element of the AGREE II-QI instrument was fully met.47 

Abstracted quality indicators were categorized by level of care (ie, patient, caregiver, provider, or health-system level) and disease (ie, disease-specific, or generic). Indicators were then mapped onto the Donabedian model21  and IOM domains29  to identify gaps in measurement approaches. Although certain quality indicators could be classified under multiple IOM domains, each indicator was assigned to a single dominant domain, on the basis of the protocol from a previous systematic review.41  Operational definitions used for this classification are found in Supplemental Table 11. Finally, each quality indicator was assigned a clinically relevant major measurement theme (eg, satisfaction, continuity of care, and appointment keeping). Two reviewers (A.T. and K.B.) independently classified each indicator by level of care, Donabedian classification, IOM domain, and clinically relevant measurement themes identified by coauthors. Disagreements were discussed until consensus was achieved. This categorization framework was based off a systematic review of quality indicators in inflammatory arthritis.41 

The search strategy and gray literature search identified 4581 studies after duplicates were removed (Fig 1). After title and abstract screening, 321 full-text articles were reviewed. Of these, 9 studies were included in the final systematic review, 8 of which were peer-reviewed and 1 was a clinical guideline identified by the gray literature search (Table 1). In total, 169 quality indicators across 29 themes were identified (see Supplemental Table 10 for abstracted quality indicators). Two quality indicator sets were developed in the United States,48,49  2 in Canada,35,50  2 in the United Kingdom,51,52  1 in the Netherlands,37  1 in Spain,53  and 1 in Switzerland.54 

Of the 9 included studies and guidelines, 5 (56%) were developed in disease-specific populations: 1 in sickle cell disease (11%),36  2 in inflammatory bowel disease (22%),37,50  1 in haemophilia (11%),35  and 1 in juvenile-onset rheumatic disease (11%).53  These illness-specific studies yielded a total of 62 quality indicators, accounting for 37% of all identified indicators. The 4 remaining studies were not conducted in any particular disease population, yielding a total of 107 (63%) quality indicators.48,51,52,54  Of these non–illness-specific studies, 1 included representation across chronic physical, mental, and developmental conditions (eg, diabetes, cystic fibrosis, cancer, mental illness, chronic pain, and neurodisability).51  Both Suris et al54  and Fair et al48  did not include information about the disciplines of expert panelists, thus it is unclear whether cross-conditions representation was achieved. The NICE quality standard for transition from children’s to adults’ services included a specialist committee with representation from physical and mental illnesses, as well as diverse community stakeholders across all conditions.52 

Three quality indicator sets were conducted using a traditional Delphi study,37,48,54  2 used a modified Delphi study,35,36  and 4 employed study-specific consensus-building methodology (eg, iterative interviews/focus groups, series of surveys, etc).5053  None were developed via Rand/UCLA appropriateness methodology.

All studies (n = 9) included interdisciplinary health care providers as expert panelists in their consensus-building process (eg, physicians, nurses, transition navigators, psychologists, etc). Four included both pediatric and adult providers in their expert panels,35,37,53,54  whereas 2 included exclusively adult providers.36,50  The remaining 3 studies did not include information about the breakdown of pediatric to adult providers.48,51,52  Four studies included exclusively health care providers,35,36,50,54  whereas 4 included patients37,48,51,53  and 3 included parents/caregivers.48,51,52  Of those including patients, 1 reported age (range = 16.5–24.7 years old; median = 18.7 years old) and 2 reported sex (49.2% male in van den Brink et al37  and 46.2% male in Aldiss et al51 ). None reported race, ethnicity, gender, sexual orientation, primary language, or socioeconomic status. No information was provided about the parent/caregiver characteristics. One study involved community stakeholders.52  See Supplemental Table 8 for stakeholder characteristics.

Of the 169 quality indicators, 72 were patient level (43%), 50 were provider level (30%), 30 were health-system level (18%), and 14 were caregiver level (8.3%) (Table 2). Three (1.8%) quality indicators measured both provider- and patient-level responsibilities (eg, written transition plans are used that are cocreated and completed by the young person and care team). When categorized according to the Donabedian model,21  75 quality indicators corresponded to processes (44%), 56 to outcomes (33%), and 38 to structure of care delivery (23%). Using the IOM27  domains, 87 indicators were classified as patient-centered (51%), 41 safe (24%), 21 effective (13%), 15 efficient (9.0%), and 5 timely (3.0%). No quality indicators related to equity were identified.

Abstracted indicators were further categorized into 29 distinct clinically relevant measurement themes (Table 3). The most common measurement theme was transition education (n = 21, 12%), followed by continuity of care (n = 13, 8%), satisfaction (n = 13, 8%), and self-management/self-efficacy (n = 11, 7%). Very few measurement themes related to life-skills and participation outcomes such as youth social development (n = 1, 0.6%), resilience (n = 1, 0.6%), and self-advocacy skills (n = 1, 0.6%). See Supplemental Table 9 for the categorization framework and abstracted quality indicators.

Critical appraisal using the AGREE II-QI yielded low scores across all domains, with an average overall quality score of 34.3% (Table 4). Across all quality indicator sets, the highest rated domains were scope and purpose (mean = 71.3%) and editorial independence (mean = 63.9%). Domains relating to stakeholder involvement were rated an average of 43.98%, which reflects exclusion of representative stakeholders (eg, youth, parents/caregivers, community stakeholders, etc). Rigor of development was rated an average of 27.3%, whereas clarity of presentation was rated an average of 24.1%. Ratings of applicability were the lowest, achieving an average domain score of 8.0% across studies. This highlights the lack of instructions for measurement or implementation in clinical practice.

This systematic review identified 169 quality indicators (63% generic and 37% illness specific) for transition to adult care for youth with chronic conditions developed via consensus-building methodologies. Our study highlights where emphasis has been placed in quality indicators for transition. To date, existing research has focused on quality indicators related to satisfaction, transition education and planning, continuity of care, satisfaction, and self-management/self-efficacy. Most quality indicators were patient-centered measures. We identified several gaps in quality indicators for transition. Although more than 50% of quality indicators were patient and caregiver level, these stakeholders were rarely included in the development process. Furthermore, there were no equity related metrics and many indicators had unclear measurement characteristics.

Most quality indicators were patient centered yet developed based on the perspectives of health care providers only. Youth possess valuable knowledge grounded in their experiences navigating the health care system with a chronic condition55,56  and should be included, as well as parents/caregivers in the case of children and adolescents, as active partners in research to ensure results are meaningful, impactful, and patient centered.55,5759  Despite this, few studies included the perspectives of these key stakeholders in the quality indicator development process. When included, youth were often placed on the same panel as clinicians in fewer numbers, increasing the likelihood their priorities were overshadowed by those of the health care provider panelists. A recent Delphi study identified core components of successful transition from pediatric to adult mental health services using 3 homogeneous panels with patients, parents/caregivers, and health care providers.58  Not only did youth have different priorities than their parents/caregivers and health care providers, but they also increased the validity of results by advising the use of youth-centered language.58 

Moreover, studies have called for increased engagement of knowledge users in the research process to improve the impact of health services research and translate results into meaningful clinical or health-system level policy changes.60,61  Community and health system leaders are key stakeholders in transition. They have knowledge and experience to provide input into the barriers and facilitators to incorporating standardized measurement into clinical practice. Among the studies identified by this review, only 1 included community knowledge users in their expert panels.52  Future research should incorporate the perspectives of diverse knowledge users in the development of quality indicators, such as community and health-system leaders, administrators, and policy makers.

Of the studies including patients and caregivers, 2 included information about participant age, sex, and type of illness. None of the studies highlighted demographic or sociocultural characteristics of participants, including race/ethnicity, gender, sexual orientation, and primary language. It is well known that the intersection of structural and social determinants of health impacts both access to health care services and quality of care received, including developmentally appropriate transitional care services. Youth and caregivers self-identifying as individuals that are structurally marginalized may have unique experiences with their transition to adult care. Future work should use a health equity lens to develop quality indicators that reflect the priorities of youth and caregivers who are marginalized and transitioning to adult care.

Level of Care

We identified few parent/caregiver-level quality indicators. Of those, many were assessing satisfaction with the transition process, with little emphasis placed on their specific roles and responsibilities. Parents/caregivers play a central role in the care of youth with chronic illness as they transition to adult care, such as promoting self-efficacy, independent communication, and autonomy, as well as supporting them to understand their condition and treatment plan.62  Parents/caregivers often encounter unique challenges distinct from those of youth and their health care team, including apprehension about their children becoming principal health care decision makers and heightened concerns about potential poor health outcomes in young adulthood.2,63,64  Involvement of parents/caregivers in transition education, preparation, and planning has been included as a recommendation for best practice in transition.51,65  As such, we recommend future research involve consultation with parents/caregivers to establish appropriate caregiver-focused quality measures.

IOM Health Care Quality Domain

The quality indicators identified by this review are inconsistent with the IOM’s assertion that “the vast majority of measures address effectiveness and safety, a smaller number examine timeliness and patient-centeredness, and very few assess the efficiency or equity of care”.66  This highlights the need for additional quality indicator development on the domains of effectiveness, equity, and safety. Given the established association between youth transfer to adult services and negative health outcomes, quality indicators assessing patient safety should be of particular importance.

Critically, we identified no quality indicators related to equity despite the impact of the social determinants of health on outcomes following transition to adult care.67  For example, a 2021 retrospective study identified that Black race, Hispanic ethnicity, and socioeconomic factors were of importance in understanding outcomes following transition in youth with childhood-onset systemic lupus erythematosus.68  Future work should identify equity metrics to ensure the relationship between the social and structural determinants of health and transition outcomes is understood and addressed at the patient, provider and health-system level. Those who are most impacted by health inequities should be actively engaged throughout the process of developing these metrics. There is also a need for purposeful measurement of existing quality indicators across diverse populations, whereby results are stratified by demographic and sociocultural characteristics to identify any deficiencies in equity and quality of care. Finally, future work may consider compiling existing health equity-related quality indicators from other care settings and contexts to assess whether they can be adapted and/or applied to the transitional care.

Generic Versus Illness-Specific

Abstracted quality indicators were both generic and specific to several chronic physical disease populations, including sickle cell disease, inflammatory bowel disease, haemophilia, and juvenile-onset rheumatic/musculoskeletal disorders. Notably, no studies had developed quality indicators specifically for mental illness or developmental conditions. There are increasing numbers of youth with physical, mental, and developmental conditions, and having a chronic physical health condition can place youth at increased likelihood of developing a mental health condition and vice versa.69,70  As such, there is still a paucity of robust quality indicators that are broadly applicable across all chronic physical, mental, and developmental conditions, preventing universal evaluation across clinical settings and jurisdictions. We recommend that further research focus on developing a key set of generic quality indicators to evaluate transition across chronic conditions and compare/benchmark aspects of care that are applicable across patients accessing transition services, regardless of the diagnosis.

Measurement Themes

Many of the patient-level outcome measures identified were assessing constructs related to their disease, such as knowledge and self-management. Very few quality indicators evaluated the developmental, social, vocational, and psychological aspects of youth transitioning to adult care. Blum’s definition of transition encompasses physical outcomes and psychosocial, educational, vocational, and social development.9  Evidence has supported the need for a holistic approach to transition, including flexibility and accommodation for unique clinical and nonclinical aspects of a patient’s life, their developmental level, and capacity for learning.5,65,7176  As such, patient-level quality indicators must reflect this recommendation and evaluate transition using appropriate psychosocial, developmental, educational and vocational metrics.

No quality indicators related to cost, billing, or economics were identified by this review. As per the Institute of Healthcare Improvement Triple Aim Framework, improving the quality of the health system includes reducing the per capita cost of services delivered.77  Some studies have reported cost savings and reduced acute care usage with the implementation transition interventions78,79 ; however, there remains a need to develop robust cost-related metrics to evaluate transitional care.65 

As evidenced by the low applicability domain score on AGREE II-QI, very few quality indicators included the characteristics required for measurement and implementation in clinical practice. Critical quality indicator characteristics needed to standardize and optimize measurement include a numerator and denominator, frequency and interval of measurement, a defined target user, an instrument for assessment, and predefined cutoffs to benchmark appropriate achievement of the assessed construct.30,47  In addition to these characteristics, many of the quality indicators did not include instructions for implementation or updating the quality indicator as new evidence emerges, highlighting their lack of utility in the clinical setting. To effectively implement measurement-based care into transitional services and meaningfully compare performance within and between health systems, further research is needed to establish quality indicators with both robust measurement characteristics and an implementation framework.

Our systematic review is limited to English literature only, which could have resulted in the exclusion of relevant studies. Additionally, the majority of studies identified were from North America and Europe, so the indicators identified may not include a broad international understanding of transition. This may limit their applicability in other countries or settings. Furthermore, this systematic review identified quality indicators developed through consensus-building methodology, which may have limited the scope of indicators included. Finally, we were unable to apply all relevant frameworks to categorize quality indicators, including the GotTransition Core Elements of Healthcare Transition.80  Use of a transition-specific quality framework may have captured deficiencies in quality indicator domains related to transition to adult care, rather than gaps in overarching domains of health care quality.

Several of the quality indicators identified by this review did not have many of the characteristics needed for measurement in clinical practice. Future research should focus on refining these quality indicators to ensure youth/family-centered language and perspectives, clarity of description, including characteristics needed for measurement, and devising a framework for implementation. We plan to conduct a multistakeholder Delphi study that refines and prioritizes these quality indicators to develop a key set of measures to be used in clinical practice. This process will be inclusive of experts from across chronic physical, mental, and developmental conditions, including youth, parents/caregivers, health care professionals, and health-system leaders. A key set of quality indicators for transition that can be applied to any clinical setting and disease population is needed to compare health-system performance across all clinical settings and jurisdictions. Following this, future attention is needed to evaluate the utility of adding some disease-specific measures to the key set (eg, specific markers of disease stability), refining measurement characteristics, and developing an implementation framework.

This review synthesizes the vast amount of information on quality indicators for busy clinicians and policymakers involved in transition. We highlight the areas of quality measurement in transition which are important to measure in practice, as well as the areas that have been overlooked and require further attention. Importantly, this review emphasizes involving youth and caregivers in future work. Finally, these results are the first step in informing and aiding policy makers in developing benchmarks for transition, which are needed to measure health system performance and flag areas where further initiatives are needed to improve quality of care.

Despite the significant number of quality indicators identified by this review, there remains a need for robust, generalizable metrics evaluating transition to adult care for youth regardless of type of chronic illness. The majority of indicators identified were related to patient-centered outcomes; however, we identified significant gaps including the paucity of youth and parents or caregivers involvement in the quality indicator development process, equity focused metrics, and measurement characteristics of quality indicators. To elucidate a key set of metrics, future research should further prioritize and refine identified quality indicators in collaboration with youth, parents or caregivers, health care providers, and health-system leaders.

We thank the members of the Transition Quality Indicators subcommittee, including Dayle McCauley, Heather Buckingham, Dr Gail Andrews, Dr Michelle Batthish, Dr Karen Beattie, Dr Lorraine Bell, Dr Emilie Dionne, Danijela Grahovac, Dr Yani Hamdani, Amanda Higgins, Ariana Wong, Brooke Allemang, Jaime Winkler, Meghan Patton, Dilshad Kassam-Lillani, Sarah Sheffe, Christina Gilman, and Alice Soper, for their insights into the development of this protocol. Dr Gorter is the inaugural chair of the Health Hub in Transition and held the Scotiabank Chair in Child Health Research between 2013 and 2021. Dr Kristin Cleverley holds the CAMH Chair in Mental Health Nursing Research at the University of Toronto.

Drs Toulany, Gorter, and Cleverley and Ms Pidduck conceptualized the design and methods of this systematic review, revised the manuscript, and approved the final manuscript as submitted; Ms Bailey and Dr Lee synthesized the literature, drafted the initial manuscript, revised the manuscript, and approved the final manuscript as submitted; Dr de Los Reyes synthesized the literature, revised the manuscript, and approved the final manuscript as submitted; Ms Lo provided methodologic expertise, revised the manuscript, and approved the final manuscript as submitted; Ms Mahood developed the search strategies and provided methodologic expertise; and all authors provided input and guidance on study design, approved the final manuscript as submitted, and agree to be accountable for all aspects of this systematic review.

This systematic review was registered with the International Prospective Register of Systematic Reviews (https://www.crd.york.ac.uk/prospero/) (identifier CRD42020198030).

COMPANION PAPER: A companion to this article can be found online at www.pediatrics.org/cgi/doi/10.1542/peds.2022-057310.

FUNDING: No external funding.

CONFLICT OF INTERESTS DISCLOSURES: The authors have indicated they have no conflicts of interest relevant to this article to disclose.

AGREE II-QI

Appraisal of Guidelines for Research and Evaluation II Quality Indicators

IOM

Institute of Medicine

PRISMA

Preferred Reporting Items for Systematic Reviews and Meta-Analyses

PROSPERO

International Prospective Register of Systematic Reviews

1
Viner
R
.
Transition from paediatric to adult care. Bridging the gaps or passing the buck?
Arch Dis Child
.
1999
;
81
(
3
):
271
275
2
Camfield
P
,
Camfield
C
.
Transition to adult care for children with chronic neurological disorders
.
Ann Neurol
.
2011
;
69
(
3
):
437
444
3
Kirk
S
.
Transitions in the lives of young people with complex healthcare needs
.
Child Care Health Dev
.
2008
;
34
(
5
):
567
575
4
O’Connell
B
,
Bailey
S
,
Pearce
J
.
Straddling the pathway from paediatrician to mainstream health care: transition issues experienced in disability care
.
Aust J Rural Health
.
2003
;
11
(
2
):
57
63
5
Kaufman
M
,
Pinzon
J
.
Transition to adult care for youth with special health care needs
.
Paediatr Child Health
.
2007
;
12
(
9
):
785
793
6
Islam
Z
,
Ford
T
,
Kramer
T
, et al
.
Mind how you cross the gap! Outcomes for young people who failed to make the transition from child to adult services: the TRACK study
.
BJPsych Bull
.
2016
;
40
(
3
):
142
148
7
Paul
M
,
Ford
T
,
Kramer
T
,
Islam
Z
, %
Harley
K
,
Singh
SP
.
Transfers and transitions between child and adult mental health services
.
Br J Psychiatry Suppl
.
2013
;
54
:
s36
s40
8
Gorter
JW
,
Stewart
D
,
Woodbury-Smith
M
.
Youth in transition: care, health and development
.
Child Care Health Dev
.
2011
;
37
(
6
):
757
763
9
Blum
RW
,
Garell
D
,
Hodgman
CH
, et al
.
Transition from child-centered to adult health-care systems for adolescents with chronic conditions. A position paper of the Society for Adolescent Medicine
.
J Adolesc Health
.
1993
;
14
(
7
):
570
576
10
Pinzon
J
,
Harvey
J
,
Society
CP
,
Committee
AH
.
Care of adolescents with chronic conditions
.
Paediatr Child Health
.
2006
;
11
(
1
):
43
48
11
Shulman
R
,
Shah
BR
,
Fu
L
,
Chafe
R
,
Guttmann
A
.
Diabetes transition care and adverse events: a population-based cohort study in Ontario, Canada
.
Diabet Med
.
2018
;
35
(
11
):
1515
1522
12
Zhao
X
,
Bjerre
LM
,
Nguyen
GC
, et al
.
Health services use during transition from pediatric to adult care for inflammatory bowel disease: a population-based study using health administrative data
.
J Pediatr
.
2018
;
203
:
280
287.e4
13
Annunziato
RA
,
Emre
S
,
Shneider
B
,
Barton
C
,
Dugan
CA
,
Shemesh
E
.
Adherence and medical outcomes in pediatric liver transplant recipients who transition to adult services
.
Pediatr Transplant
.
2007
;
11
(
6
):
608
614
14
Heery
E
,
Sheehan
AM
,
While
AE
,
Coyne
I
.
Experiences and outcomes of transition from pediatric to adult health care services for young people with congenital heart disease: a systematic review
.
Congenit Heart Dis
.
2015
;
10
(
5
):
413
427
15
Blinder
MA
,
Vekeman
F
,
Sasane
M
,
Trahey
A
,
Paley
C
,
Duh
MS
.
Age-related treatment patterns in sickle cell disease patients and the associated sickle cell complications and healthcare costs
.
Pediatr Blood Cancer
.
2013
;
60
(
5
):
828
835
16
Rosen
DS
,
Blum
RW
,
Britto
M
,
Sawyer
SM
,
Siegel
DM
;
Society for Adolescent Medicine
.
Transition to adult health care for adolescents and young adults with chronic conditions: position paper of the Society for Adolescent Medicine
.
J Adolesc Health
.
2003
;
33
(
4
):
309
311
17
Campbell
F
,
Biggs
K
,
Aldiss
SK
, et al
.
Transition of care for adolescents from paediatric services to adult health services
.
Cochrane Database Syst Rev
.
2016
;
4
:
CD009794
18
Luque Ramos
A
,
Hoffmann
F
,
Albrecht
K
,
Klotsche
J
,
Zink
A
,
Minden
K
.
Transition to adult rheumatology care is necessary to maintain DMARD therapy in young people with juvenile idiopathic arthritis
.
Semin Arthritis Rheum
.
2017
;
47
(
2
):
269
275
19
Bohun
CM
,
Woods
P
,
Winter
C
, et al
.
Challenges of intra-institutional transfer of care from paediatric to adult congenital cardiology: the need for retention as well as transition
.
Cardiol Young
.
2016
;
26
(
2
):
327
333
20
Mainz
J
,
Krog
BR
,
Bjørnshave
B
,
Bartels
P
.
Nationwide continuous quality improvement using clinical indicators: the Danish National Indicator Project
.
Int J Qual Health Care
.
2004
;
16
(
Suppl 1
):
i45
i50
21
Donabedian
A
.
Explorations in quality assessment and monitoring. Volume 1, the definition of quality and approaches to its assessment
.
Ann Arbor
:
Health Administration Press
;
1980
22
Brook
RH
,
McGlynn
EA
,
Cleary
PD
.
Measuring quality of care
.
N Engl J Med
.
1996
;
355
:
966
970
23
Hermann
RC
,
Mattke
S
,
Somekh
D
, et al
.
Quality indicators for international benchmarking of mental health care
.
Int J Qual Health Care
.
2006
;
18
(
Suppl 1
):
31
38
24
Hearnshaw
HM
,
Harker
RM
,
Cheater
FM
,
Baker
RH
,
Grimshaw
GM
.
Expert consensus on the desirable characteristics of review criteria for improvement of health care quality
.
Qual Health Care
.
2001
;
10
(
3
):
173
178
25
Sackett
D
,
Richardson
W
,
Rosenberg
W
,
Haynes
RB
.
Evidence-Based Medicine. How to Practice and Teach EBM. Evidence-Based Medicine
.
Churchill Livingston
;
2005
;
2
26
Donabedian
A
.
The quality of care. How can it be assessed?
JAMA
.
1988
;
260
(
12
):
1743
1748
27
Institute of Medicine Committee on Quality of Health Care in America
.
Crossing the Quality Chasm: A New Health System for the 21st Century
.
Washington, DC
:
National Academies Press (US)
;
2001
28
Donabedian
A
.
An Introduction to Quality Assurance in Health Care
.
New York, NY
:
Oxford University Press
;
2002
29
Institute of Medicine
.
Crossing the Quality Chasm: A New Health System for the 21st Century
.
Washington, DC
:
National Academies Press (US)
;
2001
30
Agency for Healthcare Research and Quality
.
AHRQ Quality Indicators
.
Available at: https://qualityindicators.ahrq.gov/. Accessed June 23, 2021
31
Lovaglio
PG
.
Benchmarking strategies for measuring the quality of healthcare: problems and prospects
.
ScientificWorldJournal
.
2012
;
2012
:
606154
32
Health Quality Ontario
.
Results from Health Quality Ontario’s benchmark setting for long-term care indicators
.
33
Codling
S
.
Best Practice Benchmarking: A Management Guide
.
Hampshire, England
:
Gower Publishing, Ltd.
;
1995
34
Mainz
J
.
Defining and classifying clinical indicators for quality improvement
.
Int J Qual Health Care
.
2003
;
15
(
6
):
523
530
35
Sun
HL
,
Breakey
VR
,
Straatman
L
,
Wu
JK
,
Jackson
S
.
Outcomes indicators and processes in transitional care in adolescents with haemophilia: A Delphi survey of Canadian haemophilia care providers
.
Haemophilia
.
2019
;
25
(
2
):
296
305
36
Sobota
AE
,
Shah
N
,
Mack
JW
.
Development of quality indicators for transition from pediatric to adult care in sickle cell disease: a modified Delphi survey of adult providers
.
Pediatr Blood Cancer
.
2017
;
64
(
6
)
37
van den Brink
G
,
van Gaalen
MAC
,
de Ridder
L
,
van der Woude
CJ
,
Escher
JC
.
Health care transition outcomes in inflammatory bowel disease: a multinational Delphi Study
.
J Crohn’s Colitis
.
2019
;
13
(
9
):
1163
1172
38
Toulany
A
,
Gorter
JW
,
Harrison
M
;
Canadian Paediatric Society, Adolescent Health Committee
.
A call for action: recommendations to improve transition to adult care for youth with complex health care needs
.
39
Bailey
K
,
Lee
S
,
de Los Reyes
T
,
Lo
L
,
Gorter
JW
,
Toulany
A
.
Quality indicators for transition from paediatric to adult care for adolescents with chronic physical and mental illness: protocol for a systematic review
.
BMJ Open
.
2021
;
11
(
11
):
e055194
40
Cleverley
K
,
Rowland
E
,
Bennett
K
,
Jeffs
L
,
Gore
D
.
Identifying core components and indicators of successful transitions from child to adult mental health services: a scoping review
.
Eur Child Adolesc Psychiatry
.
2020
;
29
(
2
):
107
121
41
Cooper
M
,
Rouhi
A
,
Barber
CEH
.
A systematic review of quality measures for inflammatory arthritis
.
J Rheumatol
.
2018
;
45
(
2
):
274
283
42
Canada's Drug and Health Technology Agency
.
Grey matters: a practical search tool for evidence-based medicine
.
43
Brouwers
MC
,
Kho
ME
,
Browman
GP
, et al;
AGREE Next Steps Consortium
.
AGREE II: advancing guideline development, reporting and evaluation in health care
.
CMAJ
.
2010
;
182
(
18
):
E839
E842
44
Abrahamyan
L
,
Boom
N
,
Donovan
LR
,
Tu
JV
;
Canadian Cardiovascular Society Quality Indicators Steering Committee
.
An international environmental scan of quality indicators for cardiovascular care
.
Can J Cardiol
.
2012
;
28
(
1
):
110
118
45
Koenders
N
,
van den Heuvel
S
,
Bloemen
S
,
van der Wees
PJ
,
Hoogeboom
TJ
.
Development of a longlist of healthcare quality indicators for physical activity of patients during hospital stay: a modified RAND Delphi study
.
BMJ Open
.
2019
;
9
(
11
):
e032208
46
Peter
WF
,
Hurkmans
EJ
,
van der Wees
PJ
,
Hendriks
EJ
,
van Bodegom-Vos
L
,
Vliet Vlieland
TP
.
Healthcare quality indicators for physiotherapy management in hip and knee osteoarthritis and rheumatoid arthritis: a Delphi study
.
Musculoskelet Care
.
2016
;
14
(
4
):
219
232
47
AGREE Next Steps Consortium
.
The AGREE II Instrument [electronic version]
.
Available at: www.agreetrust.org. Accessed June 5, 2021
48
Fair
C
,
Cuttance
J
,
Sharma
N
, et al;
International and Interdisciplinary Health Care Transition Research Consortium
.
International and interdisciplinary identification of health care transition outcomes
.
JAMA Pediatr
.
2016
;
170
(
3
):
205
211
49
Treadwell
M
,
Hankins
JS
,
King
A
.
Sickle cell disease (SC) in adolescents and young adults (AYA): transition from pediatric to adult care
.
50
Jawaid
N
,
Jeyalingam
T
,
Nguyen
G
,
Bollegala
N
.
Paediatric to adult transition of care in IBD: understanding the current standard of care among Canadian adult academic gastroenterologists
.
J Can Assoc Gastroenterol
.
2019
;
3
(
6
):
266
273
51
Aldiss
S
,
Ellis
J
,
Cass
H
,
Pettigrew
T
,
Rose
L
,
Gibson
F
.
Transition from child to adult care--‘it’s not a one-off event’: development of benchmarks to improve the experience
.
J Pediatr Nurs
.
2015
;
30
(
5
):
638
647
52
National Institute for Healthcare Excellence
.
Transition from children’s to adults’ services: NICE Quality Standard
.
Available at: https://www.nice.org.uk/guidance/qs140. Accessed February 8, 2021
53
Foster
HE
,
Minden
K
,
Clemente
D
, et al
.
EULAR/PReS standards and recommendations for the transitional care of young people with juvenile-onset rheumatic diseases
.
Ann Rheum Dis
.
2017
;
76
(
4
):
639
646
54
Suris
JC
,
Akre
C
.
Key elements for, and indicators of, a successful transition: an international Delphi study
.
J Adolesc Health
.
2015
;
56
(
6
):
612
618
55
Strategy for Patient Oriented Research
.
Putting patients first
.
Available at: https://cihr-irsc.gc.ca/e/documents/spor_framework-en.pdf. Accessed July 18, 2021
56
Cordier
J-F
.
The expert patient: towards a novel definition
.
Eur Respir J
.
2014
;
44
(
4
):
853
857
57
Ennis
L
,
Wykes
T
.
Impact of patient involvement in mental health research: longitudinal study
.
Br J Psychiatry
.
2013
;
203
(
5
):
381
386
58
Cleverley
K
,
McCann
E
,
O’Brien
D
, et al
.
Prioritizing core components of successful transitions from child to adult mental health care: a national Delphi survey with youth, caregivers, and health professionals [published online ahead of print June 5, 2021]
.
Eur Child Adolesc Psychiatry
.
doi:10.1007/s00787-021-01806-6
59
Banner
D
,
Bains
M
,
Carroll
S
, et al
.
Patient and public engagement in integrated knowledge translation research: are we there yet?
Res Involv Engagem
.
2019
;
5
(
1
):
8
60
Hofmeyer
A
,
Scott
C
,
Lagendyk
L
.
Researcher-decision-maker partnerships in health services research: practical challenges, guiding principles
.
BMC Health Serv Res
.
2012
;
12
(
1
):
280
61
Varallyay
NI
,
Langlois
EV
,
Tran
N
,
Elias
V
,
Reveiz
L
.
Health system decision-makers at the helm of implementation research: development of a framework to evaluate the processes and effectiveness of embedded approaches
.
Health Res Policy Syst
.
2020
;
18
(
1
):
64
62
Children’s Healthcare Canada
.
A guideline for transition from paediatric to adult health care for youth with special health care needs: a national approach
.
63
Bindels-de Heus
KG
,
van Staa
A
,
van Vliet
I
,
Ewals
FV
,
Hilberink
SR
.
Transferring young people with profound intellectual and multiple disabilities from pediatric to adult medical care: parents’ experiences and recommendations
.
Intellect Dev Disabil
.
2013
;
51
(
3
):
176
189
64
Brown
M
,
Macarthur
J
,
Higgins
A
,
Chouliara
Z
.
Transitions from child to adult health care for young people with intellectual disabilities: A systematic review
.
J Adv Nurs
.
2019
;
75
(
11
):
2418
2434
65
White
PH
,
Cooley
WC
;
Transitions Clinical Report Authoring Group; American Academy of Pediatrics; American Academy of Family Physicians; American College of Physicians
.
Supporting the health care transition from adolescence to adulthood in the medical home
.
Pediatrics
.
2018
;
142
(
5
):
e20182587
66
Committee on Redesigning Health Insurance Performance Measures, Payment, and Performance Improvement Programs
;
Board on Health Care Services
;
Institute of Medicine of the National Academies
.
Performance Measurement: Accelerating Improvement
.
Washington, DC
:
The National Academies Press
;
2006
67
Lotstein
DS
,
Kuo
AA
,
Strickland
B
,
Tait
F
.
The transition to adult health care for youth with special health care needs: do racial and ethnic disparities exist?
Pediatrics
.
2010
;
126
(
suppl 3
):
S129
S136
68
Bitencourt
N
,
Makris
UE
,
Solow
EB
,
Wright
T
,
Reisch
EJ
,
Bermas
BL
.
Predictors of adverse outcomes in patients with systemic lupus erythematosus transitioning to adult care
.
Semin Arthritis Rheum
.
2021
;
51
(
2
):
353
359
69
Adams
JS
,
Chien
AT
,
Wisk
LE
.
Mental illness among youth with chronic physical conditions
.
Pediatrics
.
2019
;
144
(
1
):
e20181819
70
Ferro
MA
,
Lipman
EL
,
Van Lieshout
RJ
, et al
.
Cohort profile: Multimorbidity in Children and Youth Across the Life-course (MY LIFE) Study
.
J Can Acad Child Adolesc Psychiatry
.
2021
;
30
(
2
):
104
115
71
American Academy of Pediatrics
;
American Academy of Family Physicians
;
American College of Physicians-American Society of Internal Medicine
.
A consensus statement on health care transitions for young adults with special health care needs
.
Pediatrics
.
2002
;
110
(
6
,
pt 2
):
1304
1306
72
van Staa
A
,
Sattoe
JN
,
Strating
MM
.
Experiences with and outcomes of two interventions to maximize engagement of chronically ill adolescents during hospital consultations: a mixed methods study
.
J Pediatr Nurs
.
2015
;
30
(
5
):
757
775
73
Kingsnorth
S
,
Gall
C
,
Beayni
S
,
Rigby
P
.
Parents as transition experts? Qualitative findings from a pilot parent-led peer support group
.
Child Care Health Dev
.
2011
;
37
(
6
):
833
840
74
Price
CS
,
Corbett
S
,
Lewis-Barned
N
,
Morgan
J
,
Oliver
LE
,
Dovey-Pearce
G
.
Implementing a transition pathway in diabetes: a qualitative study of the experiences and suggestions of young people with diabetes
.
Child Care Health Dev
.
2011
;
37
(
6
):
852
860
75
Schwartz
LA
,
Tuchman
LK
,
Hobbie
WL
,
Ginsberg
JP
.
A social-ecological model of readiness for transition to adult-oriented care for adolescents and young adults with chronic health conditions
.
Child Care Health Dev
.
2011
;
37
(
6
):
883
895
76
Stewart
D
,
Freeman
M
,
Law
M
, et al
.
“The best journey to adult life” for youth with disabilities: an evidence-based model and best practice guidelines for the transition to adulthood for youth with disabilities
.
Hamilton, Ontario
:
CanChild Centre for Childhood Disability Research
;
2009
77
Institute of Healthcare Improvement
.
The IHI triple aim
.
Available at: www.ihi.org/Engage/Initiatives/TripleAim/Pages/default.aspx. Accessed September 7, 2021
78
Burns
K
,
Farrell
K
,
Myszka
R
,
Park
K
,
Holmes-Walker
DJ
.
Access to a youth-specific service for young adults with type 1 diabetes mellitus is associated with decreased hospital length of stay for diabetic ketoacidosis
.
Intern Med J
.
2018
;
48
(
4
):
396
402
79
Maeng
DD
,
Snyder
SR
,
Davis
TW
,
Tomcavage
JF
.
Impact of a complex care management model on cost and utilization among adolescents and young adults with special care and health needs
.
Popul Health Manag
.
2017
;
20
(
6
):
435
441
80
GotTransition
.
Six core elements of healthcare transition
.
Available at: https://www.gottransition.org/six-core- elements/. Accessed September 7, 2021
This is an open access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (https://creativecommons.org/licenses/by-nc-nd/4.0/), which permits noncommercial distribution and reproduction in any medium, provided the original author and source are credited.

Supplementary data