OBJECTIVES:

The clinical profile of children who had possible seizures is heterogeneous, and accuracy of diagnostic testing is limited. We aimed to develop and validate a prediction model that determines the risk of childhood epilepsy by combining available information at first consultation.

METHODS:

We retrospectively collected data of 451 children who visited our outpatient department for diagnostic workup related to 1 or more paroxysmal event(s). At least 1 year of follow-up was available for all children who were diagnosed with epilepsy or in whom diagnosis remained inconclusive. Clinical characteristics (sex, age of first seizure, event description, medical history) and EEG report were used as predictor variables for building a multivariate logistic regression model. Performance was validated in an external cohort (n = 187).

RESULTS:

Model discrimination was excellent, with an area under the receiver operating characteristic curve of 0.86 (95% confidence interval [CI]; 0.80–0.92), a positive predictive value of 0.93 (95% CI 0.83–0.97) and a negative predictive value of 0.76 (95% CI 0.70–0.80). Model discrimination in a selective subpopulation of children with uncertain diagnosis after initial clinical workup was good, with an area under the receiver operating characteristic curve of 0.73 (95% CI 0.58–0.87).

CONCLUSIONS:

This model may prove to be valuable because predictor variables together with a first interictal EEG can be available at first consultation. A Web application is provided (http://epilepsypredictiontools.info/first-consultation) to facilitate the diagnostic process for clinicians who are confronted with children with paroxysmal events, suspected of having an epileptic origin.

What’s Known on This Subject:

In clinical practice, epileptic seizures in children often go underrecognized because of the heterogeneous clinical symptoms and limited sensitivity of the initial interictal EEG. As a result, diagnosis of epilepsy may be delayed.

What This Study Adds:

A decision model was built with the clinical information and the initial interictal EEG available at first consultation of 638 children. This model, available to the general readership as a Web application, may facilitate the diagnostic process for clinicians.

A paroxysmal event can be frightful for both children and caregivers.1 When an epileptic origin is considered, the associated psychosocial aspects may negatively influence the child’s health-related quality of life.2,3 Recurrent epileptic seizures may be harmful to the developing brain, leading to cognitive and behavioral deficits.4,6 This emphasizes the need for an early and accurate diagnosis. However, establishing the epileptic origin of a paroxysmal event in children is often challenging in clinical practice, due to a limited sensitivity of heterogeneous clinical symptoms and interictal EEG recordings.7,9 In children with uncertain diagnosis, additional investigations including prolonged or sleep-deprived EEG and MRI are required, with subsequent delay in making a final diagnosis.7,10,11 Otherwise, diagnostic inaccuracy can lead to a false diagnosis of epilepsy, resulting in unnecessary antiepileptic drug treatment or outpatient admissions and delay of other important ancillary investigations. To this end, a clinical tool that facilitates accurate diagnosis of first paroxysmal events in children at initial evaluation would be highly valuable.

Previous efforts to identify prognostic clinical variables after first consultation, focused on the risk of seizure recurrence8,10,12,14 in patients with first indisputable epileptic seizures and patients with ambiguous events, were excluded from further analysis. These restrictions may hamper its value in daily practice because diagnostic inaccuracy of first seizures is common.15 Also, children are not always referred directly after a first possible seizure because of delayed recognition.4,7 

Here, we determined the value of clinical and EEG data routinely available at first consultation and constructed a prediction model to determine the risk of epilepsy at first consultation after 1 or more possible seizures. Model performance was validated with an external cohort. To improve the implementation in clinical practice, we constructed a Web application that may assist clinicians to estimate the individualized probability of epilepsy in children who present after 1 or more possible seizures.

We retrospectively collected clinical data of children referred after 1 or more paroxysmal events, suspected of having an epileptic origin. Data from 451 children who visited the outpatient department of pediatric neurology, University Medical Center Utrecht, between January 2008 and May 2013 were used to build a clinical decision model (development cohort). Data of 187 children who visited the outpatient department of pediatrics, Martini Hospital Groningen, between January 2013 and July 2016 were collected as an external cohort to validate the model (validation cohort). All children were referred by a general practitioner, pediatrician, neurologist, or via the emergency department. In addition to clinical history and physical examination, the report of a standard EEG recording performed at time of first consultation was used. At least 1 year of clinical follow-up was available for all children who were eventually diagnosed with epilepsy and for those whose diagnosis remained inconclusive after initial evaluation. Children in whom diagnosis of epilepsy was discarded directly after first consultation were referred back to their general practitioner with explicit instructions to report new possible seizures. Excluded were children in whom the diagnosis of epilepsy had already been confirmed by the referring health care professional before consultation at the outpatient department. The institutional ethical committees of both hospitals approved the study and concluded that the Dutch Medical Research Involving Human Subjects Act did not apply, and written informed consent was not required.

The outcome measure was presence or absence of epilepsy, defined as: (1) at least 2 unprovoked seizures within 1 year, judged by an experienced child neurologist to be epileptic in origin; or (2) 1 unprovoked seizure and epileptiform EEG abnormalities at first consultation or at later sleep-deprived or prolonged EEG that confirm the diagnosis of an epilepsy syndrome, or the demonstration of a typical epileptogenic brain lesion on MRI. If diagnosis of epilepsy was discarded on the basis of clinical history, EEG results, other ancillary investigations, or at least 1 year of uneventful follow-up, we attempted to reappoint the diagnosis. Children in whom a definitive diagnosis was inconclusive at the end of follow-up, or who were lost to follow-up, were classified as having no epilepsy. The consulting pediatric neurologist always made the definitive diagnosis.

Potential predictor variables were selected from previous cohort studies in children with newly diagnosed epilepsies.16,20 Predictor variables were required to be routinely available at the time of first consultation. Information on age at consultation, sex, age at first event, medical history, relevant family history, psychomotor development, number of events and detailed event description, and the EEG report was available and extracted into separate variables in a database. Age at consultation and at first event were truncated at month level. Medical history of a child was categorized into 3 predictor variables, namely “neurologic history” in the presence of a history of perinatal asphyxia, congenital or acquired brain lesions, head trauma, central nervous system infections, or migraine; “psychiatric history” in the presence of a diagnoses of autism, attention-deficit/hyperactivity disorder or other psychiatric disorders; and “known metabolic or genetic syndrome.” Relevant family history was categorized into the presence or absence of epilepsy, febrile seizures, migraine, and seizures in first- or second-degree relatives; or as “other” when consanguinity of parents, cerebrovascular accidents, or developmental delay was present in first- or second-degree relatives. Psychomotor development was categorized as normal or delayed on the basis of IQ (IQ of ≤70 was considered as intellectual disability) and type of schooling. Categorization was not mutually exclusive in these clinical categorical variables. EEG registrations were evaluated by 2 experienced neurophysiologists, and EEG reports were categorized as the presence (or absence) of focal epileptiform abnormalities if (multi)focal spikes or spike-wave-complexes were reported, generalized epileptiform abnormalities when generalized spikes or spike-wave complexes were reported, and aspecific nonepileptiform abnormalities if no clear epileptiform activity was stated but focal or generalized slowing or other aspecific abnormalities were reported.

Clinical symptoms extracted from the event descriptions provided by caregivers and children were categorized into multiple predictor variables, namely the presence or absence of (1) staring or nonattendance, (2) bilateral jerking or shaking, (3) stiffening or tonic posturing, (4) lateralizing motor symptoms, (5) weakness or loss of muscle tone, (6) sensory signs (such as a sensation of tingling and visual or auditory symptoms), (7) automatism, or (8) autonomic symptoms. Standard seizure classification, as recently proposed by the International League Against Epilepsy (ILAE),21 could not be applied to categorize event description because the majority of the events were eventually nonepileptic in nature.

Two clinicians (E.v.D. and H.J.L.), blinded for the diagnosis at follow-up, classified the event description into the aforementioned predictor variables on the basis of the clinical report. The reproducibility of this classification was tested in a random sample of 20% of patients by an experienced pediatric epileptologist (F.E.J.). Interobserver agreement was calculated with Cohen’s κ coefficient.22 A κ of 1 indicates perfect agreement; 0 indicates agreement equivalent to chance.

Data were missing for the event frequency in 167 (37%) and 31 (17%) children in the training cohort and validation cohort, respectively, and for the age at first event in 147 (33%) and 28 (15%) children, respectively. All other variables were missing in <5 cases (≤1%). We used single imputation for missing values to prevent biased results toward the complete case subjects.23,24 On the basis of the imputed data set, a logistic regression model was built to estimate the log odds of the epilepsy probability as a linear function of the predictor variables. Backward selection using the Akaike information criterion was applied to select the strongest contributing predictor variables that were included in the full model.

The regression model was fitted on the basis of the clinical data from the test cohort (n = 451). The clinical data from the validation cohort (n = 187) was used for external model validation. We tested whether fitting the continuous predictor variables as restricted splines improved the logistic model, which was not the case, so these were kept included with their original values.25 

To assess the contribution of the EEG to the predictive value of multivariate models, we developed 2 submodels in addition to the full linear logistic regression model: 1 based only on clinical predictor variables and 1 with only EEG predictor variables.

The performance of the model was assessed by using a receiver operating characteristic (ROC) curve. Sensitivity, specificity, balanced accuracy, positive predictive values (PPVs), and negative predictive values (NPVs) were computed for different epilepsy probability thresholds, covering the relevant range for clinical decision-making (20%–80%). Analyses were performed in R (http://www.R-project.org).

Data of the training and validation cohort are summarized in Table 1. Accurate information on age at first event was available for 304 children (67%) in the training cohort and 159 children (85%) in the validation cohort. The number of events could be reliably determined for 275 children (61%) and 156 children (83%), respectively. In 203 children (45.0%) of the training cohort, the diagnosis was inconclusive after first consultation and ancillary investigations or follow-up was required; in the validation cohort, the diagnosis was originally inconclusive in 54 children (29%). After at least 1 year of follow-up, a definite classifying diagnosis (epilepsy or not) was available for 425 children (94.2%), and for 26 (5.8%) it remained inconclusive in the training cohort. For the validation cohort, the definite diagnosis was available for 172 children (92%) and remained uncertain for 15 (8%) children (Fig 1). Eventually, 30% of the children from the training cohort received the diagnosis of epilepsy compared with 84 (45%) from the validation cohort. In 1 patient, the initial diagnosis (no epilepsy) changed into epilepsy during follow-up. We provided the etiology (Supplemental Table 4) according to the proposed ILAE classification when possible.26 

TABLE 1

General Characteristics of Included Children

Training CohortValidation Cohort
AllEpilepsyNo EpilepsyAllEpilepsyNo Epilepsy
No. children (%) 451 137 (30) 314 (70) 187 84 (45) 103 (55) 
Male sex, no. (%) 256 (57) 85 (62) 171 (54) 94 (50) 45 (54) 49 (48) 
Age in y, median (IQR) 5.9 (2.6–9.8) 7.3 (4.3–10.5) 4.9 (2.2–9.5) 7.8 (3.3–11.9) 9.6 (4.3–13.2) 6.2 (2.8–10.7) 
Age at first event in y, median (IQR) 4.6 (1.7–8.7) 7.0 (3.6–10.6) 3.4 (1.3–8.1) 5.1 (2.2–11.2) 8.1 (3.4–12.1) 3.5 (1.8–10.0) 
Total No. events, median (IQR) 2 (1–5) 2 (2–6) 2 (1–5) 4 (2–20) 3 (2–13) 6 (2–24) 
Seizure history (no; yes; febrile seizures) 365; 38; 48 99; 19; 19 266; 19; 29 169; 4; 14 72; 1; 11 97; 3; 3 
Delayed development, no. (%) 108 (24) 40 (29) 68 (22) 23 (12) 9 (11) 14 (14) 
Medical history, no. (%)       
 Normal 336 (75) 90 (66) 246 (78) 159 (85) 74 (89) 85 (83) 
 Neurologic 53 (12) 28 (20) 25 (8) 5 (3) 2 (2) 3 (3) 
 Psychiatric 41 (9) 9 (7) 32 (10) 21 (11) 7 (8) 14 (14) 
 Metabolic or genetic syndrome 21 (5) 10 (7) 11 (4) 1 (1) 1 (1) 
Family history, no. (%)       
 Normal 298 (66) 91 (66) 207 (66) 140 (77) 57 (70) 83 (82) 
 Epilepsy 74 (16) 21 (15) 53 (17) 27 (15) 17 (21) 10 (10) 
 Migraine 33 (7) 8 (6) 25 (8) 9 (5) 4 (5) 5 (5) 
 Febrile seizures 27 (6) 8 (6) 19 (6) 6 (3) 3 (4) 3 (3) 
 Other 19 (4) 9 (7) 10 (3) 1 (1) 1 (1) 
Training CohortValidation Cohort
AllEpilepsyNo EpilepsyAllEpilepsyNo Epilepsy
No. children (%) 451 137 (30) 314 (70) 187 84 (45) 103 (55) 
Male sex, no. (%) 256 (57) 85 (62) 171 (54) 94 (50) 45 (54) 49 (48) 
Age in y, median (IQR) 5.9 (2.6–9.8) 7.3 (4.3–10.5) 4.9 (2.2–9.5) 7.8 (3.3–11.9) 9.6 (4.3–13.2) 6.2 (2.8–10.7) 
Age at first event in y, median (IQR) 4.6 (1.7–8.7) 7.0 (3.6–10.6) 3.4 (1.3–8.1) 5.1 (2.2–11.2) 8.1 (3.4–12.1) 3.5 (1.8–10.0) 
Total No. events, median (IQR) 2 (1–5) 2 (2–6) 2 (1–5) 4 (2–20) 3 (2–13) 6 (2–24) 
Seizure history (no; yes; febrile seizures) 365; 38; 48 99; 19; 19 266; 19; 29 169; 4; 14 72; 1; 11 97; 3; 3 
Delayed development, no. (%) 108 (24) 40 (29) 68 (22) 23 (12) 9 (11) 14 (14) 
Medical history, no. (%)       
 Normal 336 (75) 90 (66) 246 (78) 159 (85) 74 (89) 85 (83) 
 Neurologic 53 (12) 28 (20) 25 (8) 5 (3) 2 (2) 3 (3) 
 Psychiatric 41 (9) 9 (7) 32 (10) 21 (11) 7 (8) 14 (14) 
 Metabolic or genetic syndrome 21 (5) 10 (7) 11 (4) 1 (1) 1 (1) 
Family history, no. (%)       
 Normal 298 (66) 91 (66) 207 (66) 140 (77) 57 (70) 83 (82) 
 Epilepsy 74 (16) 21 (15) 53 (17) 27 (15) 17 (21) 10 (10) 
 Migraine 33 (7) 8 (6) 25 (8) 9 (5) 4 (5) 5 (5) 
 Febrile seizures 27 (6) 8 (6) 19 (6) 6 (3) 3 (4) 3 (3) 
 Other 19 (4) 9 (7) 10 (3) 1 (1) 1 (1) 

Values are expressed as mean ± SD unless otherwise indicated. Baseline data are based on the nonimputed data. IQR, interquartile range.

FIGURE 1

Cohort flowchart.

FIGURE 1

Cohort flowchart.

Close modal

The interobserver agreement of event description was excellent, with a Cohen’s κ coefficient of 0.91. The multivariable odds ratio of each predictor variable that contributed to the full model (ie, clinical and EEG data) is provided in Table 2. The predictor variables with the highest odds ratios were those from the EEG report: the presence or absence of generalized epileptiform activity, focal epileptiform activity, or aspecific nonepileptic abnormalities. High odds ratios were also found for the event description predictor variables on automatisms and weakness or loss of muscle tone and for the predictor variable on the presence of a neurologic history.

TABLE 2

Relative Odds Ratio of Each Predictor Variable

Predictor VariablesBOdds Ratio (95% CI)P
(Intercept) −3.79 — — 
Male sex 0.66 1.93 (1.07–3.54) .030 
Age at first event 0.05 1.05 (0.98–1.12) .155 
Event description    
 Automatism 1.63 5.09 (2.47–10.66) <.001 
 Lateralizing symptoms 0.76 2.15 (1.01–4.59) .047 
 Weakness or loss of muscle tone 1.12 3.07 (1.28–7.18) .010 
 Bilateral jerking 0.59 1.80 (0.97–3.34) .064 
 Cramping 0.65 1.92 (0.81–4.45) .130 
Medical history    
 Neurologic 1.34 3.81 (1.67–8.79) .002 
 Metabolic or genetic syndrome 0.79 2.20 (0.63–7.30) .203 
 Psychiatric 0.22 1.24 (0.43–3.31) .678 
EEG findings    
 Focal epileptiform abnormalities 3.20 24.60 (12.18–52.34) <.001 
 Generalized epileptiform abnormalities 3.81 45.06 (15.87–146.28) <.001 
 Aspecific nonepileptiform abnormalities 1.27 3.57 (1.57–8.12) .002 
Predictor VariablesBOdds Ratio (95% CI)P
(Intercept) −3.79 — — 
Male sex 0.66 1.93 (1.07–3.54) .030 
Age at first event 0.05 1.05 (0.98–1.12) .155 
Event description    
 Automatism 1.63 5.09 (2.47–10.66) <.001 
 Lateralizing symptoms 0.76 2.15 (1.01–4.59) .047 
 Weakness or loss of muscle tone 1.12 3.07 (1.28–7.18) .010 
 Bilateral jerking 0.59 1.80 (0.97–3.34) .064 
 Cramping 0.65 1.92 (0.81–4.45) .130 
Medical history    
 Neurologic 1.34 3.81 (1.67–8.79) .002 
 Metabolic or genetic syndrome 0.79 2.20 (0.63–7.30) .203 
 Psychiatric 0.22 1.24 (0.43–3.31) .678 
EEG findings    
 Focal epileptiform abnormalities 3.20 24.60 (12.18–52.34) <.001 
 Generalized epileptiform abnormalities 3.81 45.06 (15.87–146.28) <.001 
 Aspecific nonepileptiform abnormalities 1.27 3.57 (1.57–8.12) .002 

Determined in a multivariate model including both clinical and EEG predictor variables, based on the external validation cohort (n = 187). —, not applicable.

Figure 2 shows ROC curves for the full multivariate model and the 2 submodels as tested on the external validation cohort of 187 children. Excellent discrimination was found for the full model, combining clinical and EEG predictor variables: area under the receiver operating characteristic curve (AUC) of 0.86 (confidence interval [CI] 0.80–0.92). The corresponding sensitivity, specificity, PPV, and NPV are provided in Table 3 for different risk thresholds. The submodel based on only EEG predictor variables outperformed the model based on clinical predictor variables only: AUC of 0.82 (CI 0.77–0.88) versus AUC of 0.67 (CI 0.59–0.74), respectively.

FIGURE 2

ROC curves tested on the external validation cohort (n = 187). The green line represents ROC curve of clinical and EEG predictor variables combined with an AUC of 0.86 (CI 0.80–0.92), the blue line represents ROC curve of EEG predictors with an AUC of 0.82 (CI 0.77–0.88), and the red line represents ROC curve of only clinical predictors with an AUC of 0.67 (CI 0.59–0.74).

FIGURE 2

ROC curves tested on the external validation cohort (n = 187). The green line represents ROC curve of clinical and EEG predictor variables combined with an AUC of 0.86 (CI 0.80–0.92), the blue line represents ROC curve of EEG predictors with an AUC of 0.82 (CI 0.77–0.88), and the red line represents ROC curve of only clinical predictors with an AUC of 0.67 (CI 0.59–0.74).

Close modal
TABLE 3

Diagnostic Performance Measures at Different Probability Thresholds

Risk ThresholdSensitivity (95% CI)Specificity (95% CI)PPV (95% CI)NPV (95% CI)Balanced Accuracy (95% CI)
0.20 0.73 (0.62–0.82) 0.82 (0.73–0.89) 0.76 (0.68–0.83) 0.79 (0.72–0.84) 0.78 (0.71–0.83) 
0.35 0.70 (0.59–0.80) 0.91 (0.84–0.96) 0.87 (0.78–0.93) 0.79 (0.73–0.84) 0.82 (0.76–0.87) 
0.50 0.62 (0.51–0.72) 0.96 (0.90–0.99) 0.93 (0.83–0.97) 0.76 (0.70–0.80) 0.81 (0.74–0.86) 
0.65 0.51 (0.40–0.62) 0.98 (0.93–1.00) 0.96 (0.84–0.99) 0.71 (0.66–0.75) 0.77 (0.70–0.83) 
0.80 0.18 (0.10–0.28) 0.99 (0.05–1.00) 0.94 (0.67–0.99) 0.60 (0.57–0.62) 0.63 (0.55–0.70) 
Risk ThresholdSensitivity (95% CI)Specificity (95% CI)PPV (95% CI)NPV (95% CI)Balanced Accuracy (95% CI)
0.20 0.73 (0.62–0.82) 0.82 (0.73–0.89) 0.76 (0.68–0.83) 0.79 (0.72–0.84) 0.78 (0.71–0.83) 
0.35 0.70 (0.59–0.80) 0.91 (0.84–0.96) 0.87 (0.78–0.93) 0.79 (0.73–0.84) 0.82 (0.76–0.87) 
0.50 0.62 (0.51–0.72) 0.96 (0.90–0.99) 0.93 (0.83–0.97) 0.76 (0.70–0.80) 0.81 (0.74–0.86) 
0.65 0.51 (0.40–0.62) 0.98 (0.93–1.00) 0.96 (0.84–0.99) 0.71 (0.66–0.75) 0.77 (0.70–0.83) 
0.80 0.18 (0.10–0.28) 0.99 (0.05–1.00) 0.94 (0.67–0.99) 0.60 (0.57–0.62) 0.63 (0.55–0.70) 

Obtained from the multivariate model including both clinical and EEG predictor variables. For example, when using the risk threshold of 20%, all patients with a probability > 0.2 will be scored as cases, and the accuracy statistics are computed on the basis of these data. Thresholds are chosen on a cost-benefit analysis of false-positive and false-negative findings and can be changed according to the clinical situation. Sensitivity and specificity were corrected for prevalence of epilepsy in our training cohort.27 To assess the potential value of the model in less straightforward cases, we separately assessed the model in a subgroup of children of the validation cohort in whom diagnosis remained uncertain after first evaluation and where ancillary investigations or follow-up were needed for a definitive diagnosis.

Model performance based on the subgroup of children in whom diagnosis was inconclusive after first consultation from our validation cohort (n = 54) was good, with an AUC of 0.73 (CI 0.58–0.87) when combining EEG and clinical factors (ROC curve in Supplemental Fig 4). Corresponding sensitivity, specificity, PPV, NPV, and balance accuracy values are provided in Supplemental Table 5.

We built a Web application (http://epilepsypredictiontools.info/first-consultation) (Supplemental Table 6) that enables clinicians to explore the added clinical value of the model in daily practice and compute the probability for the diagnosis of epilepsy for an individual child who presents with 1 or more paroxysmal events.

In this study, we show that the diagnosis of epilepsy can be computed with a high likelihood in children at first consultation after 1 or more paroxysmal events, with a limited set of predictor variables and the availability of a first interictal EEG.

Early and accurate diagnosis (or exclusion) of epilepsy after a suspected event will diminish patients’ ignorance but also wrongly applied stigmata, will improve self-management, and prevent unnecessary antiepileptic drug treatment and the burden of noncontributing ancillary investigations in children who are wrongly diagnosed. Our model provides a rational approach to assist clinicians during the diagnostic process by combining routinely available clinical information in a multivariate way. More specifically, we expect our model to be useful as an “independent” screening tool to assess the likelihood of a possible seizure to be epileptic in origin and to help the clinician decide on the need for ancillary investigations or refer to an epileptologist.

We consciously do not propose a single cutoff value for clinical decision-making because this is a decision rather than a diagnostic model. Our prediction tool can help the clinician to decide whether ancillary investigations or referral to an epileptologist are necessary, which is especially preferable for children where the risk is neither high nor low. Additionally, high-risk cases are identified quickly, and appropriate actions can be taken early in the process (see Fig 3). Therefore, the merit of the model lies mainly with the general (pediatric) neurologist or pediatrician with access to EEG. In addition, it could be of use for the epileptologist to add in the prognosis of clinically more complicated cases in which diagnosis remains unclear after first consultation.

FIGURE 3

Three clinical cases seen at our outpatient department. Probability of epilepsy was calculated by using the model described in this manuscript.

FIGURE 3

Three clinical cases seen at our outpatient department. Probability of epilepsy was calculated by using the model described in this manuscript.

Close modal

Predictor variables obtained from the EEG report strongly contributed to the discriminative power of the full multivariate model, which reflects daily practice. History taking is without doubt an important diagnostic instrument because it provides a coherent sequence of all the information provided.28 However, subjective reporting might obscure its value for clinical decision-making. The submodel based on EEG predictors alone showed a superior performance as compared with the submodel with only clinical predictor variables. Nevertheless, after assessing the most important aspect, whether the event is epileptic in origin, a treating physician aims to classify the specific seizure type and epilepsy syndrome to initiate adequate treatment and predict prognosis. Here, clinical information is indispensable, and a standard EEG recording alone will be insufficient. Conversely, EEG predictors showed an inferior performance compared with clinical predictors when tested on children in whom diagnosis remained uncertain after first consultation (Supplemental Fig 4). Again, this reflects the actual clinical situation in which incongruent EEG findings might obfuscate clinical diagnosis.

A main strength of this study is the clinical applicability of the model. We collected data from a cohort of children after 1 or more paroxysmal events with at least 1 year of follow-up, rather than restricting ourselves to a predefined patient cohort, and built the model with clinical data that are routinely collected in standard care. We included all newly presented patients irrespective of the number and nature of possible events before consultation. We believe that this approach will allow a better translation to daily practice because actual first seizures are often underrecognized and may only be recalled in retrospect.4,7,15 Secondly, clinical follow-up was available in all children diagnosed with epilepsy. This follow-up adds crucial information to the model and prevents it from a circular reasoning, particularly in children who presented with a single seizure and had epileptiform EEG activity. Finally, model performance was tested with an external cohort and a subcohort of clinically more difficult cases. The discrimination of the model was good in these validations. We do not claim to present a diagnostic tool; obviously, it is up to the clinician to finally conclude whether a child may truly have epilepsy and whether ancillary diagnostics or treatment is indicated.

This study has limitations. The incidence of epilepsy in both our patients’ cohorts was lower than in other comparable cohorts,7,29,30 which might reflect a more liberal referral and selection policy to our clinics and may hamper its applicability to other medical centers. Second, although PPV and NPV remain excellent at higher-risk thresholds (Table 3), sensitivity is lower at high thresholds. This is a limitation of the model but not necessarily a problem in daily practice. If, for a specific patient, the clinician wants to minimize the risk of falsely rejecting the diagnosis of epilepsy, clinical follow-up and ancillary investigations will likely be performed. Increasing the number of children in future validation studies allows the inclusion of more predictors that could be useful to boost the sensitivity of the model at higher-risk thresholds. Third, we used generic categories based on unambiguous symptoms provided by the children or their caregivers to classify the event description. Although the interobserver variability was low, suggesting a reliable classification, an accurate event description depends on a good observation, and some symptoms might be difficult to recognize or recall. Information on event description was collected for most cases through a standardized questionnaire at the outpatient department and processed retrospectively for our study. Collecting data prospectively could further diminish missing data and improve uniformity of data, thereby possibly improving strength of predictor variables. No explicit follow-up data were collected for the children in whom the diagnosis of epilepsy was discarded directly after first consultation, which could have introduced false-negatives in our outcome variable. Nonetheless, we think the percentage of false-negatives is low because these children were referred back to their general practitioner or referral specialist with explicit instructions to report new suspected events, if any, and there is a close collaboration with health care providers in the region of the 2 institutions that participated in this study. In addition, previous research in a similar cohort has revealed that the risk of false-negatives is small.29 Similarly, a subset of children in whom a single seizure was evaluated to be epileptic in origin was not diagnosed with epilepsy if ancillary investigations did not reveal epileptiform abnormalities or underlying epileptogenic brain lesions. Some of those children might develop epilepsy in the time beyond our follow-up period.13,14 

Clinical models to assess the diagnosis of epilepsy based on clinical information available at first consultation in children with one or paroxysmal events are currently lacking. Our results indicate that a multivariable decision model may be valuable at first consultation in children presenting with possible seizures. Future research should evaluate the added value of a decision model in clinical practice to manage expectations of patients and caregivers to prompt interventions.

AUC

area under the receiver operating characteristic curve

CI

confidence interval

ILAE

International League Against Epilepsy

NPV

negative predictive value

PPV

positive predictive value

ROC

receiver operating characteristic

Dr van Diessen designed the study, collected the patient data, performed statistical analysis, and wrote the manuscript; Dr Lamberink collected the patient data, performed statistical analysis, and wrote the manuscript; Dr Otte designed the study, performed statistical analysis, and wrote the manuscript; Drs Doornebal and Brouwer collected the patient data and commented on the statistical analysis and the manuscript; Dr Jansen designed the study, collected the patient data, and commented on the statistical analysis and the manuscript; Dr Braun designed the study and commented on the statistical analysis and the manuscript; and all authors approved the final manuscript as submitted and agree to be accountable for all aspects of the work.

FUNDING: Dr van Diessen was supported by the Dutch National Epilepsy Fund (NEF 09-93).

1
Besag
FM
,
Nomayo
A
,
Pool
F
.
The reactions of parents who think that a child is dying in a seizure–in their own words.
Epilepsy Behav
.
2005
;
7
(
3
):
517
523
[PubMed]
2
Hamiwka
L
,
Singh
N
,
Niosi
J
,
Wirrell
E
.
Perceived health in children presenting with a “first seizure”.
Epilepsy Behav
.
2008
;
13
(
3
):
485
488
[PubMed]
3
Modi
AC
,
King
AS
,
Monahan
SR
,
Koumoutsos
JE
,
Morita
DA
,
Glauser
TA
.
Even a single seizure negatively impacts pediatric health-related quality of life.
Epilepsia
.
2009
;
50
(
9
):
2110
2116
[PubMed]
4
Berg
AT
,
Loddenkemper
T
,
Baca
CB
.
Diagnostic delays in children with early onset epilepsy: impact, reasons, and opportunities to improve care.
Epilepsia
.
2014
;
55
(
1
):
123
132
[PubMed]
5
O’Callaghan
FJ
,
Lux
AL
,
Darke
K
, et al
.
The effect of lead time to treatment and of age of onset on developmental outcome at 4 years in infantile spasms: evidence from the United Kingdom Infantile Spasms Study.
Epilepsia
.
2011
;
52
(
7
):
1359
1364
[PubMed]
6
Berg
AT
,
Zelko
FA
,
Levy
SR
,
Testa
FM
.
Age at onset of epilepsy, pharmacoresistance, and cognitive outcomes: a prospective cohort study.
Neurology
.
2012
;
79
(
13
):
1384
1391
[PubMed]
7
Hamiwka
LD
,
Singh
N
,
Niosi
J
,
Wirrell
EC
.
Diagnostic inaccuracy in children referred with “first seizure”: role for a first seizure clinic.
Epilepsia
.
2007
;
48
(
6
):
1062
1066
[PubMed]
8
Stroink
H
,
Brouwer
OF
,
Arts
WF
,
Geerts
AT
,
Peters
AC
,
van Donselaar
CA
.
The first unprovoked, untreated seizure in childhood: a hospital based study of the accuracy of the diagnosis, rate of recurrence, and long term outcome after recurrence. Dutch study of epilepsy in childhood.
J Neurol Neurosurg Psychiatry
.
1998
;
64
(
5
):
595
600
[PubMed]
9
Dayan
PS
,
Lillis
K
,
Bennett
J
, et al;
Pediatric Emergency Department Northeast Team of the Pediatric Emergency Care Applied Research Network (PECARN)
.
Interobserver agreement in the assessment of clinical findings in children with first unprovoked seizures.
Pediatrics
.
2011
;
127
(
5
). Available at: www.pediatrics.org/cgi/content/full/127/5/e1266
[PubMed]
10
Shinnar
S
,
Kang
H
,
Berg
AT
,
Goldensohn
ES
,
Hauser
WA
,
Moshé
SL
.
EEG abnormalities in children with a first unprovoked seizure.
Epilepsia
.
1994
;
35
(
3
):
471
476
[PubMed]
11
King
MA
,
Newton
MR
,
Jackson
GD
, et al
.
Epileptology of the first-seizure presentation: a clinical, electroencephalographic, and magnetic resonance imaging study of 300 consecutive patients.
Lancet
.
1998
;
352
(
9133
):
1007
1011
[PubMed]
12
Hirtz
DG
,
Ellenberg
JH
,
Nelson
KB
.
The risk of recurrence of nonfebrile seizures in children.
Neurology
.
1984
;
34
(
5
):
637
641
[PubMed]
13
Camfield
PR
,
Camfield
CS
,
Dooley
JM
,
Tibbles
JA
,
Fung
T
,
Garner
B
.
Epilepsy after a first unprovoked seizure in childhood.
Neurology
.
1985
;
35
(
11
):
1657
1660
[PubMed]
14
Shinnar
S
,
Berg
AT
,
Moshé
SL
, et al
.
Risk of seizure recurrence following a first unprovoked seizure in childhood: a prospective study.
Pediatrics
.
1990
;
85
(
6
):
1076
1085
[PubMed]
15
Leung
H
,
Man
CY
,
Hui
ACF
,
Wong
KS
,
Kwan
P
.
Agreement between initial and final diagnosis of first seizures, epilepsy and non-epileptic events: a prospective study.
J Neurol Neurosurg Psychiatry
.
2008
;
79
(
10
):
1144
1147
[PubMed]
16
Berg
AT
,
Testa
FM
,
Levy
SR
.
Complete remission in nonsyndromic childhood-onset epilepsy.
Ann Neurol
.
2011
;
70
(
4
):
566
573
[PubMed]
17
Arts
WFM
,
Brouwer
OF
,
Peters
ACB
, et al
.
Course and prognosis of childhood epilepsy: 5-year follow-up of the Dutch study of epilepsy in childhood.
Brain
.
2004
;
127
(
pt 8
):
1774
1784
[PubMed]
18
Sillanpää
M
,
Jalava
M
,
Kaleva
O
,
Shinnar
S
.
Long-term prognosis of seizures with onset in childhood.
N Engl J Med
.
1998
;
338
(
24
):
1715
1722
[PubMed]
19
Geerts
A
,
Arts
WF
,
Stroink
H
, et al
.
Course and outcome of childhood epilepsy: a 15-year follow-up of the Dutch study of epilepsy in childhood.
Epilepsia
.
2010
;
51
(
7
):
1189
1197
[PubMed]
20
Camfield
C
,
Camfield
P
,
Gordon
K
,
Smith
B
,
Dooley
J
.
Outcome of childhood epilepsy: a population-based study with a simple predictive scoring system for those treated with medication.
J Pediatr
.
1993
;
122
(
6
):
861
868
[PubMed]
21
Fisher
RS
,
Cross
JH
,
French
JA
, et al
.
Operational classification of seizure types by the International League Against Epilepsy: position paper of the ILAE commission for classification and terminology.
Epilepsia
.
2017
;
58
(
4
):
522
530
[PubMed]
22
Viera
AJ
,
Garrett
JM
.
Understanding interobserver agreement: the kappa statistic.
Fam Med
.
2005
;
37
(
5
):
360
363
[PubMed]
23
Greenland
S
,
Finkle
WD
.
A critical look at methods for handling missing covariates in epidemiologic regression analyses.
Am J Epidemiol
.
1995
;
142
(
12
):
1255
1264
[PubMed]
24
Donders
ART
,
van der Heijden
GJMG
,
Stijnen
T
,
Moons
KGM
.
Review: a gentle introduction to imputation of missing values.
J Clin Epidemiol
.
2006
;
59
(
10
):
1087
1091
[PubMed]
25
Durrleman
S
,
Simon
R
.
Flexible regression models with cubic splines.
Stat Med
.
1989
;
8
(
5
):
551
561
[PubMed]
26
Scheffer
IE
,
Berkovic
S
,
Capovilla
G
, et al
.
ILAE classification of the epilepsies: position paper of the ILAE commission for classification and terminology.
Epilepsia
.
2017
;
58
(
4
):
512
521
[PubMed]
27
Mercaldo
ND
,
Lau
KF
,
Zhou
XH
.
Confidence intervals for predictive values with an emphasis to case-control studies.
Stat Med
.
2007
;
26
(
10
):
2170
2183
[PubMed]
28
Guerrini
R
.
Epilepsy in children.
Lancet
.
2006
;
367
(
9509
):
499
524
[PubMed]
29
Stroink
H
,
van Donselaar
CA
,
Geerts
AT
,
Peters
ACB
,
Brouwer
OF
,
Arts
WFM
.
The accuracy of the diagnosis of paroxysmal events in children.
Neurology
.
2003
;
60
(
6
):
979
982
[PubMed]
30
Uldall
P
,
Alving
J
,
Hansen
LK
,
Kibaek
M
,
Buchholt
J
.
The misdiagnosis of epilepsy in children admitted to a tertiary epilepsy centre with paroxysmal events.
Arch Dis Child
.
2006
;
91
(
3
):
219
221
[PubMed]

Competing Interests

POTENTIAL CONFLICT OF INTEREST: The authors have indicated they have no potential conflicts of interest to disclose.

FINANCIAL DISCLOSURE: The authors have indicated they have no financial relationships relevant to this article to disclose.

Supplementary data