- Research
- Open access
- Published:
Prediction nomogram for coronary artery aneurysms at one month in Kawasaki disease
Italian Journal of Pediatrics volume 49, Article number: 146 (2023)
Abstract
Background
Coronary status at one month after Kawasaki disease (KD) onset had a great significance. The present study aimed to establish a prediction model for coronary artery aneurysms (CAA) at one month in children with KD.
Methods
Patients with a diagnosis of KD between May 2017 and Dec 2018 were enrolled as the development cohort to build a prediction model. The model was validated by internal and external validation. Patients between Jan 2019 and Dec 2019 were enrolled as the validation cohort. The adaptive least absolute shrinkage and selection operator (LASSO) was used to select the possible predictors. Receiving operating characteristic curve (ROC), calibration plots, and decision curve analysis (DCA) were used to evaluate the performance of the model. The performance of the Son score was also assessed.
Results
LASSO regression demonstrated that age, sex, and CALs in the acute stage were predictors for CAA at one month. The area under the ROC (AUC) was 0.946 (95% confidence interval: 0.911–0.980) with a sensitivity of 92.5% and a specificity of 90.5%. The calibration curve and the DCA showed a favorable diagnostic performance. The internal and external validation proved the reliability of the prediction model. The AUC of our model and the Son score were 0.941 and 0.860, respectively (P < 0.001).
Conclusion
Our prediction model for CAA at one month after disease onset in KD had an excellent predictive utility.
Background
Kawasaki disease (KD) is one of the most common pediatric vasculitis all over the world. It is responsible for most acquired heart diseases due to its predilection for coronary arteries [1]. The incidence of coronary artery lesions (CALs) was reported to be approximately 25% in untreated patients [1]. Fortunately, nowadays these patients benefit greatly from the standard treatment regimen of intravenous immunoglobulin (IVIG) and aspirin in the acute stage. Most dilations were reported to resolve within 4 to 8 weeks of disease onset [2,3,4]. However, some coronary artery aneurysms (CAA), especially large or giant CAA, will persist for a long time, leading to a higher cardiac event risk in later life [3, 5, 6].
It was reported baseline CAA was associated with persistent CAA in Western countries whereas recent studies found that more than half of the coronary artery dilations recovered one month after disease onset, drawing a conclusion that CAA at one month after disease onset was of great significance and could act as a guide for late coronary outcomes [3, 4, 7,8,9]. Previously, Son and his colleagues established a risk model for CAA at 2 to 8 weeks in North America, which was identified to have a poor performance in the Japanese population [10, 11]. In China, the existing scoring systems for CAA were predictive of the occurrence of CAA in acute KD when the predictive model for CAA at one month after disease onset was still lacking [12, 13]. Therefore, the present study was designed to: (1) create a risk model for CAA prediction at one month with development and validation cohorts in an East China population. (2) identify the predictive utility of the Son score using data from this area. We aimed to facilitate the prediction of CAA at one month in clinical practice and further alleviate the unnecessary worries of the parents of patients with CAA which could possibly resolve over time.
Materials and methods
Patients
The study was conducted in Children’s Hospital of Soochow University. Children’s Hospital of Soochow University is a tertiary hospital that serves most patients in this area and some patients in surrounding areas. Patients with a diagnosis of KD between May 2017 and Dec 2018 were enrolled as the development cohort (DC), and patients between Jan 2019 and Dec 2019 were enrolled as the validation cohort (VC). Exclusion criteria were as follows: 1. Patients with initial IVIG in other hospitals, 2. Patients with incomplete echocardiographic data in the acute stage, 3. Patients with lost follow-up at one month after disease onset, 4. Patients with recurrent KD. As a result, a total of 599 patients were included in the DC and 370 patients were enrolled in the VC (Fig. 1).
The study was approved by the institutional review board of Children’s Hospital of Soochow University (No:2023cs031).
Definitions
Diagnosis of KD was based on the 2017 AHA guideline [1]. A total of 2 g/kg IVIG in a single dose together with 30–50 mg/kg aspirin was administered in KD patients. For patients who were afebrile for 3–4 days, aspirin was then reduced to 3–5 mg/kg/day until the patients showed no evidence of CALs by 6 to 8 weeks after the onset of illness. Delayed IVIG treatment was defined as IVIG initiation after the 10th day of illness. We calculated the Z scores of the left main coronary artery, left circumflex artery, left descending artery, and right coronary artery based on the method reported and CAA was defined by a Z score ≥ 2.5 [14]. No involvement of coronary arteries was defined as a Z score always < 2. Dilation was defined when the maximum Z score was between 2 and 2.5. A small aneurysm was defined when the maximum Z score was between 2.5 and 5.0. A medium aneurysm was defined when the maximum Z score was 5.0 and 10.0, and a giant aneurysm was defined when the maximum Z score was ≥ 10. IVIG resistance was defined as a persistent or recurrent fever ≥ 38.0 ℃ for more than 36 h.
According to the Son score, 2 points were assigned if the maximum Z score at baseline was ≥ 2, 1 point if age at fever onset was < 6 months, 1 point if Asian ethnicity was reported, and 1 point if baseline C-reactive protein (CRP) was ≥ 130 mg/L [10]. Because our study population were Chinese, all the patients had 1 point at baseline for ethnicity.
Data collection
The medical data were prospectively collected. The body weight and height were collected to calculate the Z scores. Echocardiograms were performed before or within the first two days of IVIG treatment and were repeated before discharge and at four weeks (± one week). If the patients had severe complications, echocardiograms were repeated as appropriate. Medical data was collected which included demographics, incomplete KD, use of IVIG, days of IVIG initiation, response to IVIG treatment, total fever duration, and echocardiographic findings. Laboratory variable of CRP was also obtained to calculate the Son score. The putative predictors were chosen based on previous work that showed their potential prognostic value in CALs and on our clinical experience [4, 10, 12, 15].
Statistical analyses
The sample size was derived based on the available data. Categorical variables were expressed as numbers and percentages. Continuous variables were shown as median with mean ± standard deviation (SD) or median with quartiles. In comparisons between two groups, Mann–Whitney U test, Student’s t test or chi-square test was used as appropriate. A penalised model of the adaptive least absolute shrinkage and selection operator (LASSO) was used to select the possible predictors because multicollinearity was present among CALs in the acute stage and other predictors. The performance of the model was evaluated by area under the receiving operating characteristic curve (AUC), calibration plots, and decision curve analysis (DCA). A nomogram risk prediction model was also established in the development cohort.
Model validation was done in two steps. First, we did an internal validation using a bootstrap resampling process to provide an unbiased estimate of model performance. Second, to assess external validity, the prediction accuracy of CAA at one month was determined on the validation cohort by computing the AUC, calibration plots, and DCA. Delong’s test was used to compare the AUC of two models. Minimum sample size required for the new model development was also calculated. All the data were analyzed using R for Windows (Version 4.0.4) with pmsampsize, glmnet, rms, rmda, caret, and pROC packages. Two-sided P < 0.05 was considered statistically significant.
Results
Patient characteristics
A total of 599 patients were enrolled in the DC including 372 males and 227 females. The minimum sample size calculated was 319 (R2 of the model was 0.2 and the number of variables was 8). The male-to-female ratio was 1.64. Fifty-three (8.8%) patients had CAA at one month. The comparisons of patients with and without CAA at one month are shown in Table 1. Patients with CAA at one month were younger, had later IVIG initiation, and had higher incidences of CALs in the acute stage. They also tended to have a longer fever duration, although the difference was not statistically significant (P = 0.054).
Three hundred and seventy patients were enrolled in the VC and comparisons between DC and VC are shown in Table 2. The two cohorts differed in age, days of IVIG at initiation, and CALs in the acute stage. However, no difference was found regarding sex, complete KD, use of IVIG, total fever duration, and IVIG resistance.
Screening for predictive factors and prediction model development
Predictors selected by LASSO regression were age, sex, and CALs in the acute stage (Fig. 2). These three predictors were integrated into the nomogram (Fig. 3). For each patient, a higher total point indicates a higher risk of CAA at one month. When the total points reached 75, an estimated incidence of CAA at one month was approximately 100%.
Accuracy and net benefit of the model
In the DC, the AUC of the model was 0.946 (95% confidence interval [CI]: 0.911–0.980) with a sensitivity of 92.5% and a specificity of 90.5% (Fig. 4A). Using ten-fold cross-validation, the AUC of the model was 0.930. The calibration curve was close to the ideal diagnostic line (Fig. 5A). The DCA showed significantly better net benefit in the predictive model (Fig. 6A). Another VC was used for external validation. The AUC was 0.947 (95% CI: 0.909–0.985) with a sensitivity of 93.0% and a specificity of 88.7% (Fig. 4B). Meanwhile, the model had good consistency, and the calibration curve of the validation cohort was also close to the ideal diagonal line (Fig. 5B). Moreover, the DCA showed a significant net benefit of the validation cohort (Fig. 6B).
Evaluation of the son score
A total of 967 patients were enrolled to evaluate the performance of the Son score after excluding two patients with incomplete CRP. Two hundred and seventy-nine patients had a high-risk score, defined as ≥ 3 points, among whom 90 (32.3%) showed CAA at one month. At the cutoff ≥ 3 points, the sensitivity was 93.8%, the specificity was 78.3%, the positive predictive value was 32.3%, and the negative predictive value was 99.1%. The AUC for the Son score was 0.860 (95% CI: 0.832–0.888). DeLong's test for ROC curves of the Son score and our model showed the difference was statistically significant (AUC 0.860 vs. 0.941, P < 0.001).
Discussion
In the present study, we developed a model for predicting CAA at one month in KD. The prediction model included age, sex, and CALs in the acute stage, which exhibited good performance in both the DC and VC. Besides, we evaluated the performance of the Son score, and found that although its sensitivity was quite high, it was no better than our prediction model in our cohort. These findings shed light on an early estimation of CAA at one month after KD onset.
Arteritis in KD model experienced three pathological processes, of which one month after disease onset fell into the subacute stage [1]. Pathologically, the coronary arteries were infiltrated with lymphocytes, plasma cells, and eosinophils without luminal myofibroblastic proliferation [1]. Clinically, patients were in the convalescent stage and routine follow-up was performed during this period [16]. Also, the Japanese Circulation Society guidelines of KD classified the severity of CALs based on the echocardiographic or coronary angiographic findings at one month from the onset [17]. Taken together, the coronary artery status at one month had a practical significance and an outsize role in clinical practice.
In previous multicenter studies in Japan and North America, an increased baseline Z score was recognized as a major risk factor for CALs at 1–2 months [8, 18, 19]. We also found that coronary artery status in the acute stage had a prominent predictive role in our model. When we classified acute CALs into five categories based on Z score, we found that dilations could possibly resolve and giant CAA would possibly persist, when the small and medium CAA were intermediate. Our results were in consistence with Ryusuke Ae’s [4]. He and his colleagues found that four-fifths of patients with dilatations improved at one month when aneurysms were less likely to improve over time. Indeed, larger aneurysms were prone to have a relatively poor prognosis, suffering from a series of cardiovascular events in later life [3, 5, 6].
Younger males were considered to be more vulnerable to KD. Moreover, younger age and males had been widely reported as risk factors for CALs in the acute stage, as well as at 1–2 months in a number of previous studies [8, 18,19,20]. Although the specific mechanism remained unclear, we speculated it might be related to the vulnerability of the immature coronary arteries in male infants caused by inflammation. Thus, pediatricians should pay more attention to these younger males with regard to a relatively unsatisfactory outcome. Unlike the results in the Post RAISE studies, IVIG resistance was not considered a risk factor in the present study [18, 19]. The AUC of IVIG resistance was 0.549 with a sensitivity of 15.6% and a specificity of 94.3%. The underlying reasons might be the divergence in different definitions of CALs, when we used Dallaire’s Z score equation and the Post RAISE studies used either Kobayashi’s Z score equation or the absolute coronary diameters to define CALs. Otherwise, there was no difference in CAAs between patients with and without IVIG resistance in our study, as was reported in another study which was carried out in Anhui, China [13].
When we compared our model with the Son score, we found that the latter was not more predictive than our model, although the Son score had a better performance in our cohort than in a Japanese one [11]. The reasons might lie in the different ethnic backgrounds of the patients enrolled and the unsatisfactory performance of CRP with an AUC of 0.557 (sensitivity: 27.1%, specificity: 84.3%) in our study. Actually, CRP was recognized as an independent risk factor of IVIG resistance rather than CALs in the acute stage in most studies.
The present study has several limitations. First, we excluded 255 patients who were lost in the one-month follow-up, which could lead to bias because most of the lost patients had less severe CALs in the acute stage and wouldn’t follow the doctor's advice after discharge. Second, the patients enrolled in our study were all Chinese, which would not guarantee the performance of the model in other nations. Moreover, a multicenter study is warranted in the future.
Conclusion
Our prediction model for CAA at one month after disease onset in KD had an excellent predictive utility.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Abbreviations
- KD:
-
Kawasaki disease
- CALs:
-
Coronary artery lesions
- IVIG:
-
Intravenous immunoglobulin
- CAA:
-
Coronary artery aneurysms
- DC:
-
Development cohort
- VC:
-
Validation cohort
- CRP:
-
C-reactive protein
- SD:
-
Standard deviation
- LASSO:
-
Adaptive least absolute shrinkage and selection operator
- AUC:
-
Area under the receiving operating characteristic curve
- ROC:
-
Receiving operating characteristic curve
- DCA:
-
Decision curve analysis
References
McCrindle BW, Rowley AH, Newburger JW, Burns JC, Bolger AF, Gewitz M, et al. Diagnosis, treatment, and long-term management of Kawasaki disease: a scientific statement for health professionals from the american heart association. Circulation. 2017;135(17):e927–99.
Tang Y, Yan W, Sun L, Xu Q, Ding Y, Lv H. Coronary artery aneurysm regression after Kawasaki disease and associated risk factors: a 3-year follow-up study in East China. Clin Rheumatol. 2018;37(7):1945–51.
Lin MT, Sun LC, Wu ET, Wang JK, Lue HC, Wu MH. Acute and late coronary outcomes in 1073 patients with Kawasaki disease with and without intravenous gamma-immunoglobulin therapy. Arch Dis Child. 2015;100(6):542–7.
Ae R, Abrams JY, Maddox RA, Schonberger LB, Nakamura Y, Kuwabara M, et al. Outcomes in Kawasaki disease patients with coronary artery abnormalities at admission. Am Heart J. 2020;225:120–8.
Suda K, Iemura M, Nishiono H, Teramachi Y, Koteda Y, Kishimoto S, et al. Long-term prognosis of patients with Kawasaki disease complicated by giant coronary aneurysms: a single-institution experience. Circulation. 2011;123(17):1836–42.
Bang JS, Kim GB, Kwon BS, Song MK, An HS, Song YW, et al. Long-Term prognosis for patients with kawasaki disease complicated by large coronary aneurysm (diameter ≥6 mm). Korean Circ J. 2017;47(4):516–22.
Chbeir D, Gaschignard J, Bonnefoy R, Beyler C, Melki I, Faye A, et al. Kawasaki disease: abnormal initial echocardiogram is associated with resistance to IV Ig and development of coronary artery lesions. Pediatr Rheumatol Online J. 2018;16(1):48.
Son MBF, Gauvreau K, Kim S, Tang A, Dedeoglu F, Fulton DR, et al. Predicting coronary artery aneurysms in Kawasaki disease at a North American Center: an assessment of baseline z scores. J Am Heart Assoc. 2017;6(6):e005378.
Wang Q, Morikawa Y, Akahoshi S, Miyata K, Sakakibara H, Matsushima T, et al. Follow-up duration of echocardiography in patients with kawasaki disease with no initial coronary aneurysms. J Pediatr. 2022;244:133-8.e1.
Son MBF, Gauvreau K, Tremoulet AH, Lo M, Baker AL, de Ferranti S, et al. Risk model development and validation for prediction of coronary artery aneurysms in Kawasaki disease in a north american population. J Am Heart Assoc. 2019;8(11):e011319.
Miyata K, Miura M, Kaneko T, Morikawa Y, Matsushima T, Sakakibara H, et al. Evaluation of a kawasaki disease risk model for predicting coronary artery aneurysms in a Japanese population: an analysis of post RAISE. J Pediatr. 2021;237(96–101):e3.
Hua W, Ma F, Wang Y, Fu S, Wang W, Xie C, et al. A new scoring system to predict Kawasaki disease with coronary artery lesions. Clin Rheumatol. 2019;38(4):1099–107.
Liu HH, Chen WX, Niu MM, Jiang Q, Qiu Z, Fan GZ, et al. A new scoring system for coronary artery abnormalities in Kawasaki disease. Pediatr Res. 2022;92(1):275–83.
Dallaire F, Dahdah N. New equations and a critical appraisal of coronary artery Z scores in healthy children. J Am Soc Echocardiogr. 2011;24(1):60–74.
Harada K. Intravenous gamma-globulin treatment in Kawasaki disease. Acta Paediatr Jpn. 1991;33(6):805–10.
Tremoulet AH, Jain S, Chandrasekar D, Sun X, Sato Y, Burns JC. Evolution of laboratory values in patients with Kawasaki disease. Pediatr Infect Dis J. 2011;30(12):1022–6.
Fukazawa R, Kobayashi J, Ayusawa M, Hamada H, Miura M, Mitani Y, et al. JCS/JSCS 2020 Guideline on diagnosis and management of cardiovascular sequelae in Kawasaki disease. Circ J. 2020;84(8):1348–407.
Miyata K, Miura M, Kaneko T, Morikawa Y, Sakakibara H, Matsushima T, et al. Risk Factors of coronary artery abnormalities and resistance to intravenous immunoglobulin plus corticosteroid therapy in severe Kawasaki disease: an analysis of post RAISE. Circ Cardiovasc Qual Outcomes. 2021;14(2):e007191.
Iio K, Morikawa Y, Miyata K, Kaneko T, Misawa M, Yamagishi H, et al. Risk Factors of Coronary Artery Aneurysms in Kawasaki Disease with a Low Risk of Intravenous Immunoglobulin Resistance: An Analysis of Post RAISE. J Pediatr. 2022;240(158–63): e4.
Kuwabara M, Yashiro M, Ae R, Yanagawa H, Nakamura Y. The effects of early intravenous immunoglobulin therapy for Kawasaki disease: the 22nd nationwide survey in Japan. Int J Cardiol. 2018;269:334–8.
Acknowledgements
Not applicable.
Funding
This work was financially supported by the National Natural Science Foundation of China (grant number 81700439 and 82070512), Gusu health personnel training project (grant number GSWS2020054, GSWS2022059, and GSWS2022056), and Suzhou Science and Technology Development Plan Project (grant number SS202066).
Author information
Authors and Affiliations
Contributions
YJT analyzed data and wrote the manuscript. CXD collected the data. QQX and WPZ collected and interpreted the data. YMQ interpreted the data. MHL and HTL designed the study and revised the manuscript. All authors read and approved the final manuscript.
Corresponding authors
Ethics declarations
Ethics approval and consent to participate
This study was performed in line with the principles of the Declaration of Helsinki. The institutional review board of Children’s Hospital of Soochow University approved this study (No: 2023cs031). Informed consent was obtained from all individual participants included in the study.
Consent for publication
Not applicable.
Competing interests
The authors have no relevant financial or non-financial interests to disclose.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Tang, Y., Ding, C., Xu, Q. et al. Prediction nomogram for coronary artery aneurysms at one month in Kawasaki disease. Ital J Pediatr 49, 146 (2023). https://doi.org/10.1186/s13052-023-01551-3
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13052-023-01551-3