Validation of GRACE score (Global Registry of Acute Coronary Events) as a predictor of in hospital mortality in acute coronary syndromes in Buenos Aires

Brenda N. Mangariello, Patricia C. Gitelman


Background: GRACE score (G) estimates in-hospital mortality risk (IHM) in patients with acute coronary syndromes (ACS).Given the variability of patients´ characteristics, health systems, socioeconomic environment and changes in treatment; external validation should be performed. The TRIPOD statement was published to standardize validation studies´ methodology. The objective of this study is to asses if G predicts IHM with precision in patients with acute coronary syndrome at Juan A. Fernández Hospital (validation cohort -V-).Methods: Retrospective validation study. Consecutive patients admitted between 2001 and 2016 were included. Discriminationwas evaluated using the area under the ROC curve (AUC) and calibration was evaluated using de Hosmer-Lemeshowtest, calibration-in-the-large, calibration slope, validation graph and calibration belt. Subgroup analysis by type of ACS wasperformed.

Results: A total of 2104 patients were analyzed. Myocardial infarction with ST elevation (40.4% and 32%) and IHM (5.56%and 4.6%) was more prevalent than G estimation. Calibration was poor, risks were underestimated between probabilities of3 and 13%. The calibration slope was adequate, therefore the overall effect and magnitude of predictors on IHM was similarto G. The AUC was 0.86. The model performed with underestimation of risk between probabilities of 5% and 23% in patientswith ACS and ST elevation, the discrimination was good. Calibration and discrimination performed well in patients withnon ST elevation ACS.

Conclusions: Despite the lack of statistical validity of the model in the total population, the variables were predictors of IHMin the validation cohort. Therefore, G score is clinically relevant, but should be recalibrated in our population.


Elbarouni B, Goodman SG, Yan RT, Welsh RC, Kornder JM, DeYoung JP, et al. Validation of the Global Registry of Acute Coronary Event (GRACE) risk score for in-hospital mortality in patients with acute coronary syndrome in Canada. Am Heart J 2009;158:392–9.

Roffi M, Patrono C, Collet J-P, Mueller C, Valgimigli M, Andreotti F, et al. 2015 ESC Guidelines for the management of acute coronary syndromes in patients presenting without persistent ST-segment elevation. Eur Heart J 2016;37:267-315.

Amsterdam EA, Wenger NK, Brindis RG, Casey DE, Ganiats TG, Holmes DR, et al. 2014 AHA/ACC guideline for the management of patients with non-st-elevation acute coronary syndromes: A report of the American college of cardiology/American heart association task force on practice guidelines. Circulation 2014;130:344-426.

Granger C, Goldberg R, Dabbous O, Pieper K, Eagle K, Cannon C, et al. Predictors of hospital mortality in the global registry of acute coronary events. Arch Intern Med 2003;163:2345–53.

Fox KAA, Goodman SG, Anderson FA, Granger CB, Moscucci M, Flather MD, et al. From guidelines to clinical practice: The impact of hospital and geographical characteristics on temporal trends in the management of acute coronary syndromes - The Global Registry of Acute Coronary Events (GRACE). Eur Heart J 2003;24:1414-24.

Fox KAA, FitzGerald G, Puymirat E, Huang W, Carruthers K, Simon T, et al. Should patients with acute coronary disease be stratified for management according to their risk? Derivation, external validation and outcomes using the updated GRACE risk score. BMJ Open 2014;4:1-10.

Collins GS, Reitsma JB, Altman DG, Moons KGM. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): The TRIPOD Statement. Eur Urol 2015;67:1142-51.

Prabhudesai AR, Srilakshmi MA, Santosh MJ, Shetty GG, Varghese K, Patil CB, et al. Validation of the GRACE score for prognosis in Indian patients with acute coronary syndromes. Indian Heart J 2012;64:263-9.

D’Ascenzo F, Biondi-Zoccai G, Moretti C, Bollati M, Omedè P, Sciuto F, et al. TIMI, GRACE and alternative risk scores in Acute Coronary Syndromes: A meta-analysis of 40 derivation studies on 216,552 patients and of 42 validation studies on 31,625 patients. Contemp Clin Trials 2012;33:507-14.

Manzano-Fernández S, Sánchez-Martínez M, Flores-Blanco PJ, López-Cuenca Á, Gómez-Molina M, Pastor-Pérez FJ, et al. Comparison of the global registry of acute coronary events risk score versus the can rapid risk stratification of unstable angina patients suppress adverse outcomes with early implementation of the ACC/AHA guidelines risk score to predict in-hospital mort. Am J Cardiol 2016;117:1047-54.

Pieper KS, Gore JM, FitzGerald G, Granger CB, Goldberg RJ, Steg G, et al. Validity of a risk-prediction tool for hospital mortality: The Global Registry of Acute Coronary Events. Am Heart J 2009;157:1097-105.

Thygesen K, Alpert JS, Jaffe AS, Chaitman BR, Denmark KT, White HD, et al. Third Universal Definition of Myocardial Infarction Classification Subcommittee : J Am Coll Cardiol 2012;60:1581-98.

Anderson, Fred; FitzGerald G. Methods and formulas used to calculate the GRACE Risk Scores for patients presenting to hospital with an acute coronary syndrome : Coordinating Center for the Global Registry of Acute Coronary Events. [Internet]. 2010. p. 1-14. Available from:

Gomez Talavera S, Núñez Gil I, Vivas D, Ruiz Mateos B, Viana Tejedor A, Martín García A et al. Sindrome coronario agudo en nonagenarios: Evolución clínica y validación de las principales escalas de riesgo. Rev Esp Geriatr Gerontol 2014;49:5-9.

Vach W. Calibration of clinical prediction rules does not just assess bias. J Clin Epidemiol 2013;66:1296-301.

Van Hoorde K, Van Huffel S, Timmerman D, Bourne T, Van Calster B. A spline-based tool to assess and visualize the calibration of multiclass risk predictions. J Biomed Inform 2015;54:283–93.

Calster BVAN, Nieboer D, Vergouwe Y, Cock BDE, Calster B Van. A calibration hierarchy for risk models : strong calibration occurs only in utopia. J Clin Epidemiol 2016;74:167-76.

Collins GS, De Groot JA, Dutton S, Omar O, Shanyinde M, Tajar A, et al. External validation of multivariable prediction models: A systematic review of methodological conduct and reporting. BMC Med Res Methodol 2014;14:1–11.

Simms AD, Reynolds S, Pieper K, Baxter PD, Cattle BA, Batin PD, et al. Evaluation of the NICE mini-GRACE risk scores for acute myocardial infarction using the Myocardial Ischaemia National Audit Project (MINAP) 2003-2009: National Institute for cardiovascular Outcomes Research (NICOR). Heart 2013;99:35–40.

Toll DB, Janssen KJM, Vergouwe Y, Moons KGM. Validation, updating and impact of clinical prediction rules: A review. J Clin Epidemiol 2008;61:1085-94.

Van Calster B, Vickers AJ. Calibration of risk prediction models: Impact on decision-analytic performance. Med Decis Mak 2015;35:162-9.

Raposeiras-Roubín S, Abu-Assi E, Cabanas-Grandío P, Agra-Bermejo RM, Gestal-Romarí S, Pereira-López E, et al. Walking beyond the GRACE (Global Registry of Acute Coronary Events) model in the death risk stratification during hospitalization in patients with acute coronary syndrome: What do the AR-G (ACTION [Acute Coronary Treatment and Intervention Outcomes Networ. JACC Cardiovasc

Interv 2012;5:1117–25.

Aragam KG, Tamhane UU, Kline-Rogers E, Li J, Fox KAA, Goodman SG, et al. Does simplicity compromise accuracy in ACS risk prediction? A retrospective analysis of the TIMI and GRACE risk scores. PLoS One. 2009;4:1–9.

Fujii T, Suzuki T, Torii S, Murakami T, Nakano M, Nakazawa G, et al. Diagnostic Accuracy of Global Registry of Acute Coronary Events (GRACE) Risk Score in ST-Elevation Myocardial Infarction for In-Hospital and 360-Day Mortality in Japanese Patients. Circ J 2014;78:2950-4.

Yan AT, Jong P, Yan RT, Tan M, Fitchett D, Chow CM, et al. Clinical trial-derived risk model may not generalize to real-world patients with acute coronary syndrome. Am Heart J 2004;148:1020-7.

Nassar Junior AP, Mocelin AO, Andrade FM, Brauer L, Giannini FP, Nunes ALB, et al. SAPS 3, APACHE IV or GRACE: which score to choose for acute coronary syndrome patients in intensive care units? Sao Paulo Med J. 2013;131:173-8.

Santos Medina M, Valera Sales A, Ojeda Riquenes Y, Pardo Pérez L. Validación del Score Grace como predictor de riesgo tras un infarto agudo de miocardio. Rev Cubana Cardiol Cir Cardiovasc [Internet]. 2015 [citado 2019 Mar18];21(2):[aprox. 6 p.]. Disponible en: view/578

Sénior JM, Fernández A, Rodríguez A, Muñoz E, Díaz J, Gándara J, et al. Validación y comparación de los puntajes TIMI y GRACE en pacientes con síndrome coronario agudo sin elevación del segmento ST. Rev Colomb Cardiol. 2016;23:479–86.

De-Miguel-Balsa E, Latour-Pérez J, Baeza-Román A, Amorós-Verdú C, Fernández-Lozano JA. GRACE Score Validation in Predicting Hospital Mortality: Analysis of the Role of Sex. J Womens Health (Larchmt) 2017.

Mahmoud WE, Hassanein MM, Nour El-Din MM, Elbeltagy SM, Sadaka M a. Validation of TIMI and GRACE acute coronary risk scores in Alexandria Governorate and their role in the comparison of quality of care between hospitals. J Egypt Public Health Assoc 2010;85:1-28.

Burgos, ML, Costabel J, I, Cigalini, IM, Godoy, CL, Zamora, EF, Giordanino, R et al. Validation of the GRACE score (global registry of acute coronary events) as a predictor of in-hospital mortality in patients with acute myocardial infarction in Argentina. Rev Fed Argent Cardiol. 2017;46:228-32.

Steg PG, Goldberg RJ, Gore JM, Fox KA, Eagle KA, Flather MD, et al. Baseline characteristics, management practices, and in-hospital outcomes of patients hospitalized with acute coronary syndromes in the Global Registry of Acute Coronary Events (GRACE). Am J Cardiol 2002;90:358–63.

Full Text


  • There are currently no refbacks.

Licencia Creative Commons
The documents published in this journal are under the licencia Creative Commons Atribución-NoComercial-Compartir-Igual 2.5 Argentina.

Revista argentina de cardiología. ISSN en línea 1850-3748. Argentine journal of cardiology (English ed. Online ISSN 2314-2286) Sociedad Argentina de Cardiología. Azcuénaga 980 (C1115AAD),Ciudad Autónoma de Buenos Aires, República Argentina. Tel. (54 11) 4961-6027/8/9 Fax: 4961-6020