JCDR - Register at Journal of Clinical and Diagnostic Research
Journal of Clinical and Diagnostic Research, ISSN - 0973 - 709X
Orthopaedics Section DOI : 10.7860/JCDR/2015/12355.6201
Year : 2015 | Month : Jul | Volume : 9 | Issue : 7 Full Version Page : RC01 - RC04

Evaluation of Probability of Survival using APACHE II & TRISS Method in Orthopaedic Polytrauma Patients in a Tertiary Care Centre

Archit Agarwal1, Atul Agrawal2, Rajesh Maheshwari3

1 Junior Resident, Department of Orthopaedics, Himalayan Medical Institute, Jollygrant, Dehradun, India.
2 Associate Professor, Department of Orthopaedics, Himalayan Medical Institute, Jollygrant, Dehradun, India.
3 Professor and Head, Department of Orthopaedics, Himalayan Medical Institute, Jollygrant, Dehradun, India.


NAME, ADDRESS, E-MAIL ID OF THE CORRESPONDING AUTHOR: Dr. Atul Agrawal, Associate Professor, Department of Orthopaedics, Himalayan Medical Institute, Jollygrant, Dehradun, India. E-mail : atulscastle@gmail.com
Abstract

Aim

The aim of the study was to assess the ability of Acute Physiology and Chronic Health Evaluation (APACHE) II scoring system and Trauma and Injury Severity Score (TRISS) method to evaluate chances of survival of orthopaedic polytrauma patients.

Materials and Methods

It is a retrospective study carried out at a tertiary care teaching hospital situated in a hilly terrain. The medical records of 535 polytrauma patients admitted to ICU from January 2012 to April 2015 were examined of which only 95 were included into the study. The APACHE II scores were calculated from data at the time of admission, on day 1 after admission and on day 5. Data from casualty department was used to calculate TRISS. For each patient APACHE II and TRISS was used to calculate their probability of death. Receiver operating characteristic curve analysis was used to assess the ability of APACHE II and TRISS to predict mortality.

Results

In the receiver operating characteristic curve analysis, the areas under the curve for TRISS, APACHE II on admission and APACHE II on day one of admission scoring system was 0.831, 0.706, 0.885 respectively.

Sensitivity and specificity for TRISS was 83.64 and 77.50 respectively while for APACHE II score on day one of admission was 90.91 and 72.50.

Conclusion

The results from the present study showed that APACHE II score on day one of admission was relatively a better predictor than TRISS score and a far better predictor than APACHE II on admission in evaluating probability of survival of a patient.

Keywords

Introduction

Trauma scoring systems are routinely used to evaluate and monitor traumatic injury outcomes. It is done in order to reduce number of preventable deaths [1]. Presently, illness severity scoring systems are important tools for studying patient outcomes and to measure the efficacy of trauma centres. Initially efforts were focused on assessing rates of preventable mortality. But with increasing incidence of trauma, many statistical models have been developed in an attempt to accurately predict outcomes for trauma patients [2]. Each scoring system has its own strengths and weaknesses. The choice depends on the system’s ease of use and its applicability for that particular intensive care unit (ICU) or patient group [3].

The origin of TRISS (Trauma and Injury Severity Score) can be traced to the MTOS (Major Trauma Outcome Study), which was conducted in the United States in 1980s, and provides a data- base for audit in the individual patient and allows for comparison of performance over time and between hospitals [4].

Knaus et al., introduced the “Acute Physiology and Chronic Health Evaluation” (APACHE) system in 1981 to classify disease severity and predict future events in the course of disease [5]. In 1985 data from 5815 medical and surgical ICU admissions at 13 hospitals was used to refine APACHE I into APACHE II. The APACHE II score constituted of 12 routine physiologic measurements plus the patient’s age and previous health status [6]. APACHE II scoring is based on the changes of normal function of major organ systems. It is relatively independent of therapeutic interventions prior to ICU admission and specific disease processes [7]. With the use of more recent cohorts new scoring systems have been developed but still APACHE II is used for research and clinical audit purposes. It is easier to use in comparison to APACHE III and so has been in use for a longer time which allows consistency [3].

Our objective was to evaluate the ability of commonly used trauma scores (TRISS) along with a more general ICU scoring system (APACHE II), to accurately predict mortality in critically injured orthopaedic polytrauma patients requiring extensive care in an ICU.

Materials and Methods

It is a retrospective study conducted at a tertiary care teaching hospital situated in a hilly terrain of Uttarakhand, India. After the approval of research committee of the institution, medical records of orthopaedic patients being admitted to ICU from emergency in between January 2012 to April 2015 were accessed for the required information.

Data Collection

The medical records of 535 polytrauma patients who needed ICU care from January 2012 to April 2015 were retrieved. After applying inclusion and exclusion criteria 440 patients were excluded and only 95 patients were included in the study.

The inclusion criteria were patients with blunt injuries (Road traffic accident), age more than 15 years, brought within 48 hours of trauma, ISS>15 and any one long bone or pelvis or spine fracture. On the other hand, patients with penetrating trauma, burn injury, died within 48 hours of ICU admission, missing data and one who left the hospital against medical advice were excluded.

Medical records were carefully reviewed for the following parameters to calculate APACHE score: demo- graphic and clinical data, systolic, diastolic and mean arterial blood pressure (mm Hg), heart rate, respiratory rate, body temperature, initial Glasgow Coma Scale (GCS) score, arterial blood gas analysis (pH, PaO2, PaCO2, oxygen saturation, and base excess), FiO2, laboratory data (white blood cell count, haematocrit, and serum levels of sodium, potassium, creatinine), presence of chronic diseases or immune-compromised state. Severe chronic illness included liver cirrhosis with portal hypertension, New York Heart Association class IV congestive heart failure, chronic respiratory disease, end-stage renal disease receiving dialysis, and an immune-compromised state (example: leukaemia, lymphoma, or AIDS).

Calculation Method

Step1 - Abbreviated Injury Scores (AIS) [8] is calculated for different body regions scoring 1-6 for individual injuries. These body regions were the head or neck, face, chest, abdomen or pelvic contents, extremities or pelvic girdle, and external.

Step2- The ISS (Injury Severity Score) [9] was calculated using the AIS. To calculate an ISS, the highest AIS severity code in each of the three most severely injured ISS body regions was needed. ISS= (1st AIS score) ^2+ (2nd AIS score) ^2+ (3rd AIS score) ^2.

The ISS greater than 15 is defined as major trauma. The ISS was calculated using the Abbreviated Injury Scales 2005.

Step3- Calculate Revised Trauma Score (RTS) [10] (coefficients from the MTOS were used).

Formula for RTS is: RTS=βRR×RR+βSBP×SBP+βGCS×GCS;

where βRR, βSBP, and βGCS are the coefficients associated with RR (respiratory rate), SBP (systolic blood pressure), and GCS (Glasgow coma scale).

Step4-Calculate probability of survival using TRISS [4] Ps=1/ (1+e^-b)

Where Ps is an estimate of a patient’s survival probability

b = b0 + b1 (RTS) + b2 (ISS) + b3 (AGE INDEX) and

The b0, b1, b2, b3 are regression coefficients derived from the MTOS in 1995 which are different for penetrating and blunt injuries.

AGE INDEX = 0 for age less than 55 years&

AGE INDEX = 1 for age greater than or equal to 55.

The popular TRISS method calculates the probability of survival (Ps) of a trauma patient. “TRISS fallouts”, or unexpected non-survivors are patients who meet death despite the probability of survival on admission of >0.5. Preventable death can be divided into three categories: 1) definitively preventable death (DP): deaths occurred with Ps>0.50, 2) possible preventable death (PP): deaths occurred with 0.25<Ps<0.50, 3) non-preventable death (NP): deaths occurred with 0.25<Ps [1].

An extensive chart and computer check for data completeness, accuracy, and consistency was carried out with help of SPSS 22. Square root transformation was used for data which was not distributed uniformly. Unpaired t-tests were used to compare different scores in survivors and non survivors. The ROC curve was performed using the trial version of MEDCALC to check specificity and sensitivity of different scores.

Results

During these 40 months, 95 patients which met the criteria were studied and analysed. Total 82 (86.3%) patients were male while 13 (13.7%) were female. Out of 95 patients studied, 32(33.3%) patients were in the age group 15-25 years. Mean age of non survivors was 43.5 years & survivor was 38.1 years [Table/Fig-1].

Distribution of patients according to age

Age GroupsEnd resultTotal
non survivorsurvivor
15-25112132
25-357714
35-454913
45-556915
55-655611
65-75415
75-85202
85-95123
Total405595

Mean APACHE II score on the day of admission [Table/Fig-2] in non survivors predicted a mortality rate of 40 % while mean APACHE II score on the day 1 after admission in non survivors predicted a mortality rate of 55%.

Mean values of scores in survivors and non survivors with p-values

ScoreSurvivorsNon Survivorsp-value
TRISS*82±5.3750.77±28.86<0.001
APACHE II score on admission18.53±6.78723.90±6.823<0.001
APACHE II score on Day 114.38±6.81627.70±8.579<0.001
RTS6.49 ±1.385.33± 0.8<0.001

*Probability of survival


AUROC- Area under receiver operating characteristic curve

According to ROC curve analysis, APACHEII score on day 1 of admission (88.5%, 95% Cl= 80.3 to 94.2) proved to be more reliable system than TRISS methodology (83.1%, 95% CI=74 to 90) though the difference was not statistically significant (p>0.001). Specificity, sensitivity and AUROC for different scores are as mentioned in [Table/Fig-3,4].

Different parameters of various scores

ScoreSensitivitySpecificityAUROCYouden Index
RTS89.0957.500.7630.4659
TRISS83.6477.500.8310.6114
APACHE II on Admission63.6470.000.7060.3364
APACHE II on Day 190.9172.500.8850.6341

ROC curve comparing the sensitivity and specificity of TRISS, APACHE II on Admission, APACHE II on Day 1 and RTS

APACHE II on day 1 shows highest area under ROC Curve

Youden Index J was calculated to prove superiority of one scoring system over other. It was highest for APACHE II on Day 1 after admission followed by TRISS as shown in [Table/Fig-3].

The average time for the patient to reach the hospital was 7.5 hours for the survivors and 6.5 hours for non-survivors. Data was not uniformly distributed, so square root transformation was used and statistical significance of variable between survival and non-survival was done. It was found that there is no statistical significance in time taken by survivors and non survivors to reach emergency.

We had 4 unexpected survivor, these patients had survival probability of less than 50%.TRISS fallouts i.e. unexpected non survivors were 16 (survival probability of >50%).

Discussion

Indices of injury severity are integral part of triage, to outcome evaluation and quality assurance. As their application is gaining importance, severity scales are being more closely analysed for their accuracy and validity [11]. Thus data stratification has become very important. A possible implication for the increased precision required in risk stratification is that there is not “one size fits all” score, and this concept may be particularly true for the trauma population [12].

Trauma care systems in India are in their initial stages of development and there is an almost complete lack of organized trauma care [13]. It is an established fact that the mortality in serious injuries is six times worse in a developing country such as India compared to a developed country [14]. Zafar et al., and few others stated that present injury severity instruments using coefficients developed in western world do not accurately correlate with observed survival rates in a developing country [15].

Patients are often transported to the nearest hospital from the accident scene even though these hospitals may not have the resources to treat the patient. In our study, the low mean RTS of the non-survivors, as compared to the survivors, shows that the former were physiologically more deranged. The reason for this can be the delay in transporting a patient to the hospital. EMS (Emergency Medical services) is limited on account of remote locations in hilly terrain, few specialised hospital and longer duration of transport to specialised care centre. This leads to further deranged physiology when first seen in the hospital as compared to the developed world where the EMS is highly responsive and provision of level I/II trauma centres is present.

Non survivors had higher mean ISS than survivors which mean the former had more severe injuries. Impact of the accident can be reduced by using seatbelts, helmets and airbags. These would prevent serious injuries from happening [16]. Though the injury severity score which is commonly used for audit of collected trauma cases may be subjected to considerable observer variation. The ISS does not account for multiple injuries to the same body region or fatal damage to internal organs. In fact, two severe injuries to the same body region may have lowered the calculated score than two moderate injuries to different body regions [1].

Pre-hospital care is virtually non-existent in remote areas of hilly terrain, and ‘golden hour’ concept in such circumstances is questionable as it’s evident in our study too. The mean of time taken to reach emergency by survivors is more than non survivors and it was not statistically significant. The mean time from injury to arrival in hospital of patients dying with major injuries was 6.5 hours; details of pre-hospital treatment, airway management, and resuscitation were not retrievable in this group. The delays in definite treatment had a considerable negative impact on the outcome in our setting. The time interval of non survivors was lesser than survivors because badly injured patients are shifted first to higher centres without proper primary care. It may also be due to improper triage carried out at field level.

In our study of critically injured patients requiring greater than 48 hours of ICU care, APACHE II score on day 1 after admission was found to be relatively better score than TRISS in predicting mortality. This difference undoubtedly lies in the greater incorporation of physiologic and biochemical data into APACHE II. The system of APACHE II on admission underestimated mortality in our study. This could be explained by differences in patient population, coefficients used in study and referral criteria between the western world and our centre especially in hilly regions. Also because the APACHE-II does not consider pre-ICU management, which can restore a patient’s altered physiology. This lowers the points assessed and thus under estimates a patient’s true risk when taken into account just on admission to ICU [6]. Though in a study carried out by Jorge et al., it was seen that APACHE II score is a good prognostic marker of trauma patients in Emergency Department as well as 24 hours after admission to the ICU [17].

REMS (Rapid Emergency Score) an attenuated version of APACHE II was used in trauma patients though originally derived from medicine people. It was found to have good predictive mortality [17]. Abbreviated versions of the APACHE II score have been found to have similar prognostic values for trauma patients but it’s insisted that better designed studies are needed to validate abbreviated APACHE II scores in the trauma population [18].

Effectiveness of APACHE II has been proved even in neurosurgical ICU patients to predict in hospital mortality [19]. In a study carried out by Zali et al., [20] GCS was compared to APACHE II for predicting mortality in neurosurgical ICU patients. They concluded that, the GCS score provides simple, rapid and effective assessment in head injury patients but for the prediction of mortality in patients with multiple trauma APACHE II is superior to GCS since it includes multiple physiologic systemic parameters in these patients.

A study analysed different scoring systems (ISS,NISS and APACHE II) along with prothrombin time as independent predictors of the early mortality in polytrauma patients. It was seen that APACHE II and prothrombin time had the highest prognostic quality in polytrauma patients who had poor outcomes [21].

TRISS score for probability of death also shows observer variation, which is less at the extremes of probabilities but potentially very large between p= 0.05 and p= 0-95. Comparisons between groups, hospitals, and countries must be treated with circumspection and great care and attention paid to collection of injury severity score data to reduce observer variation [22]. TRISS allows for a reasonably effective mechanism by which anatomy, physiology, age and mechanism of injury can be taken into account as to their influence on outcome when some other independent variable is being studied [11]. Cayten et al., identified some limitations of TRISS methodology. They revealed: i) the inability of TRISS to account for multiple severe injuries to a single body part; ii) The inability to predict survival in low falls; iii) The lack of distinction between gunshot and knife injuries and the inability to take into account pre-existing conditions and underestimation of the effects of age and head injuries [23]. Since then, physicians have attempted to improve TRISS, and revised the coefficients as well as introduced new or modified variables in 1995 and 2010.

Challenges found during study were: i) Data Analysis: It is particularly difficult to measure the GCS in patients who are intubated or paralysed; ii) Missing data: It is difficult to get accurate and complete data of the early phases of care of the acutely injured individuals both in the pre-hospital and in hospital phases of care from medical records.

The ability to anticipate trauma complications based on these scoring systems could improve the survival rate in polytrauma patients [21].

Limitations of the Study

It was a retrospective study. Comparison and integration of data were not conducted with other trauma centres. A period 40 months of data collection may not be sufficient and small sample sizes can result in a lack of power. The accuracy of the predicted survival rate will be improved with cumulative patient data.

Conclusion

Our study demonstrates that general ICU scoring systems with a strong physiologic basis such as APACHE II are beneficial in orthopaedic polytrauma patients requiring greater than 48 hours of intensive care. It is a better predictor of clinical outcome than other trauma scores.

*Probability of survival

References

[1]PJung HM, Bo-Ra S, Won J, Jung-Kil L, Hyung-Sik M, Evaluation of Probability of Survival Using Trauma and Injury Severity Score Method in Severe Neurotrauma Patients J Korean Neurosurg Soc 2013 54:42-46.  [Google Scholar]

[2]Seong YH, Jun HL, Young HL, Chong KH, Ae JS, Young C, Comparison of the Sequential Organ Failure Assessment, Acute Physiology and Chronic Health Evaluation II scoring system, and Trauma and Injury Severity Score method for predicting the outcomes of intensive care unit trauma patient Am J Emerg Med 2012 30:749-53.  [Google Scholar]

[3]Kwok MH, Geoffrey JD, Matthew K, Judith F, Lee KY, Steven ARW, A comparison of admission and worst 24-hour Acute Physiology and Chronic Health Evaluation II scores in predicting hospital mortality: a retrospective cohort study Critical Care 2006 10:R4  [Google Scholar]

[4]Boyd CR, Tolson MA, Copes WS, Evaluating trauma care: the TRISS method: Trauma Score and the Injury Severity Score J Trauma 1987 27:370-78.  [Google Scholar]

[5]Knaus WA, Zimmerman JE, Wagner DP, Draper EA, Lawrence DE, APACHE-acute physiology and chronic health evaluation: a physiologically based classification system Crit Care Med 1981 9(8):591-97.  [Google Scholar]

[6]Knaus WA, William A, Draper EA, Elizabeth A, Wagner DP, Doughlas P, APACHE II: a severity of disease classification system Crit Care Med 1985 13(10):818-29.  [Google Scholar]

[7]Waters M, Nightingale P, Edwards JD, A critical study of the APACHE II scoring system using earlier data collection Emerg Med J 1990 7:16-20.  [Google Scholar]

[8]American Medical Association Committee on the Medical Aspects of Automotive safety:Rating the severity of tissue damage: The Abbreviated Scale JAMA 1971 :215-77.  [Google Scholar]

[9]Baker SP, O’Neill B, Haddon W, William BL, The injury severity score: A method for describing patients with multiple injuries and evaluating emergency care J Trauma 1974 14(3):187-96.  [Google Scholar]

[10]Champion HR, Sacco WJ, Copes WS, Gann DS, Gennarelli TA, Flanagan ME, A revision of the trauma score J Trauma 1989 29(5):623-29.  [Google Scholar]

[11]Champion HR, Trauma Scoring Scand J of Surg 2002 91:12-22.  [Google Scholar]

[12]Dossett LA, Redhage LA, Sawyer RG, May AK, Revisiting the validity of apache II in the trauma ICU: Improved risk stratification in critically injured adults Injury 2009 40(9):993-98.  [Google Scholar]

[13]Joshipura MK, Shah HS, Patel PR, Divatia PA, Trauma care systems in India-an overview Indian J Crit Care Med 2004 8(2):93-97.  [Google Scholar]

[14]Mock CN, Jurkovich GJ, Amon KD, Arreola RC, Maier RV, Trauma mortality patterns in three nations at different economic levels: implications for global trauma system development J Trauma 1998 44:804-14.  [Google Scholar]

[15]Zafar H, Rehmani R, Raja AJ, Ali A, Ahmed M, Registry based trauma outcome: perspective of a developing country Emerg Med J 2002 19:391-94.  [Google Scholar]

[16]Vikram UD, Mrunal NK, Erach KB, Analysis of Trauma Outcome Using the TRISS Method at a Tertiary Care Centre in Pune Indian J Surg 2012 74(6):440-44.  [Google Scholar]

[17]Jorge RP, Jussara G, Friedman G, Comparison of APACHE II and three abbreviated APACHE II scores for predicting outcome among emergency trauma patients Rev Assoc Med Bras 2014 60(4):381-86.  [Google Scholar]

[18]Bryan FI, Michael M, Nia JT, Michael AH, Niaman N, Chad MC, Rapid Emergency Medicine Score (REMS) in the trauma population: a retrospective study BMJ Open 2014 4:e004738  [Google Scholar]

[19]Sang-Kyu P, Hyoung-Joon C, Dong-Won K, Tai-Ho I, Hyun-Jong H, Hyeong-Joong Y, Acute Physiology and Chronic Health Evaluation II and Simplified Acute Physiology Score II in Predicting Hospital Mortality of Neurosurgical Intensive Care Unit Patients J Korean Med Sci 2009 24:420-26.  [Google Scholar]

[20]Zali AR, Seddighi AS, Seddighi A, Ashrafi F, Comparison of the Acute Physiology and Chronic Health Evaluation Score (APACHE) II with GCS in Predicting Hospital Mortality of Neurosurgical Intensive Care Unit Patients Global Journal of Health Science 2012 4(3):179-84.  [Google Scholar]

[21]Ladislav M, Kaspar R, Marius K, Otmar T, The risk of early mortality of polytrauma patients associated to ISS, NISS, APACHE II values and prothrombin time Journal of Trauma Management & Outcomes 2013 7:6.AR  [Google Scholar]

[22]Zoltie N, Dombal FT, The hit and miss of ISS and TRISS BMJ 1993 307:906-09.  [Google Scholar]

[23]Cayten CG, Stahl WM, Murphy JG, Agarwal N, Byrne DW, Limitations Of the TRISS method for interhospital comparisons: A Multihospital Study J Trauma 1991 31:471-81.  [Google Scholar]