JCDR - Register at Journal of Clinical and Diagnostic Research
Journal of Clinical and Diagnostic Research, ISSN - 0973 - 709X
Internal Medicine Section DOI : 10.7860/JCDR/2014/9925.5052
Year : 2014 | Month : Oct | Volume : 8 | Issue : 10 Full Version Page : MC09 - MC13

A Prospective Study of Comparison of APACHE-IV & SAPS-II Scoring Systems and Calculation of Standardised Mortality Rate in Severe Sepsis and Septic Shock Patients

Ajay Somabhai Dabhi1, Suhas S Khedekar2, Vadivelan Mehalingam3

1 Associate Professor, Department of Medicine, Govt. Medical College, Vadodara, India.
2 Senior Resident, Department of Medicine, Govt. Medical College, Vadodara, India.
3 Associate Professor, Department of Medicine, JIPMER, Pondicherry, India.


NAME, ADDRESS, E-MAIL ID OF THE CORRESPONDING AUTHOR: Dr. Vadivelan Mehalingam, No.B-003, Sreenivas Towers, Ariyankuppam, Cuddalore Road, Pondicherry, India. Phone : 08300175566, E-mail : mevadivelan@hotmail.com
Abstract

Context: Severe sepsis and septic shock are major causes of mortality in the Intensive Care Unit (ICU) Illness Scoring Systems can help in the prediction of outcome of these patients.

Aim: To calculate and compare APACHE-IV and SAPS-II Scoring Systems along with calculation of Standardised Mortality Rate (SMR) in patients of severe sepsis and septic shock in the ICU.

Study Design: Observational-analytical prospective study.

Materials and Methods: The study was conducted on 84 patients with severe sepsis and septic shock admitted to the Medical ICU of a tertiary care teaching hospital.

Results: Mean of Predicted Mortality Rate (PMR) for APACHE-IV was 37.85% and for SAPS-II, it was 72.36% which shows that APACHE-IV had under-predicted overall mortality while SAPS-II had over-predicted overall mortality of patients with severe sepsis and septic shock. Standardised Mortality Rate for APACHE-IV was 1.60 and for SAPS-II, it was 0.83.

Conclusion: Predicted Mortality of APACHE-IV and SAPS-II Scoring Systems did not correlate with the observed mortality for patients with severe sepsis and septic shock.

Keywords

Introduction

Severe sepsis and septic shock are major reasons for Intensive Care Unit (ICU) admissions and the leading causes of mortality in non-coronary ICUs [13]. There is a lack of an agreed severity of illness scoring system for patients with sepsis. In the absence of such a system, it is difficult to interpret sepsis outcome studies [4]. Mortality Prediction Systems have been introduced as tools for assessing the performance of ICUs [5,6]. Prognostic scoring systems have a number of applications. They help in individual patient outcome prediction by reducing uncertainty and provide an opportunity for improved decision making. Prognostic scoring systems can facilitate quality assessment of an individual ICU by allowing comparison of its overall performance to a large scale representative database.

The 3 commonly used scoring systems are Acute Physiology and Chronic Health Evaluation (APACHE), Simplified Acute Physiology Score (SAPS) and Mortality Probability Model (MPM).

The present study attempts to use APACHE-IV and SAPS-II scoring systems to assess the Predictive Mortality in a Medical ICU in patients of severe sepsis and septic shock and to compare these values with the Actual Mortality Indices.

Aims and Objectives

To calculate APACHE-IV Scoring System in patients of severe sepsis and septic shock in the ICU.

To calculate SAPS-II Scoring System in patients of severe sepsis and septic shock in the ICU.

To compare both the scoring systems and to calculate Standardised Mortality Rate.

Materials and Methods

This observational-analytical prospective study was carried out in the Medical ICU of a tertiary care teaching hospital from January 2008 to June 2009. The study included 84 patients admitted to the ICU with severe sepsis and septic shock.

Inclusion criteria

Patients admitted in Medical ICU meeting the diagnostic criteria for severe sepsis and septic shock during the first 24 h of admission.

Severe sepsis-Sepsis with one or more signs of organ dysfunction.

Cardio-vascular system-Systolic Blood Pressure (SBP) of less than or equal to 90 mm Hg that responds to administration of intravenous fluids.

Renal-Urine output less than 0.5 ml/kg/hour for one hour despite adequate fluid replacement.

Respiratory system-PaO2/FiO2 ratio below 250.

Metabolic-pH less than 7.3 or a base deficit of more than 5 mEq/L and a plasma lactate level more than 1.5 times of the upper limit of normal value.

Hematologic system-Platelet count below 80,000/mm3.

Septic shock-Sepsis with hypotension (SBP less than 90 mm Hg) for at least one hour despite adequate fluid resuscitation (indicated by CVP value above 8 mm Hg) or the need for vasopressors to maintain SBP greater than 90 mm Hg.

Exclusion criteria

Patients whose duration of stay in ICU was less than 4 h.

Patients in vegetative state.

The patients were grouped according to the aetiology of their illness e.g. tropical infection, respiratory infection, genito-urinary infection etc. A thorough clinical examination was carried out in all patients. Total leucocyte count, Packed Cell Volume (PCV), serum creatinine, serum bilirubin, serum sodium/potassium/bicarbonate and arterial pH was done in each patient.

For calculating APACHE-IV score, following data was collected-

1. Acute Physiology Points-Both worst and best value in the first 24 h of admission to ICU was collected for a) Temperature b) Pulse c) Blood Pressure d) Respiratory Rate e) Haematocrit f) Total Leucocyte Count g) Serum Blood Urea Nitrogen (BUN) h) Serum creatinine i) Serum sodium.

Single worst value in first 24 h was collected for a) FiO2 b) PaO2 c) PCO2 d) pH e) Urine output f) Serum albumin g) Serum bilirubin h) Glasgow Coma Scale.

2. Age of the patient

3. Chronic Health Evaluation-Was done to know if the patient had severe organ system insufficiency or was immunocompromised. Conditions included are a) Chronic Liver Disease b) Leukemia/Lymphoma c) Acquired Immune Deficiency Syndrome (AIDS) d) Cancer metastasis e) Chronic Renal Insufficiency.

4. ICU admission information-Whether patient was admitted to ICU directly from Emergency Room or was transferred from other ward or some other hospital to ICU was noted.

5. Pre-ICU length of stay-Number of days for which patient was admitted in ward before being transferred to ICU.

6. Emergency Surgery in ICU

7. Re admission to ICU

8. Requirement of ventilatory support

9. Thrombolytic therapy-If the patient was diagnosed to have Acute Myocardial Infarction.

10. Primary admission diagnosis.

The data collected from patients was converted to APACHE-IV Score and Predicted Mortality Rate by readymade software programmed by Mazen Kherallah. (Site-http:/www/icumedicus.com/icu_scores/apache IV.php)

SAPS-II Scoring System was calculated using the following variables-

1. Acute Physiology Points-Both best and worst value in first 24 h of admission to ICU was collected for a) Pulse b) Temperature c) Systolic BP d) Total Leucocyte Count e) Serum BUN f) Serum sodium g) Serum potassium h) Serum bicarbonate.

Single worst value in first 24 h was collected for a) FiO2 b) PaO2 c) pH d) Urine output e) Serum bilirubin f) Serum albumin g) Glasgow Coma Scale.

2. Age of patient

3. Type of admission

4. Mechanical ventilation

5. Chronic Health Evaluation-Conditions included were a) Hematologic malignancy b) AIDS c) Cancer metastasis.

The data collected from patients was converted to SAPS-II Score and Predicted Mortality Rate by software programmed by Mazen Kherallah. (Site-http:/www/icumedicus.com/icu_scores/saps.php).

Comparison of both scoring systems was done in terms of Predicted and Actual Mortality Rates. The Standardised Mortality Rate was calculated by dividing Actual Mortality Rate by Predicted Mortality Rate for both the systems.

Data were expressed as mean, standard deviation and percentages. Unpaired student’s t-test and chi-square test were used to analyse the data. Statistical software SPSS was used for statistical analysis. p-value less than or equal to 0.05 was considered to be statistically significant for all statistical comparisons.

Results

Eighty four patients fulfilling the inclusion criteria were recruited as study subjects.

This study showed that majority of subjects were in the age group of 21-50 y (64%). Mean age of the study subjects was 40.60 ± 17.24 yrs [Table/Fig-1].

Age composition of study subjects

Age (y)Number of patients (n)Percentage (%)
16-2078.33
21-302934.52
31-401416.67
41-501113.10
51-601011.90
61-70910.71
71-8044.76

Out of 84 study patients, 50 were males and 34 were females. Majority of study patients were admitted directly to ICU through the Emergency Room while others were transferred from other wards of the hospital to ICU or were referred to the ICU from other hospitals.

Majority of the study patients had Respiratory Sepsis that was followed by tropical infections [Table/Fig-2]. Out of 84 study patients, 12 had some chronic disease (chronic renal failure, cirrhosis of liver, AIDS, metastatic cancer, multiple myeloma).

Diagnosis of study subjects on admission

DiagnosisNumber of patients (n)Percentage (%)
Respiratory sepsis2934.51
1. Pneumonia910.71
2. Tuberculosis89.52
3. Chronic Obstructive Pulmonary Disease44.76
4. Restrictive Lung Disease33.57
5. Acute Respiratory Distress Syndrome55.95
Tropical Infection1214.28
1. Malaria1011.90
2. Tetanus22.38
Cardio-vascular disease44.76
1. Congestive Cardiac Failure33.57
2. Rheumatic Heart Disease11.19
Obstetric sepsis55.95
Surgical sepsis22.38
CNS sepsis1315.47
1. Meningitis910.71
2. Guillain-Barre Syndrome44.76
GI sepsis-Gastroenteritis44.76
Hepatic sepsis-Cirrhosis of liver33.57
Uro-sepsis-Urinary Tract Infection22.38
Cellulitis-Snake bite33.57
Miscellaneous78.33
1. Malignancy44.76
2. Diabetic Keto-acidosis33.57

The Actual Mortality Rate (AMR) in this study was 60.71% since 51 out of the 84 study patients had expired. Mean of Predicted Mortality Rate (PMR) for APACHE-IV was 37.85% and for SAPS-II, it was 72.36% which shows that APACHE-IV had under-predicted overall mortality while SAPS-II had over-predicted overall mortality. Standardised Mortality Rate (SMR) was calculated by dividing AMR by PMR [Table/Fig-3].

Mortality chart

VariableMean ScorePredicted Mortality Rate (PMR) %Actual Mortality Rate (AMR) %Standardised Mortality Rate (SMR) = AMR/PMR
APACHE IV97.42 ± 19.5137.8560.711.60
SAPS II68.20 ± 19.6372.3660.710.83

The highest and lowest readings of temperature and heart rate in the first 24 h of ICU stay were found to be higher in non-survivors as compared to the survivors. Likewise, the lowest value of SBP in the first 24 h along with urine output and Glasgow Coma Scale (GCS) rating was significantly low in non-survivors [Table/Fig-4].

Comparison of clinical profile of study subjects according to outcome

ParameterSurvivors Mean ± SDNon-survivors Mean ± SDp-valueSignificance
Mean Temperature (°F)High100.776 ± 2.08101.97 ± 1.8740.008Highly Significant
Low99.121 ± 2.19100.02 ± 1.7490.041Significant
Mean Systolic BP(mm Hg)High86.24 ± 7.9885.29 ± 10.450.658Not Significant
Low66.12 ± 19.4255.56 ± 29.140.05Significant
Mean Diastolic BP(mm Hg)High52.606 ± 20.6243.05 ± 27.060.071Not Significant
Low12.424 ± 22.6413.72 ± 22.710.798Not Significant
Mean Heart Rate(/minute)High116.39 ± 9.32121.57 ± 6.600.004Highly Significant
Low105.00 ± 7.20109.65 ± 6.370.003Highly Significant
Mean Respiratory Rate(/minute)High31.55 ± 5.7732.82 ± 5.560.314Not Significant
Low25.97 ± 4.9727.12 ± 5.500.335Not significant
Urine output(ml)848.48 ± 1507.09373.53 ± 309.570.032Significant
Glasgow Coma Scale8.576 ± 2.255.92 ± 3.050.001Highly Significant

Non-survivors had significantly high leucocyte count and FiO when compared with survivors; while survivors had significantly higher serum bicarbonate, albumin and pH as compared to non-survivors [Table/Fig-5].

Comparison of laboratory profile of study subjects according to outcome

ParameterSurvivors Mean ± SDNon-survivors Mean ± SDp-valueSignificance
SodiumHigh126.64 ± 8.13125.11 ± 10.310.477Not Significant
Low119.15 ± 9.87117.45 ± 10.450.459Not Significant
PotassiumHigh4.14 ± 0.674.28 ± 0.720.354Not Significant
Low3.35 ± 0.523.51 ± 0.790.292Not Significant
GlucoseHigh154.03 ± 68.32163.45 ± 64.310.524Not Significant
Low128.03 ± 47.05133.76 ± 49.200.597Not Significant
CreatinineHigh2.94 ± 1.883.89 ± 2.750.084Not Significant
Low2.20 ± 1.362.69 ± 2.220.256Not Significant
Blood Urea NitrogenHigh46.04 ± 29.0555.32 ± 27.330.142Not Significant
Low38.18 ± 25.4544.29 ± 24.680.276Not Significant
HematocritHigh29.69 ± 6.4030.37 ± 6.860.654Not Significant
Low25.97 ± 5.8325.35 ± 6.410.655Not Significant
WBC countHigh12906.06 ± 5533.2520115.69 ± 23693.860.041Significant
Low10096.97 ± 3806.2816178.43 ± 20369.680.042Significant
BicarbonateHigh22.42 ± 5.0218.80 ± 5.960.005Highly Significant
Low18.63 ± 4.7816.12 ± 5.640.037Significant
FiO228.18 ± 23.0653.52 ± 39.260.001Highly Significant
pH7.31 ± 0.077.25 ± 0.080.001Highly Significant
pO276.92 ± 14.5668.14 ± 27.530.061Not Significant
pCO237.86 ± 8.2740.37 ± 11.670.251Not Significant
Albumin2.97 ± 0.612.57 ± 0.610.004Highly Significant

Most common organ failure in the study patients was cardio-vascular failure followed by respiratory failure [Table/Fig-6].

Incidence of organ failure and association with mortality

Organ involvedTotal number of patientsSurvivorsNon-survivorsp-value
Heart8132490.05
Lung6621450.003
Acidosis5617390.003
Kidney5415390.001
Liver175120.09

As the total score of the APACHE-IV Scoring System increased, both PMR and AMR increased. AMR was higher than PMR of almost all APACHE-IV Scores [Table/Fig-7]. SAPS-II Score also had a direct relationship with AMR and PMR. However, for each score, PMR was higher than AMR for SAPS-II [Table/Fig-8].

Comparison of APACHE-IV score and mortality rates

Apache-IV ScoreActual Mortality (%)Predicted Mortality (%)
61-70257.45
71-8026.6620.64
81-905027.06
91-10066.6631.58
101-11073.3346.45
111-12010057.75
121-13010068.04
131-14033.3372.14
141-15010076.62

Comparison of SAPS-II score and mortality rates

SAPS-II ScoreActual Mortality Rate (AMR) (%)Predicted Mortality Rate (PMR) (%)
21-3008.5
31-4028.5719.14
41-502035.4
51-6046.6659.8
61-705076.16
71-8090.9089.63
81-9069.2393.84
91-10010097.5
101-11010099
111-120100100

Discussion

Sepsis is an infection-induced syndrome characterized by a number of symptoms and clinical signs including fever or hypothermia, leucocytosis or leucopenia, tachycardia and tachypnea [7]. If organ-system failure is associated with the condition, sepsis is considered to be severe.

The mean score of APACHE-IV and SAPS-II of the subjects in this study was 97.42 ± 19.51 and 68.20 ± 19.63 respectively. Mean Predicted Mortality Rate for APACHE-IV and SAPS-II were 37.85% and 72.36% respectively. But the Actual Mortality rate was 60.71%. Thus, APACHE-IV under-predicted mortality while SAPS-II over-predicted mortality of the study subjects, giving a Standardized Mortality Rate of 1.60 and 0.83 respectively.

The measures of the severity of illness (scores) are used as an important tool after admission to predict the outcome of patients. APACHE and SAPS scoring systems are commonly used in judging disease severity and organ failure in critically ill patients.

A multicentric, prospective observational study done in India, to determine the incidence and outcome of severe sepsis among adult patients found the median APACHE II score to be 22. The Standardised Mortality Ratio was found to be 1.40 in the study [8].

A European study was carried out in a single-center Intensive Care Unit (ICU) to validate the SAPS II and APACHE II scores. In this study, the observed hospital mortality of patients with risk of death higher than 60% was overpredicted by SAPS II and underpredicted by APACHE II. This study validated both SAPS II and APACHE II scores in the ICU population which comprised mainly of surgical patients [9].

A study done in a tertiary care hospital in Saudi Arabia showed that predicted mortality by SAPS II and APACHE II systems was not significantly different from the actual mortality. The Standardised Mortality Ratio for APACHE II was 1.00 and that of SAPS II was 1.09 in this study [10].

Another study was conducted in a tertiary care medical/surgical Intensive Care Unit in Saudi Arabia to assess the validity of mortality prediction systems in patients admitted to the ICU with severe sepsis and septic shock. APACHE II and SAPS II scores were included in the study. Predicted and actual mortality rates along with standardised mortality ratio were calculated. Calibration, as tested by C-statistics, was poor for both APACHE II and SAPS II scores. The study concluded that though general ICU mortality system models had accurate mortality prediction, they had poor calibration. However, customization of SAPS II improved calibration. The customized model may be a useful tool when evaluating outcomes in patients with sepsis [11].

As new and effective therapeutic agents are becoming available, it is important that epidemiologic data be updated in order to better understand the incidence and pathophysiology of the disease and to plan the rational treatment of patients.

The manifestations of response to sepsis are usually super-imposed on the symptoms and signs of the patient are underlying illness and primary infection. However, there are individual variations in the clinical presentation. Hyper-ventilation is an early sign of sepsis. Oliguria in sepsis occurs secondary to shock that causes diminished renal perfusion leading to Acute Renal Failure. Insulin resistance and hyperglycemia are invariably present in sepsis. Hyperglycemia needs to be corrected since high blood glucose levels increase the risk of infection, delays wound healing, impairs neutrophil function and stimulates blood coagulation [12]. Anaemia is common in sepsis and results from depression of erythropoiesis.Hematocrit values of less than 30% have been used as an indication of blood transfusion in patients with sepsis with good results.

The Institute for Healthcare Improvement (IHI) has highlighted sepsis as an area of focus and has identified several deficiencies that may cause sub-optimal care of patients with severe sepsis. These deficiencies include inconsistency in the early diagnosis of severe sepsis and septic shock, frequent inadequate volume resuscitation without defined endpoints, late or inadequate use of antibiotics, frequent failure to support the cardiac output when depressed, frequent failure to control hyperglycemia adequately, frequent failure to use low tidal volumes and pressures in Acute Lung Injury (ALI) and frequent failure to treat adrenal insufficiency in refractory shock. Although the mortality rate for severe sepsis is 30 to 50%, this increases to 80 to 90% for septic shock with multiple organ dysfunction [13].

The aims of clinical evaluation in cases of sepsis are-

Establishment of a diagnosis.

Estimation of severity and prognosis of the condition.

Identification of the underlying cause.

The measures of the severity of illness (Scores) are used as an important tool after admission to predict the outcome of the patient. Mortality risk stratification in severe sepsis and septic shock is commonly used in clinical trials and in practice, which helps to improve accuracy when evaluating new therapies [14]. By facilitating comparison of the actual with predicted mortalities, the use of such Scoring Systems can provide valuable information about the performance of individual ICUs in treating patients with sepsis.

Severity of illness Scoring Systems are relatively simple to use and widely available. But, there is no ideal system for patients with sepsis. Most of the systems were developed for ICU patients in general and when applied to a particular group of patients, such as those with sepsis, their accuracy declines.

The advantages of an internationally valid mortality prediction system for patients with severe sepsis and septic shock are-

It will be useful in comparing the outcomes of patients between different ICUs and countries.

It will allow grouping of patients for enrolment in clinical trials. This will be of particular value when conducting large, international multi-centre studies.

This study has used APACHE-IV and SAPS-II Scoring Systems for risk stratification as outcome prediction models and gives some insight into the issue of the outcome of septic patients from a tertiary care perspective. Customization of these systems to predict the outcome of sepsis is an attractive option.

Limitations

Sample size was small and people from higher socio-economic status could not be included in the study.

Patients could not be subjected to thorough investigations because of financial constraints.

Conclusion

The present study shows that neither APACHE-IV nor SAPS-II Scoring System performed well in predicting mortality in patients with severe sepsis and septic shock. However, Discrimination (ability to distinguish between survivors and non-survivors) of SAPS-II was better than that of APACHE-IV for patients with severe sepsis and septic shock.

References

[1]Rangel-Frausto MS, The epidemiology of bacterial sepsis Infect Dis Clin North Am 1999 13:299-312.  [Google Scholar]

[2]Angus DC, Linde-Zwirble WT, Lidicker J, Clermont G, Carcillo J, Pinsky MR, Epidemiology of severe sepsis in the United States: analysis of incidence, outcome and associated costs of care Crit Care Med 2001 29:1303-10.  [Google Scholar]

[3]Angus DC, Wax RS, Epidemiology of sepsis: an update Crit Care Med 2001 29(Suppl 7):S109-16.  [Google Scholar]

[4]Friedman G, Silva E, Vincent JL, Has the mortality of septic shock changed with time? Crit Care Med 1998 26:2078-86.  [Google Scholar]

[5]Lemeshow S, Le Gall Jr, Modelling the severity of illness of ICU patients JAMA 1994 272:1049-55.  [Google Scholar]

[6]Lemeshow S, Teres D, Klar J, Avrunin JS, Gehlbach SH, Rapoport J, Mortality Probability Models (MPM II) based on an international cohort of ICU patients JAMA 1993 270:2478-86.  [Google Scholar]

[7]Wheeler AP, Bernard GR, Treating patients with severe sepsis N Engl J Med 1999 340:207-14.  [Google Scholar]

[8]Todi S, Chatterjee S, Bhattacharyya M, Epidemiology of severe sepsis in India Crit Care 2007 11(Suppl 2):65  [Google Scholar]

[9]Capuzzo M, Valpondi V, Sgarbi A, Bortolazzi S, Pavoni V, Gilli G, Validation of severity scoring systems SAPS II and APACHE II in a single-center population Intensive Care Med 2000 26(12):1779-85.  [Google Scholar]

[10]Arabi Y, Haddad S, Goraj R, Al-Shimemeri A, Al-Malik S, Assessment of performance of four mortality prediction systems in a Saudi Arabian intensive care unit Crit Care 2002 6(2):166-74.  [Google Scholar]

[11]Arabi Y, Al-Shirawi N, Memish Z, Venkatesh S, Al-Shimemeri A, Assessment of six mortality prediction models in patients admitted with severe sepsis and septic shock to the intensive care unit: a prospective cohort study Crit Care 2003 7(5):R116-22.  [Google Scholar]

[12]Munford Robert S, Severe Sepsis and Septic Shock. In: Kasper DL, Eugene Braunwald, Fauci AS, Hauser SL, Longo DL, Jameson JL, editors Harrison’s Principles of Internal Medicine 2005 16th EdNew YorkMcGraw-Hill:1606-12.  [Google Scholar]

[13]Goldhill DR, Sumner A, Outcome of intensive care patients in a group of British Intensive Care Units Crit Care Med 1998 26:1337-45.  [Google Scholar]

[14]Moreno R, Morais P, Outcome prediction in intensive care: Results of a prospective, multi-centre, Portuguese study Intensive Care Med 1997 23:177-86.  [Google Scholar]