JCDR - Register at Journal of Clinical and Diagnostic Research
Journal of Clinical and Diagnostic Research, ISSN - 0973 - 709X
Microbiology Section DOI : 10.7860/JCDR/2018/35169.11877
Year : 2018 | Month : Aug | Volume : 12 | Issue : 08 Full Version Page : DC14 - DC17

Evaluation of Performance Characteristics of Enzyme Chemiluminescence Immunoassay (ECLIA) and Rapid Diagnostic Test (RDT) for HBV, HIV and HCV Infections

Dipmala Das1, Sudipta Roy2, Suman Mondal3

1 Associate Professor, Department of Microbiology, IQ City Medical College, Durgapur, West Bengal, India.
2 Assistant Professor, Department of Microbiology, IQ City Medical College, Durgapur, West Bengal, India.
3 Senior Laboratory Technologist, Department of Microbiology, IQ City Medical College, Durgapur, West Bengal, India.


NAME, ADDRESS, E-MAIL ID OF THE CORRESPONDING AUTHOR: Dr. Sudipta Roy, Assistant Professor, Department of Microbiology, IQ City Medical College, Bijra, Durgapur-713206, West Bengal, India.
E-mail: sudroy69@gmail.com
Abstract

Introduction

The incidence of Human Immunodeficiency Virus (HIV), Hepatitis B Virus (HBV) and Hepatitis C Virus (HCV) in India has increased over the past two decades. These infections cause significant mortality and morbidity. This increasing trend is alarming and is emerging as a global health problem. India has one of the largest reservoirs of HIV, HBV and HCV and many of its cases remain undetected. Due to the large sero-prevalence in India, serological tests for HBsAg, anti-HCV and anti-HIV are done for diagnosing the respective diseases, and screening of antenatal, preoperative cases and of blood donors.

Aim

To find out the efficacy of Rapid Diagnostic Test (RDT) and Enzyme Chemiluminescence Immunoassay (ECLIA) in comparison to Enzyme Linked Immunosorbent Assay (ELISA) for diagnosis of HBV, HCV and HIV infections in patients.

Materials and Methods

This cross-divtional study presented a comparative analysis of test results of HBsAg, anti-HCV and anti-HIV antibodies by different methods namely RDT and ECLIA taking ELISA as reference standard. A total of 198 serum samples were taken from patients and tests were done for HBsAg, anti-HCV and anti-HIV by three different methods i.e. ECLIA, RDT and ELISA and sensitivity, specificity, Positive Predictive Value (PPV), Negative Predictive Value (NPV) and accuracy were calculated. The agreement between the results was computed using Kappa coefficient.

Results

The findings demonstrated that for HBsAg, the results of RDT and ECLIA were same. For anti-HIV 1 and 2, sensitivity of RDT and ECLIA was similar. For anti-HCV, ECLIA showed better sensitivity than RDT and RDT showed better specificity than ECLIA. Strength of agreement was almost perfect for HBsAg and anti-HIV, where as for anti-HCV it was substantial.

Conclusion

There were some variations in certain results by different methods. It was observed that RDT and ECLIA are good screening tests for HIV and HBV infections. On the other hand, we inferred that for HCV, ECLIA is a better screening test than RDT.

Keywords

Introduction

The incidence of HIV, HBV and HCV in India has increased over the past two decades and is emerging as a global health problem. These infections cause significant mortality and morbidity [1]. These infections can also be acquired through blood transfusion. Data in India suggests that, about 0.36% of the population is HIV infected, 2.4% (extending to 15.9% in certain population groups) is HBV infected and 1.2% is HCV infected [2]. In the present scenario there are about 21.17 lakhs HIV cases, 50 million HBV cases and 12-18 million HCV cases within the country [3-5]. Hence, India, being a population of 1.2 billion has one of the largest reservoirs of HIV, HBV and HCV and many of its cases remain undetected [2,6]. Due to the large sero-prevalence in India, serological tests for HBsAg, anti-HCV and anti-HIV are done for diagnosing the respective diseases, antenatal and preoperative screening. When the prevalence of these blood borne infections is 1 in 1000 (0.1%) or more in the general population, screening tests are advisable [7].

Owing to resource constraints, in a country like India, rapid card tests based on immunochromatography methods only are used to screen these viral infections in most of the laboratories, both in private and public sector. It has been found that rapid immuno-chromatographic kits for HBsAg and HCV have only limited efficacy and should be backed by superior methods like Enzyme Linked Immunosorbent Assay (ELISA) and Polymerase Chain Reaction (PCR) [8]. For HIV infection the performance of Rapid Diagnostic Tests (RDT) in comparison to ELISA is suboptimal and RDT based serial testing algorithm cannot parallel the testing accuracy of an ELISA based approach [9]. Hence, it is required to formulate an integrated strategy for India.

Another method is emerging globally for screening of these viral infections, namely Enzyme Chemiluminescence Immunoassay (ECLIA) which is a recent FDA approved method for detecting HBsAg, anti-HCV and anti-HIV antibodies for its higher sensitivity and specificity [8,10].

There are very few studies in India evaluating the role of ECLIA to screen HBV, HIV and HCV infections in patients and blood donors [11,12]. Due to better testing output and objective interpretation of results, most of the laboratories in developed countries have adopted this method. But due to expensive instrumentation, use of this method in India is limited.

The study aimed to assess the performance characteristics of a fully automated rapid immunodiagnostic chemiluminescence system Vitros®ECi (Ortho diagnostics Ltd.,) and RDT for screening of HBs Ag, HCV antibodies and HIV antibodies in terms of sensitivity, specificity and accuracy compared to ELISA. RDT uses the immunochromatographic method to detect HBsAg, anti-HCV and anti-HIV antibodies. ELISA uses combination of the specificity of antibodies or antigens with the sensitivity of enzyme assays to detect HBsAg, antibodies to HCV and HIV 1 and 2 in human serum. These antigen antibody reactions occur in a coated microwell with a positive and negative control being run with each batch of tests following the principle of ‘Sandwich ELISA’. ELISA was validated by the acceptance criteria laid down by the manufacturers. ECLIA uses sophisticated hardware and software and enhanced chemiluminescence detection technology to process samples.

Materials and Methods

This cross-sectional pilot study was done at Department of Microbiology of a tertiary care medical college in West Bardhhaman district of West Bengal, India for a period of four months from November 2016 till February 2017. One hundred and ninety-eight blood samples during aforementioned period were collected from inpatient and outpatient in plain vacutainers and were received at microbiology laboratory and information documented. Serum was immediately separated from blood and subjected to respective tests and results were recorded. Purposes of doing the tests were also recorded as diagnosing diseases, antenatal and preoperative screening. HIV pre-test consent was taken according to NACO guidelines [13]. Demographic details of all the patients were noted. Study was initiated after permission from the Institutional Ethics Committee.

Inclusion Criteria: All those with unknown serological tests giving consent were included in the study.

Exclusion Criteria: All those who declined their consent and those who were already infected were excluded from the study.

All samples were tested by three different methods i.e., ECLIA by Vitros®ECiQ/ECi Immunodiagnostic Systems (Ortho Clinical Diagnostics Ltd), ELISA (manufactured by J.Mitra Diagnostics fourth Generation Microlisa-HIVAg & Ab kit for HIV, J.Mitra Diagnostics Hepalisa kit for HBsAg ELISA, J.Mitra Diagnostics 3rd generation HCV Microlisa kit for HCV) and RDT (J mitra & Co. Ltd.,) for HBsAg, anti-HCV and HIV antibodies. The validity of the ELISA tests was assessed by means of acceptance criteria which were laid down by the manufacturer for the absorbance of the reagent blank as well as for the mean absorbance of the positive and negative controls which were supplied with the test kits. The cut off value for reporting the positive results was calculated as per the manufacturer’s directions. Both known positive and negative controls were used as the external controls. Sensitivity, specificity, PPV, NPV and diagnostic accuracy were calculated based on the results of the tests taking ELISA as gold standard [14-17]. In Vitros®ECiQ/ECi Immunodiagnostic Systems (Ortho Clinical Diagnostics Ltd.,) for HBsAg, anti-HCV and anti-HIV antibodies, sample with signal cut off ratio less than 0.80 was considered non-reactive. Sample with signal cutoff ratio more than 1 was considered reactive and sample with signal cut-off ratio from 0.80 to 1 was considered indeterminate [11]. Indeterminate samples were tested in duplicate.

Statistical Analysis

Collected data were compiled on Microsoft excel worksheets (Microsoft Office Excel 2007, Redwoods, WA, USA). Validity of the tests like RDT and ECLIA was expressed by sensitivity and specificity by taking ELISA as gold standard. Kappa co-efficient was also computed to see the extent of agreement between the values of two different methods beyond which we would expect by chance alone. Cohen’s kappa coefficient (k) was calculated using a free tool available from Graph Pad software website [18]. A p-value <0.001 was considered as statistically significant.

Results

Among 198 patients 114(58%) were male and 84(42%) were female. The population comprising patients aged between 10 to 85 years is shown in [Table/Fig-1]. The purpose of doing the tests was documented and they are shown in [Table/Fig-2]. In most of the cases (53.5%), reasons for doing the tests were not mentioned in the requisition forms.

Age distribution of patients.

Age GroupsNumber of casesPercentage
≤20 yrs147.1
21-30 yrs4221.2
31-40 yrs2412.1
41-50 yrs5025.3
51-60 yrs3417.2
61-70 yrs2412.1
>70 yrs105.1
Total198100%
Mean±SD43.62±17.50

Purpose of doing HBsAg, anti-HIV and anti-HCV tests.

Purpose of testingNumberPercentage
Antenatal screening126.1
Symptomatic4422.2
Preoperative screening3618.2
Purpose of screening not known10653.5

RDT, ECLIA and ELISA were done for all 198 samples for HBsAg, HIV 1and 2 antibodies and HCV antibodies taking ELISA as gold standard. Sensitivity, specificity, PPV, NPV, accuracy and kappa coefficient were calculated and are tabulated in [Table/Fig-3].

Sensitivity, Specificity, Accuracy and Kappa coefficient of different tests.

TestsTrue PositiveTrue NegativeFalse PositiveFalse NegativeSensitivity %Specificity %PPV %NPV %Accuracy %Cohens kappa coefficientp-value
RDT(HBs Ag)16178048010010097.8980.878<0.001
ECLIA(HBsAg)16178048010010097.8980.878<0.001
RDT(anti-HIV 1&2)6192001001001001001001<0.001
ECLIA(anti-HIV 1&2)6190201009975100990.852<0.001
RDT(anti-HCV)81862466.798.98097.9970.711<0.001
ECLIA(anti-HCV)1218610010094.654.510094.70.681<0.001

PPV: Positive Predictive Value; NPV: Negative Predictive Value; RDT: Rapid Diagnostic Test; ECLIA: Enzyme Chemiluminiscence Assay; HBsAg: Hepatitis B surface antigen; HIV: Human Immunodeficiency Virus; HCV: Hepatitis C Virus


Our findings demonstrated that for HBsAg sensitivity, specificity and accuracy for RDT and ECLIA were same. For anti-HIV 1 and 2, RDT showed 100% accuracy and ECLIA showed 99% accuracy. For anti-HCV, ECLIA by ECiVitros showed better sensitivity than corresponding RDT (Sensitivity100% versus Sensitivity 66.7% respectively). On the contrary, RDT showed better specificity than ECLIA by ECiVitros (Specificity 98.9% versus Specificity 94.6% respectively).

Kappa co-efficient was also computed to observe to what extent the reading of two different methods (RDT and ECLIA) for HBsAg, anti-HIV1 and 2 and anti-HCV agreed beyond which we would expect by chance alone. Strength of agreement for HBsAg by RDT and ECLIA was almost perfect (0.88). Again, strength of agreement for RDT and ECLIA for anti-HIV 1 and 2 and anti-HCV were also substantial [19]. All results were documented according to the kit manufacturers’ directions.

Discussion

In developing countries use of RDT as the first line screening assay for HBV, HCV and HIV is very much in use. The present study attempted to compare the test results of RDT and a newer technique (ECLIA) as screening tests for these infections. In the study 114(58%) patients were male and 84(42%) patients were female. The maximum number of patients belonged to 41-50 years age group [Table/Fig-1]. Most of the studies with a similar scope has emphasised only on evaluating different techniques like RDT, ECLIA and ELISA [12,16].

Currently, the information of use of chemiluminescence (ECLIA) technology for the detection of HBsAg, anti-HIV 1&2 and anti-HCV in patients is limited [11]. For screening of HBsAg, HIV and HCV antibodies, RDT are routinely used in developing country like India. In the study, we attempted to evaluate for the first time, the role of ECLIA along with RDT in screening of these infections in patients of this region with ELISA as gold standard. On the other hand, few similar studies have been done for screening of these infections in the blood donor group [16,20].

In the study, report of test results for HIV was done as per NACO guidelines [13]. We observed sensitivity of 80% and specificity of 100% by ECLIA and RDT respectively for HBsAg.

Sensitivity of 100% and specificity of 94.6% by ECLIA vs. sensitivity 66.7% and specificity 98.9% by RDT was observed for anti-HCV. Sensitivity of 100%, specificity of 99% by ECLIA and sensitivity and specificity both 100% by RDT was recorded in case of anti-HIV. These results are also documented in [Table/Fig-3]. In another study Ismail N et al., observed sensitivity 97.4% and specificity 100% for HBsAg done by ECLIA. Results of the current study showed a little lower sensitivity but same specificity for HBsAg. Ismail N et al., also mentioned sensitivity of 100% and specificity of 98.9% for anti-HCV by ECLIA performed by ECiVitros (Ortho diagnostics). This result for anti-HCV also showed similar sensitivity and specificity by ECLIA [21].

There is no false negative result for anti-HCV by ECLIA but four false negative tests were found by RDT. Due to the findings it can be concluded that RDT has poor specificity as compared to ECLIA for screening of HCV infections. Hence, RDT may miss some HCV infection. As a result use of only RDT for screening of blood donors and patients for transfusion purposes and for antenatal cases, may result in alarming consequences. It is also concluded that RDT may not be a suitable screening test for anti-HCV antibodies.

Regarding anti-HIV, our study revealed 100% sensitivity and 100% specificity by RDT which was comparable with ECLIA which showed 100% sensitivity and 99% specificity. Khan JK et al., mentioned in their study that there was around 50% less sensitivity with rapid kits as compared to ELISA for anti-HIV and HBsAg [8]. However, we observed that both ECLIA and RDT gave good sensitivity and specificity for HBsAg and anti-HIV.

It was also noticed that if cut off/OD was high for the tests by ECLIA and ELISA then the results were reactive by RDT also. But, when OD level was only marginally high in ELISA, it was observed that both RDT and ECLIA showed negative or nonreactive result. This type of finding for ECLIA is unlikely as ECLIA is considered a more sensitive test than ELISA [22,23]. Ideal screening tests should show high degree of PPV and low degree of false negative results. Taking ELISA as gold standard diagnostic test may be the cause of such finding. In such cases it is advisable to confirm the discrepant results by other specific tests.

The essence of this study was to enlighten the poor resource countries that rapid test kits as sole diagnostic test for detection of HBsAg and HCV should be interpreted with caution both in patients and in donors and role of ELISA as gold standard should be re-evaluated [23].

It is suggested that hospitals and blood banks which can provide for ECLIA should prefer it over other test procedures particularly for anti-HCV because it is rapid, highly sensitive, user friendly and quality assured. The inbuilt monitoring system in ECLIA by Vitros ECi assures that proper calibration and running of control a ‘must do’ before running the tests. This ensures maximum reliability and minimum subjective errors.

Limitation

One of the limitations of the study was that confirmatory tests like RIBA and qualitative nucleic acid testing for HCV, Western blot for HIV, anti-HBc antibody and HBV DNA for HBV infection could not be done owing to resource constraint [9,24-27]. Clinical follow up of reactive cases and staging of the disease was not done.

Conclusion

In the study, it was concluded that both RDT and ECLIA are good screening tests for HIV infection. For HCV infection, ECLIA is a better screening tool than RDT. Regarding HBsAg, RDT should be used in resource limited areas, but in resourceful areas ECLIA should be adopted as the preferred method of screening test as it is fully automated and requires minimum technical expertise. The role of ELISA as reference standard may also be re-evaluated with Nucleic Acid Amplification Technique (NAT). It is also stressed that ECLIA is more rapid and user friendly than ELISA.

In case of discrepant test results performed by different methods, each laboratory should develop a protocol to interpret and confirm the results in consultation with clinicians so as to serve the patient with the most accurate and standardised reports.

PPV: Positive Predictive Value; NPV: Negative Predictive Value; RDT: Rapid Diagnostic Test; ECLIA: Enzyme Chemiluminiscence Assay; HBsAg: Hepatitis B surface antigen; HIV: Human Immunodeficiency Virus; HCV: Hepatitis C Virus

References

[1]Bihl F, Castelli D, Marincola F, Dodd RY, Brander C, Transfusion-transmitted infections J Transl Med 2007 5:2510.1186/1479-5876-5-2517553144  [Google Scholar]  [CrossRef]  [PubMed]

[2]Ahmed R, Bhattacharya S, Universal screening versus universal precautions in the context of preoperative screening for HIV, HBV, HCV in India Indian J Med Microbiol 2013 31:219-25.10.4103/0255-0857.11562323883705  [Google Scholar]  [CrossRef]  [PubMed]

[3]India HIV Estimations 2015. [Accessed 2018/02/07:3] at naco.gov.in/sites/default/files/India HIV Estimations 2015.pdf  [Google Scholar]

[4]Ray G, Current scenario of Hepatitis B and its treatment in India J Clin Transl Hepatol 2017 5(3):277-96.10.14218/JCTH.2017.0002428936409  [Google Scholar]  [CrossRef]  [PubMed]

[5]Dhiman RK, Satsangi S, Grover SG, Puri P, Tackling the hepatitis C disease burden in Punjab India J Clin Exp Hepatol 2016 6(3):224-32.10.1016/j.jceh.2016.09.00527746619  [Google Scholar]  [CrossRef]  [PubMed]

[6]UNAIDS Report on the global AIDS epidemic 2010. [Accessed 2017/11/09] at http://www.unaids.org/globalreport/Global_report.htm  [Google Scholar]

[7]Thornton AC, Delpech V, Kall MM, Nardone A, HIV testing in community settings in rei-rich countries: A systematic review of the evidence HIV Med 2012 13(7):416-26.10.1111/j.1468-1293.2012.00992.x22413900  [Google Scholar]  [CrossRef]  [PubMed]

[8]Khan JK, Lone DS, Hameed A, Munim MR, Bhatti M, Khattak AA, Evaluation of the performance of two rapid immunochromatographic tests for detection of hepatitis B surface antigen and anti HCV antibodies using ELISA tested samples Special Edition Annals 2010 16(1):84-87.  [Google Scholar]

[9]Mehra B, Bhattar S, Bhalla P, Rawat D, Rapid tests versus ELISA for screening of HIV infection: our experience from a voluntary counselling and testing facility of a tertiary care centre in North India ISRN AIDS 2014 2014:29684010.1155/2014/29684025006527  [Google Scholar]  [CrossRef]  [PubMed]

[10]Guidelines for laboratory testing and result reporting of antibody to hepatitis C virus MMWR 2003 52(RR03):1-16.  [Google Scholar]

[11]Bilolikar AK, Latha MB, Reddy SG, Vanaja S, Ahmed IMD, Chowdary RD, Seroprevalance of HBsAg, anti-HIV 1&2 and anti-HCV by chemiluminescence method-A hospital based study from 2007 to 2014 J Med Sci Res 2015 3(1):1-8.10.17727/JMSR.2015/3-001  [Google Scholar]  [CrossRef]

[12]Mathur A, Dontula S, Jagannathan L, A study of centralized individual donor nucleic acid testing for transfusion transmitted infections to improve blood safety in Karnataka, India Glob J Transfus Med AATM 2017 2:24-28.10.4103/GJTM.GJTM_8_17  [Google Scholar]  [CrossRef]

[13]National Guidelines for HIV Testing. [Accessed 2017/11/09] at www.naco.gov.in/sites/default/files/National_Guidelines_for_HIV_Testing_21Apr2016.pdf: 37-41  [Google Scholar]

[14]Cruz HM, Scalioni LP, Paula VS, Silva EF, Rodrigues KM, Milagres FAP, Evaluating HBsAg rapid test performance for different biological samples from low and high infection rate settings & populations BMC Infect Dis 2015 15:54810.1186/s12879-015-1249-526619906  [Google Scholar]  [CrossRef]  [PubMed]

[15]Hayder I, Ahmed W, Alam SE, Comparison of different ICT kits for HBsAg and Anti HCV using gold standard ELISA Pak J Med Res 2012 51(3):72-76.  [Google Scholar]

[16]Torane VP, Shastri JS, Comparison of ELISA and rapid screening tests for the diagnosis of HIV, Hepatitis B and Hepatitis C among healthy blood donors in a tertiary care hospital in Mumbai IJMM 2008 26(3):284-85.10.4103/0255-0857.4207118695340  [Google Scholar]  [CrossRef]  [PubMed]

[17]Ali SHM, Khalidi SA, Kasim WN, Evaluation of performance characteristics of commercially available tests for diagnosing Hepatitis B surface antigenemia The Iraqi Post Graduate Medical Journal 2009 8(2):159-71.  [Google Scholar]

[18]QuickCalcs. [Accessed 2017/11/09] at https://www.graphpad.com/quickcalcs/kappa1.cfm  [Google Scholar]

[19]Landis JR, Koch GG, The measurement of observer agreement for categorical data Biometrics 1977 33:159-74.10.2307/2529310  [Google Scholar]  [CrossRef]

[20]Kukar N, Garg R, Maharishi RN, Syal N, Arora H, ELISA versus Rapid test kits for screening of HIV and Hepatitis B and Hepatitis C among blood donors in a tertiary care hospital Sch J App Med Sci 2017 5(3A):727-29.10.21276/aimdr.2017.3.3.PT5  [Google Scholar]  [CrossRef]

[21]Ismail N, Fish GE, Smith MB, Laboratory evaluation of a fully automated chemiluminescence immunoassay for rapid detection of HBsAg, antibodies to HBsAg, and antibodies to hepatitis C virus J Clin Microbiol 2004 42(2):10-17.10.1128/JCM.42.2.610-617.200414766824  [Google Scholar]  [CrossRef]  [PubMed]

[22]Ghosh M, Nandi S, Dutta S, Saha MK, Detection of hepatitis B virus infection: A systematic review World J Hepatol 2015 7(23):2482-91.10.4254/wjh.v7.i23.248226483870  [Google Scholar]  [CrossRef]  [PubMed]

[23]Amini A, Varsaneux O, Kelly H, Tang W, Chen W, Boeras DI, Diagnostic accuracy of tests to detect hepatitis B surface antigen: a systematic review of the literature and meta-analysis BMC Infectious Diseases BMC Series 2017 17(1):69810.1186/s12879-017-2772-329143619  [Google Scholar]  [CrossRef]  [PubMed]

[24]Busch MP, Kleinman SH, Jackson B, Stramer SL, Hewlett I, Preston S, Nucleic acid amplification testing of blood donors for transfusion-transmitted infectious diseases: report of the Interorganizational Task Force on Nucleic Acid Amplification of Blood Donors Transfusion 2000 40(2):143-59.10.1046/j.1537-2995.2000.40020143.x10685998  [Google Scholar]  [CrossRef]  [PubMed]

[25]Gretch DR, dela Rosa C, Carithers RL, Willson RA, Williams B, Corey L, Assessment of hepatitis C viremia using molecular amplification technologies: correlations and clinical implications Ann Intern Med 1995 123(5):321-29.10.7326/0003-4819-123-5-199509010-000017542853  [Google Scholar]  [CrossRef]  [PubMed]

[26]Polyak SJ, Gretch DR, Molecular diagnostic testing for viral hepatitis: methods and applications. In R. A Willson (1997 ed.) Viral hepatitis: diagnosis, treatment, and prevention vol. 4New York, N.Y.Marcel Dekker, Inc.:1-33.  [Google Scholar]

[27]Nese I, Aslihan D, Ünsur EK, Görmüs U, Sönmez E, Tabak F, Comparison of Chemiluminescence Microparticle Immunoassay and Electrochemiluminescence Immunoassay for Detection of HBsAg Viral Hepat J 2014 20(3):101-05.10.4274/vhd.08760  [Google Scholar]  [CrossRef]