JCDR - Register at Journal of Clinical and Diagnostic Research
Journal of Clinical and Diagnostic Research, ISSN - 0973 - 709X
Biochemistry Section DOI : 10.7860/JCDR/2020/47345.14391
Year : 2020 | Month : Dec | Volume : 14 | Issue : 12 Full Version Page : BC09 - BC11

Application of Sigma Metrics for Evaluating the Analytical Performance of Thyroid Profile and Cortisol in Clinical Biochemistry Laboratory

Smita Natvarbhai Vasava1, Roshni Gokaldas Sadaria2

1 Assistant Professor, Department of Biochemistry, Smt. BK Shah Medical Institute and Research Centre, Sumandeep Vidyapeeth Deemed to be University, Piparia, Vadodara, Gujarat, India.
2 Associate Professor, Department of Biochemistry, Smt. BK Shah Medical Institute and Research Centre, Sumandeep Vidyapeeth Deemed to be University, Piparia, Vadodara, Gujarat, India.


NAME, ADDRESS, E-MAIL ID OF THE CORRESPONDING AUTHOR: Dr. Roshni Gokaldas Sadaria, C-204, Lilleria Avenue, Sama-Savali Road, Vadodara-390024, Gujarat, India.
E-mail: drroshnijasani@gmail.com
Abstract

Introduction

Now-a-days quality is the key aspect of clinical laboratory services. The six sigma metrics is an important quality measurement method for evaluating the performance of the clinical laboratory.

Aim

To assess the analytical performance of clinical biochemistry laboratory by utilising thyroid profile and cortisol parameters from Internal Quality Control (IQC) data and to calculate sigma values.

Materials and Methods

Study was conducted at Clinical Biochemistry Laboratory, Dhiraj General Hospital, Piparia, Gujarat, India. Retrospectively, IQC data of thyroid profile and cortisol were utilised for six subsequent months (July to December 2019). Coefficient of Variation (CV%) and bias were calculated from IQC data, from that the sigma values were calculated. The sigma values <3, >3 and >6 were indicated by poor performance procedure, good performance and world class performance, respectively.

Results

The sigma values were estimated by calculating mean of six months. The mean sigma value of Thyroid Stimulating Hormone (TSH) and Cortisol were >3 for six months which indicated the good performance. However, sigma value of Triiodothyronine (T3), Tetraiodothyronine (T4) were found to be <3 which indicated poor performance.

Conclusion

Six sigma methodology applications for thyroid profile and cortisol was evaluated, it was generally found as good. While T3 and T4 parameters showed low sigma values which requires detailed root cause analysis of analytical process. With the help of six sigma methodology, in clinical biochemistry laboratories, an appropriate Quality Control (QC) programming should be done for each parameter. To maintain six sigma levels is challenging to quality management personnel of laboratory, but it will be helpful to improve quality level in the clinical laboratories.

Keywords

Introduction

Six sigma management methodology come to attention publically because it is a system that integrates with accurate evaluation, problem-solving, and process improvement [1]. The laboratory process is divided into three phases; pre-analytical, analytical and post-analytical, in clinical medical laboratories. Errors that appear in each stages ultimately affect the test results and therefore for each stage, the magnitude of total error should be calculated. It has been found that most commonly errors occur at the pre-analytical phase [2]. The six sigma is quality control methodology which detect defect rate of 3.4 defects per million opportunities. Six sigma was initially developed by Bill Smith of Motorola in 1986 for eradicating defects in manufacturing. This defect is explained to be a process or product which fails to meet customers’ requirements and expectations. The six sigma improvement model, Define, Measure, Analyse, Improve, and Control (DMAIC) specifies the sequence of steps for understanding and improving a process are: a) defining the project goals and customer (internal and external) requirements; b) measures the process for determination of current performance; c) analysing and determining the root causes of relevant defects; d) improving the process with elimination of defect root causes, and e) controls the subsequent future performance of process [3]. In clinical laboratories, six sigma deliver the manner to make lesser mistakes in all processes by removing errors before they come into sight.

In the present study, the CV% and bias were derived from IQC data of T3, T4, TSH and cortisol parameters and sigma values were calculated by which the analytical performance of clinical biochemistry laboratory was evaluated in Central Clinical Biochemistry laboratory, Dhiraj General Hospital, Gujarat, India.

Materials and Methods

The present retrospective cross-sectional study was conducted at Central Clinical Biochemistry Laboratory of Dhiraj General Hospital, Piparia, Gujarat, India. Approval for the study was obtained from Sumandeep Vidyapeeth Institutional Ethics Committee (SVIEC/ON/MEDI/RP/20125, dated 14/12/2020). IQC data of thyroid profile and cortisol were obtained from Maglumi 800 Chemiluminescence Immunoassay Analyser (CLIA) retrospectively from July 2019 to December 2019. The following serum immunoassay parameters were included: T3, T4, TSH and cortisol. [Table/Fig-1] shows, unit of measurement, normal range of parameters and IQC range of T3, T4, TSH and cortisol.

Unit of measurement, normal range and IQC range of T3, T4, TSH and cortisol.

ParameterUnitNormal rangeIQC range
T3ng/mL0.79-1.584.0-7.44
T4ug/dL4-119.7-16.3
TSHuIU/mL0.39-5.02.32-4.32
Cortisolug/dL8-10 AM: 8-254-6 PM :1-17Midnight: 1-58.2-13.8

Total triiodothyronine (T3), Thyroxine (T4); Thyroid-stimulating hormone (TSH); IQC: Internal quality control


IQC level of QC materials were given with kit and analysed every alternate day regularly. All QC materials were ready to use and given with kit. QC values were taken according to the reference method and Maglumi 800 Immunoassay Analyser was calibrated regularly.

The CV is a standardised measure of dispersion of a probability distribution or frequency distribution which is often expressed as a percentage. Analytical method and analyser have a good performance if the CV% value is ≤5% while CV% values ≥10% suggests that analytical method and analyser have an inadequate performance [2]. First mean and SD were calculated and from that CV% was calculated from IQC data of T3, T4, TSH and cortisol with the formula CV%=(SD/Mean)×100. CV% is defined as the degree of precision. First mean and SD were calculated and from that CV% was calculated from IQC data over the six months. Bias measures, how far was your observed value from a target value. Calculation of bias% was done by the following formula as {(lab Mean of IQC data-target mean of IQC data)/(target mean of IQC data)}×100. Percent bias values of each parameter were calculated from July to December 2019.

Total Allowable error (TEa) values of T3, T4, TSH and cortisol were obtained from the Clinical Laboratories Improvement Act (CLIA) guidelines [4] and Nar R and Emekli DI study [2]. The sigma metrics was calculated for various parameters by the following equation: Sigma metrics (σ)=(TEa%-bias%)/CV% [5], where, TEa and bias are an indicator of systematic errors, whereas CV% is an indicator of random errors. Sigma metrics involve simple and minimal calculations. All that is necessary is to decide the quality goals and calculate the method’s imprecision and bias levels as one would ordinarily do in method validation studies [6]. In the present study, the sigma values <3, ≥3 to 6 and >6 were considered as a poor performance procedure, good performance and world class performance, respectively.

Statistical Analysis

Mean and Standard Deviation (SD) values, CV%, bias% and six sigma values were calculated by following formulations. All calculations were done in the spread sheet; MS excel of Windows 6. The sigma metrics was calculated for various parameters by the following equation: Sigma metrics (σ)=(TEa%-bias%)/CV% [5], where, TEa and bias are an indicator of systematic errors, whereas CV% is an indicator of random errors.

Results

The target mean, laboratory mean and the calculated SD of the IQC data for various parameters in clinical biochemistry laboratory is shown in [Table/Fig-2].

Target mean, laboratory mean and Standard Deviation (SD) values of each parameter.

ParameterTarget MeanIQC
JulyAugustSeptemberOctoberNovemberDecember
MeanSDMeanSDMeanSDMeanSDMeanSDMeanSD
T35.72 ng/mL5.780.145.250.225.180.125.110.124.550.124.670.18
T413 ug/dL11.260.1210.910.3110.850.2811.680.1212.671.4112.670.35
TSH3.32 uIU/mL2.890.132.900.093.10.143.010.193.110.292.950.11
Cortisol11 ug/dL10.080.3610.920.2910.460.2710.080.399.840.4211.10.45

The CV% values of IQC were found <5 for the parameters T3, Cortisol. While CV% of IQC were found between 5 to 10 for T4 in month November 2019. Total allowable error, bias and CV% values of the IQC for each parameter is shown in [Table/Fig-3].

Total allowable error (TEa), bias and CV% values of internal quality.

ParameterTEa (%)IQC
JulyAugustSeptemberOctoberNovemberDecember
CV%Bias%CV%Bias%CV%Bias%CV%Bias%CV%Bias%CV%Bias%
T36.82.424.784.194.252.324.182.354.112.643.553.853.43
T410.41.0710.262.849.912.589.301.0310.689.612.32.769.0
TSH23.74.501.893.101.904.522.16.312.019.322.113.731.97
Cortisol253.579.082.669.922.589.463.879.084.278.844.0510.19

The sigma values for cortisol were found to be 6.02 in month of September 2019. But, several parameters had sigma values less than 3 (<3): T3 (July to December 2019); T4 (July to December 2019); TSH (November 2019). Cumulative sigma metrics of last six months (July-December 2019) for TSH and cortisol was found to be more than 3 (except in November 2019). Complete sigma metrics for thyroid profile and cortisol are shown in [Table/Fig-4,5].

The sigma metrics month-wise and cumulative sigma metrics for each parameter.

ParameterJulyAugustSeptemberOctoberNovemberDecemberCumulative sigma metrics
IQC Sigma (σ) valueIQC Sigma (σ) valueIQC Sigma (σ) valueIQC Sigma (σ) valueIQC Sigma (σ) valueIQC Sigma (σ) value
T30.830.611.131.141.230.880.97
T40.130.170.211.070.070.510.36
TSH4.857.034.783.442.325.834.71
Cortisol4.465.676.024.113.783.664.61

Sigma metrics performance groups for each parameter.

Sigma metricsJulyAugustSeptemberOctoberNovemberDecember
Group 1 (<3)T3, T4T3, T4T3, T4T3, T4T3, T4, TSHT3, T4
Group 2 (3-6)TSH, CortisolCortisolTSHTSH, CortisolCortisolTSH, Cortisol
Group 3 (>6)-TSHCortisol---

Discussion

The six sigma methodology permits the clinical laboratories to evaluate the effectiveness of their ongoing quality control processes [7]. Six sigma is a procedure of detecting errors used for the purpose of improvement under the roof of total quality management [8]. The sigma metrics reveals whether bias, imprecision, or both are contributing to a lower sigma metric for an assay or analyser currently in use. This valuable information was used for the evaluation of the associated processes which can be thoroughly used for improvements to reduce bias or imprecision which ultimately improve the quality and subsequently reducing laboratory costs [9].

Sigma metrics were computed using the data obtained from the measurement of QC materials to be used as quality indicators that represent the balance between quality requirements (TEa) and test variation (bias and CV). Thus, six sigma focuses on gathering data for analysis, which is used for Quality Assurance (QA). Laboratory errors thus can be reduced by maintaining ±6 SD between the mean value and the range [10].

A six-month CV is considered the representative of true test variation because many different laboratory technicians will perform QC measurements, and significant events, such as calibration or manufacturer maintenances will occur in that time frame. Unfortunately, there are currently no guidelines published regarding the sigma metric calculation. The variables that affect such a comparison include, the heterogeneous nature of data collection, the differences in methodologies, different IQC materials, different proficiency testing bodies giving bias and the time interval upon which sigma metrics is calculated, study period with cumulative bias and different environmental conditions in addition to the different analytical or clinical benchmarks that are chosen for evaluation of TEa. It also would be preferable to assess bias against a reference method or material [10]. It is important that an analytical procedure achieves a good sigma level if a high reliability is to be attached to the results [11].

In the present study, CV% values of IQC were found less than 5 for T3 and Cortisol. While CV% values of IQC were found between 5 to 10 for T4 in month November, 2019, respectively. The reasons for variability of CV may be errors due to instability of the IQC or calibrator material during transport or storage and sample handling of laboratory technicians. For better CV, it is necessary to identify a protocol for transportation, preparation and aliquoting the IQC and calibrator material to prevent differences between laboratory technicians during assay.

The mean sigma values were found to be more than 3 for TSH and Cortisol. So, for theses parameters, more elaborate QC strategies are required. The sigma values were <3 for T3 (July to December 2019); T4 (July to December 2019); TSH (November 2019). The mean sigma values of T3 and T4 were less than 3 (Sigma <3). So, for these parameters, the frequency of IQC should be increased and corrective action should be undertaken for these parameters. In our laboratory calibrations of parameters with poor sigma performance are more frequently performed now and the number of daily IQC has been increased.

In a study performed by Nar R and Emekli DI, concluded that sigma value of TSH was >6 for both QC for three months. The sigma value mean of three months for TSH was found to be 13, 06/16, 13 for first and second level. So the study suggests that TSH had world class performance for both QC levels [2].

In the study conducted by Gulbahar O et al., demonstrated that according to six sigma value, there was world class performance for TSH in both instruments [12]. There was differences in six sigma values may be due to type of immunoassay analyser used, IQC material or pre-analytical and post-analytical conditions. In the present study, only one instrument was available for immunoassay measurement. So, inter-instrument variation could not be used for comparison.

The six-sigma methodology is an effective method for the evaluation of analytical stage, the quality measurement of the laboratory tests and the optimisation of quality control rules according to sigma values. IQC practices should be specific to the test and they should be generated in accordance with the sigma values of each test [2].

Limitation(s)

Limitation of the present study was, only one IQC level material was available with kit (either normal or abnormal level control). Multilevel IQC materials, upgraded analysers and better methodologies may help in reducing the errors and improve the sigma values in the laboratory. Along with analytical process, pre-analytical and post-analytical processes should be performed for evaluation of general performance of clinical laboratory.

Conclusion(s)

The analytical performance of our laboratory according to six sigma methodology, it was good for cortisol and TSH. But unsatisfactory value for T3 and T4 which shows instability and low consistency of results being delivered which require detailed root cause assessment of analytical process. Quality is ongoing process, so, quality personnel of the laboratory should not stop by generating CV% and Bias% of the any analyte but also monitor sigma matrix regularly to give world class quality of laboratory work. Evaluation of overall performance of clinical laboratory should done with analytical process as well as pre-analytical and post-analytical processes.

Total triiodothyronine (T3), Thyroxine (T4); Thyroid-stimulating hormone (TSH); IQC: Internal quality control

References

[1]Zhou B, Wu Y, He H, Li C, Tan L, Cao Y, Practical application of six sigma management in analytical biochemistry processes in clinical settings J Clin Lab Anal 2020 34:e23126.1-10.10.1002/jcla.23126  [Google Scholar]  [CrossRef]

[2]Nar R, Emekli DI, The evaluation of analytical performance of immunoassay tests by using six-sigma method J Med Biochem 2017 36:01-08.10.1515/jomb-2017-002630581326  [Google Scholar]  [CrossRef]  [PubMed]

[3]Sawalakhe PV, Deshmukh SV, Lakhe RR, Suitability of six sigma in testing laboratories; Some explorations Internatl J of Engineering Res & Techno 2016 4(30):2278-0181.:1-4.  [Google Scholar]

[4]Greg Cooper CLS, Using Analytical Goals in Bio-Rad’s Unity Real Time™ Software to Reduce False Rejections. QC NetTM Netherland. Retrieved from https://www.qcnet.com/QCPublicaties/ArchivedarticleAnalyticalGoalsgregcooper/tabid/6694/language/en-US/Default.aspx?PageContentMode=1  [Google Scholar]

[5]Rentapalli BR, Ganji SB, Sulemani MDD, Target score of riqas and sigma metrics for evaluating the analytical performance of thyroid function testing on advia centaur XPT immunoassay analyser J Evolution Med Dent Sci 2019 8(07):447-50.10.14260/jemds/2019/98  [Google Scholar]  [CrossRef]

[6]Sawalakhe PV, Deshmukh SV, Lakhe RR, Evaluating performance of testing laboratory using six sigma International Journal of Innovations in Engineering and Science 2016 1(1):13-20.  [Google Scholar]

[7]Randox, Retrieved from https://www.randox.com/24-7-statistical-metrics-reports/  [Google Scholar]

[8]Tosuner Z, Gücin Z, Tgçe K, Büyükpinarbasili N, Turna S, Taskiran O, A six sigma trial for reduction of error rates in pathology laboratory Turk Patoloji Derg 2016 32:171-77.10.5146/tjpath.2015.0135627562391  [Google Scholar]  [CrossRef]  [PubMed]

[9]Smy L, The case for six sigma in lab quality management systems APR 1; 2020 AACC.org. Retrieved from https://www.aacc.org/publications/cln/articles/2020/april/the-case-for-six-sigma-in-lab-quality-management-systems  [Google Scholar]

[10]Ganji SB, Revupalli S, Evaluation of quality assurance in a new clinical chemistry laboratory by six sigma metrics J of Clin and Diag Res 2019 13(3):BC04-07.10.7860/JCDR/2019/40658.12666  [Google Scholar]  [CrossRef]

[11]Afrifa J, Gyekye SA, Owiredu WKBA, Ephraim RKD, Essien-Baidoo S, Amoah S, Application of sigma metrics for the assessment of quality control in clinical chemistry laboratory in Ghana: A pilot study Niger Med J 2015 56(1):54-58.10.4103/0300-1652.14917225657495  [Google Scholar]  [CrossRef]  [PubMed]

[12]Gulbahar O, Arslan B, Sen B, Cingirt M, Yilmaz SN, Evaluation of thyroid function tests in our laboratory by using six sigma analysis Turkish Journal of Biochemistry 2015 40(S1)  [Google Scholar]