hrcak mascot   Srce   HID

Izvorni znanstveni članak
https://doi.org/10.11613/BM.2018.020707

Risk analysis and assessment based on Sigma metrics and intended use

Yong Xia ; Department of Clinical Medical Laboratory, Peking University Shenzhen Hospital, Futian District, Shenzhen, China
Hao Xue ; Department of Clinical Medical Laboratory, Peking University Shenzhen Hospital, Futian District, Shenzhen, China
Cunliang Yan ; Department of Clinical Medical Laboratory, Peking University Shenzhen Hospital, Futian District, Shenzhen, China
Bowen Li ; Student, Guangdong Medical University, Dongguan, China
ShuQiong Zhang ; Department of Clinical Medical Laboratory, Peking University Shenzhen Hospital, Futian District, Shenzhen, China
Mingyang Li ; Department of Clinical Medical Laboratory, Peking University Shenzhen Hospital, Futian District, Shenzhen, China
Ling Ji ; Department of Clinical Medical Laboratory, Peking University Shenzhen Hospital, Futian District, Shenzhen, China

Puni tekst: engleski, pdf (170 KB) str. 195-203 preuzimanja: 267* citiraj
APA 6th Edition
Xia, Y., Xue, H., Yan, C., Li, B., Zhang, S., Li, M. i Ji, L. (2018). Risk analysis and assessment based on Sigma metrics and intended use. Biochemia Medica, 28 (2), 195-203. https://doi.org/10.11613/BM.2018.020707
MLA 8th Edition
Xia, Yong, et al. "Risk analysis and assessment based on Sigma metrics and intended use." Biochemia Medica, vol. 28, br. 2, 2018, str. 195-203. https://doi.org/10.11613/BM.2018.020707. Citirano 26.01.2021.
Chicago 17th Edition
Xia, Yong, Hao Xue, Cunliang Yan, Bowen Li, ShuQiong Zhang, Mingyang Li i Ling Ji. "Risk analysis and assessment based on Sigma metrics and intended use." Biochemia Medica 28, br. 2 (2018): 195-203. https://doi.org/10.11613/BM.2018.020707
Harvard
Xia, Y., et al. (2018). 'Risk analysis and assessment based on Sigma metrics and intended use', Biochemia Medica, 28(2), str. 195-203. https://doi.org/10.11613/BM.2018.020707
Vancouver
Xia Y, Xue H, Yan C, Li B, Zhang S, Li M i sur. Risk analysis and assessment based on Sigma metrics and intended use. Biochemia Medica [Internet]. 2018 [pristupljeno 26.01.2021.];28(2):195-203. https://doi.org/10.11613/BM.2018.020707
IEEE
Y. Xia, et al., "Risk analysis and assessment based on Sigma metrics and intended use", Biochemia Medica, vol.28, br. 2, str. 195-203, 2018. [Online]. https://doi.org/10.11613/BM.2018.020707

Rad u XML formatu

Sažetak
Introduction: In order to ensure the quality in clinical laboratories and meet the low risk requirements of patients and clinicians, a risk analysis and
assessment model based on Sigma metrics and intended use was constructed, based on which differential sigma performance (σ) expectations of
42 analytes were developed.
Materials and methods: Failure mode and effects analysis was applied to produce an analytic risk rating based on three factors, each test of which
was graded as follows: 1) Sigma metrics; 2) the severity of harm; 3) intended use. By multiplying the score of Sigma metrics by the score of severity
of harm by the score of intended use, each was assigned a typical risk priority number (RPN), with RPN ≤ 25 rated as low risk. Low risk was defined
as acceptable standards; the sigma performance expectations were calculated.
Results: Among the 42 analytes, tests with σ ≥ 6, 5 ≤ σ < 6, 4 ≤ σ < 5, 3 ≤ σ < 4, σ < 3 were 21, 5, 5, 6, and 5, respectively; there were 7 high-risk
tests, 8 of them medium risk tests. According to the risk assessment conclusion, 13 tests had sigma performance expectations ≥ 6; 15 test items had
sigma performance expectations ≥ 5, while 3 test items had sigma performance expectations ≥ 4; 11 test items had sigma performance expectations
≥ 3.
Conclusions: Constructing the risk analysis and assessment model based on Sigma metrics and intended use will help clinical laboratories to identify
the high-risk tests more objectively and comprehensively. Such model can also be used to establish the sigma performance expectations and
meet the low risk requirements of patients and clinicians.

Ključne riječi
risk analysis; risk assessment; Six Sigma; Sigma metrics; failure mode and effects analysis

Hrčak ID: 201527

URI
https://hrcak.srce.hr/201527

▼ Article Information



Introduction

Laboratories have a major impact on patient safety, as 80 – 90% of all diagnoses are made on the basis of laboratory tests (1). Laboratory errors have a frequency of 0.012 – 0.6% for all test results (2). A series of regulatory requirements and practice guidelines have been introduced to guide the establishment and continuous improvement of the quality management system to reduce the risk of the total testing process (3-5).

Failure mode and effects analysis (FMEA), one of the most proactive methods of risk management, has been accepted as the method of choice in the identification of potential points of failure within a process, their effects being determined and action identified for mitigating failures (6). The first step in FMEA is to identify all potential possible failure modes of the product or system. After that, critical analysis is performed on these failure modes and the risk priority number (RPN) is calculated by the multiplication of the occurrence (O), severity (S) and detection (D). Finally, the failure modes can be ranked and then proper actions will be preferentially taken on the high-risk failure modes (7). The application of the FMEA tool is consistent with the risk-based thinking required by ISO 9001 in the critical decisions, and plays an important role in ensuring the reliability of the product system. In contrast, Shebl et al. conducted numerous interviews with hospital staff in the United Kingdom and concluded: “FMEA in health care is associated with a lack of standardization in how the scoring scales are used and how failures are prioritized.” (8). Different technicians and different scoring methods yielded dissimilar results; it is a tool for which there is a lack of evidence (9). The Clinical and Laboratory Standards Institute (CLSI) EP23A guideline: Laboratory Quality Control Based on Risk Management provides an introduction to risk management techniques and guidance on developing a risk-based quality control plan (QCP) (3). The 2-factor model that includes only the probability of occurrence of harm and the severity of harm, does not consider the detection capability, is not conducive to the development of a robust laboratory QCP (10). Six Sigma is a technique that allows objective assessment of process performance. The resulting RPN on a sigma-scale is more objective, because it is less reliant on subjective rankings and more reliant on observed performance (11). Six sigma quality control (QC) design tools can enhance FMEA, the risk assessment process and design of QC plans (11).

In this study, a risk analysis and assessment model based on Sigma metrics and intended use was constructed to ensure the quality in clinical laboratories and meet the low risk requirements of patients and clinicians.

Materials and methods

Materials

This study was performed in the Clinical Chemistry Laboratory of the Peking University Shenzhen Hospital, Shenzhen, China, in 2017. The laboratory is accredited according to the International Organization for Standardization (ISO) 15189 2012 by China National Accreditation Service for Conformity Assessment in 2015. Thirty-six serum analytes were evaluated on the Beckman AU5800 chemistry analyser (Beckman Coulter, Tokyo, Japan), which included 27 original manufacturer reagents and 9 “non-kit” reagents. The 27 original manufacturer reagents were: alanine aminotransferase (ALT), aspartate aminotransferase (AST), alkaline phosphatase (ALP), gamma-glutamyltransferase (GGT), total protein (TP), albumin (Alb), total bilirubin (BT), direct bilirubin (BD), urea, creatinine (CREA), uric acid (UA), glucose (Glc), creatinine kinase (CK), lactate dehydrogenase (LD), amylase (AMY), triglycerides (TG), total cholesterol (CHOL), high density lipoprotein cholesterol (HDL), low density lipoprotein cholesterol (LDL), potassium (K), sodium (Na), chloride (Cl), calcium (Ca), magnesium (Mg), inorganic phosphate (Phos), iron (Fe), and transferrin (TRSF). There were 9 “non-kit” reagents, of which IgG, IgM, IgA, pre-albumin (PA), cystatin C (Cys-C) were from DiaSys (Holzheim, Germany); ß2-microglobulin (BMG), C3, C4 were from Leadman (Beijing, China) and C-reactive protein (CRP) was from Sekisui (Tokyo, Japan). Johnson Vitros5600 analyser (Ortho Clinical Diagnostics, Raritan, USA) and original manufacturer reagents were used to measure cardiac troponin I (cTn-I), Roche e601 analyser (Roche Diagnostics, Mannheim, Germany) and original manufacturer reagents for cardiac troponin T (cTn-T), Siemens RP500 blood gas analyser (Siemens Healthcare Diagnostics, Suffolk, United Kingdom) and original manufacturer reagents for pH, pCO2, pO2 and SEBIA CAPILLARY 2 capillary electrophoresis analyser and original manufacturer reagents (Sebia, Evrycedex, France) for HbA1c. Some commercial control samples of human origin were used for evaluation. Unassayed Specialty Chemistry & Protein Control level 1 and 2 (Qualab Biotech, Shanghai, China) were used for Cys-C. Liquid Unassayed Special Protein Control level 2 and 3 (Qualab Biotech, Shanghai, China) were used for PA, BMG, CRP. Liquichek Cardiac Markers Plus Control LT level 1 and 2 (Bio-Rad Laboratories, Irving, USA) were used for cTn-I, cTn-T. Rapid QC Complete level 1, 2 and 3 (Siemens Healthcare Diagnostics Inc, Terry town, USA) were used for pH, pCO2, pO2; HbA1c capillary controls (expected values-HbA1c percentages) (Sebia, Lisses, France) were used for HbA1c. For all other tests Liquid Assayed Multiqual level 1, 2 and 3 (Bio-Rad Laboratories, Irving, CA, USA) were used.

Methods

The critical decision level-making Sigma metrics

The critical decision levels were determined from a sigma verification program (SVP) (Westgard QC, Madison, USA) or established upon consultation with clinicians. Imprecision was calculated from cumulative results of the internal quality control (IQC) excluded out-of-control in different time periods of 2016 (Table 1). Cumulative coefficient of variation (CV) or standard deviation (SD) was chosen from QC with the concentration closest to the level of critical decision marked in the CV% column of Table 1. Bias calculations were from 2016 external quality assurance (EQA) programs in laboratory medicine by National Centre of Clinical Laboratories (NCCL) of China. Passing-Bablok regression was performed using Microsoft Excel 2007 to determine the bias between the test result and the instrument group mean for comparison from the ten or fifteen EQA program results for each test (12). The equation generated y = ax + b (R2 > 0.95) was then applied to determine bias at the critical decision level. Total allowable error (TEa) referred to the SVP and EQA criteria from NCCL of China. The Sigma metrics were calculated as follows: Sigma metrics = (TEa - bias) / SD or Sigma metrics = (TEa% - bias%) / CV%.

Table 1 Sigma metrics at the critical decision levels and risk analysis and assessment
Test/unitCDLTea (source)Regression equation
[y = ax (95% CI) +
b (95% CI)]
Bias
(%)
CV
(%)
NSigmaScoreSeverityScoreIntended useScoreRPNRAA
ALT (U/L)95SVP20% (CLIA)y = 0.98 (0.97 to 0.99)
x - 0.86 (- 2.36 to 0.64)
- 3.02.692282*6.31Serious3S/M412low
AST (U/L)40SVP20% (CLIA)y = 0.95 (0.93 to 0.96)
x - 1.23 (- 3.64 to 1.18)
- 8.21.712283*6.91Serious3S/M412low
GGT (U/L)85SVP22.1% (RD)y = 0.98 (0.97 to 1.00)
x + 0.39 (- 2.41 to 3.19)
- 1.11.522279*13.81Minor2S/M48low
ALP (U/L)150SVP30% (CLIA)y = 0.87 (0.82 to 0.93)
x + 3.30 (- 7.22 to 13.81)
- 10.42.362280*8.31Minor2S/M48low
TP (g/L)57SVP10% (CLIA)y = 1.00 (0.98 to 1.01)
x + 0.37 (- 0.61 to 0.98)
0.31.432286*6.81Minor2M36low
ALB (g/L)25SVP10% (CLIA)y = 0.94 (0.93 to 0.95)
x + 3.09 (2.66 to 3.53)
6.71.492278*2.25Minor2M330middle
BT (µmol/L)51.3SVP20% (CLIA)y = 1.04 (1.03 to 1.05)
x – 2.88 (- 3.64 to – 2.12)
- 1.41.362286*13.71Critical4S/M416low
BD (µmol/L)5.13SVP44.5% (RD)y = 1.00 (0.93 to 1.07)
x – 0.69 (- 2.77 to 1.38)
- 13.42.871285*10.81Serious3S/M412low
Urea (mmol/L)14.28SVP9% (CLIA)y = 1.00 (0.98 to 1.02)
x + 0.002 (- 0.26 to 0.27)
0.11.742287*5.12Serious3S/M424low
CREA (µmol/L)176.8SVP15% (CLIA)y = 1.00 (0.99 to 1.01)
x – 0.53 (- 3.87 to 2.85)
0.21.692284*8.81Critical4D520low
UA (µmol/L)196.3SVP17% (CLIA)y = 0.99 (0.95 to 0.99)
x – 6.21 (- 13.80 to 1.38)
- 5.41.592281*7.31Serious3D515low
Glc (mmol/L)6.66SVP10% (CLIA)y = 0.99 (0.97 to 1.00)
x – 0.01 (- 0.18 to 0.15)
- 1.51.942285*4.43Critical4D/S/M560high
CK (U/L)275SVP30% (CLIA)y = 1.01 (0.98 to 1.05)
x – 4.34 (- 18.86 to 10.18)
- 0.22.572281*11.61Serious3S/M412low
Test/unitCDLTEa (source)Regression equation
[y = ax (95% CI) +
b (95% CI)]
Bias
(%)
CV
(%)
NSigmaScoreSeverityScoreIntended useScoreRPNRAA
LDH (U/L)170SVP20%
(CAP PT)
y = 0.99 (0.96 to 1.02)
x + 1.06 (- 4.65 to 6.77)
- 0.23.152278*6.31Minor2S/M48low
AMY (U/L)145SVP30% (CAP PT)y = 0.88 (0.78 to 0.98)
x + 8.65 (- 17.79 to 35.09)
- 6.11.862280*12.81Critical4D/M520low
TG (mmol/L)1.47SVP25% (CLIA)y = 0.93 (0.90 to 0.96)
x + 0.04 (- 0.01 to 0.08)
- 4.81.412279*14.31Minor2M36low
CHOL (mmol/L)4.66SVP10% (CLIA)y = 1.00 (0.98 to 1.01)
x – 0.01 (- 0.80 to 0.05)
- 0.91.852288*4.93Minor2M318low
HDL-C (mmol/L)1.30 SVP30% (CLIA)y = 0.95 (0.97 to 0.92)
x + 0.05 (0.01 to 0.10)
- 1.33.542279*8.11Negligible1M33low
LDL-C (mmol/L)2.59SVP20% (CLIA)y = 1.10 (0.96 to 1.23)
x – 0.34 (- 0.82 to 0.15)
- 3.32.132280*7.81Minor2M36low
K (mmol/L)2.5SVP0.5 (CLIA)y = 0.98 (0.96 to 1.00)
x + 0.08 (- 0.01 to 0.17)
0.040.031
(SD)
288*15.41Catastrophic5D/M525low
Na (mmol/L)115SVP4 (CLIA)y = 1.00 (0.95 to 1.06)
x – 0.54 (- 8.01 to 6.94)
- 0.21.211
(SD)
290*3.14Critical4D/M580high
Cl (mmol/L)100SVP5% (CLIA)y = 1.02 (1.00 to 1.05)
x – 2.69 (- 5.02 to – 0.37)
- 0.31.182288*4.03Serious3M327middle
Ca (mmol/L)3.25SVP0.25 (CLIA)y = 0.95 (0.92 to 0.97)
x + 0.11 (0.04 to 0.18)
- 0.060.043
(SD)
289*4.73Critical4D/M560high
Mg (mmol/L)1.03SVP25%
(CAP PT)
y = 0.94 (0.92 to 0.96)
x + 0.05 (0.03 to 0.07)
- 1.62.182287*10.71Serious3M39low
Phos (mmol/L)1.29SVP10.7% (CAP PT)y = 0.98 (0.96 to 1.00)
x + 0.04 (- 0.00 to 0.07)
1.061.512284*6.41Serious2M36low
Fe (µmol/L)13.43SVP20% (CLIA)y = 0.98 (0.96 to 1.00)
x + 0.82 (0.17 to 1.47)
4.11.322276*12.01Minor2D510low
TRSF (g/L)3.6SVP20%
(CAP PT)
y = 1.05 (1.00 to 1.10)
x + 0.01 (- 0.11 to 0.12)
5.11.723193*8.71Minor2D510low
IgG (g/L)7SVP25% (CLIA)y = 1.00 (0.93 to 1.08)
x + 0.03 (- 1.02 to 1.08)
0.94.653290*5.22Minor2M312low
IgM (g/L)0.6SVP16.8% (RD)y = 1.00 (0.96 to 1.04)
x – 0.02 (- 0.07 to 0.02)
- 3.82.531285*5.12Minor2M312low
IgA (g/L)0.6SVP13.5% (RD)y = 1.01 (0.99 to 1.02)
x – 0.03 (- 0.09 to 0.02)
- 4.42.461286*3.74Minor2M324low
C3 (g/L)1.35SVP8.4% (RD)y = 1.07 (1.02 to 1.12)
x – 0.06 (- 0.14 to 0.01)
2.53.193288*1.95Serious3M345middle
C4 (g/L)0.75SVP16% (RD)y = 1.05 (0.97 to 1.13)
x – 0.00 (- 0.02 to 0.02)
4.23.413286*3.54Serious3M336middle
PA (mg/L)150SVP14.5% (RD)y = 0.92 (0.83 to 1.01)
x + 18.64 (0.47 to 36.8)
4.52.3421984.33Negligible1M39low
BMG (mg/L)2.7SVP9% (RD)y = 1.09 (1.00 to 1.18)
x – 0.05 (- 0.38 to 0.27)
6.93.421900.65Serious3S/M460high
Cys-C (mg/L)10SVP7.6% (RD)y = 1.02 (0.97 to 1.07)
x – 0.02 (- 0.28 to 0.23)
1.81.811913.24Serious3S/M448middle
CRP (mg/L)30SVP25% (NCCL)y = 0.92 (0.89 to 0.95)
x + 0.40 (- 0.97 to 1.78)
- 6.92.1821958.31Negligible1M33low
cTn-I (ng/mL)0.4cc30% (NCCL)y = 1.02 (0.98 to 1.05)
x – 0.04 (- 1.08 to 1.00)
- 8.24.341195§5.02Catastrophic5D550middle
cTn-T (ng/mL)0.1cc30% (NCCL)y = 0.96 (0.93 to 0.98)
x – 0.00 (- 0.04 to 0.04)
- 5.56.5213543.84Catastrophic5D5100high
Test/unitCDLTEa (source)Regression equation
[y = ax (95% CI) +
b (95% CI)]
Bias
(%)
CV
(%)
NSigmaScoreSeverityScoreIntended useScoreRPNRAA
pH7.1cc0.04 (NCCL)y = 1.05 (1.03 to 1.07)
x – 0.39 (- 0.53 to - 0.24)
- 0.020.0041
(SD)
1665.82Critical4D540middle
pCO2 (mmHg)75cc8% (NCCL)y = 1.01 (0.96 to 1.05)
x – 0.58 (- 3.03 to 1.86)
- 0.22.2911653.44Critical4D580high
pO2 (mmHg)80cc8% (NCCL)y = 0.91 (0.86 to 0.97)
x + 12.27 (6.91 to 17.64)
6.75.5821670.25Critical4D5100high
HbA1c (%)6.5NGSP7% (NCCL)y = 1.04 (1.00 to 1.08)
x – 0.37 (- 0.41 to - 0.33)
- 2.11.731106**2.85Serious3M345middle
CDL - critical decision levels. TEa - total allowable error. CV – coefficient of variation. RAA - risk analysis and assessment. RPN - risk priority number . SVP - Sigma verification program. CLIA - Clinical Laboratory Improvement Amendments. S – screening. M - patient management decisions. RD - Ricos desirable. CC - clinical consultation. NGSP - National Glycohaemoglobin Standardization Program. CAP - College of American Pathologists. PT - proficiency testing. NCCL - National Centre of Clinical Laboratories of China External Quality Assurance. D – diagnosis. SD – standard deviation. ALT - alanine aminotransferase. AST - aspartate aminotransferase. ALP - alkaline phosphatase. GGT - gamma-glutamyltransferase. TP - total protein. ALB – albumin. BT – bilirubin, total. BD – bilirubin, direct. CREA – creatinine. UA - uric acid. Glc – glucose. CK - creatinine kinase. LD - lactate dehydrogenase. AMY – amylase. TG – triglycerides. CHOL - cholesterol. HDL – high density lipoprotein. LDL – low density lipoprotein. K – potassium. Na – sodium. Cl – chloride. Ca – calcium. Mg – magnesium. Phos – inorganic phosphate. Fe – iron. TRSF - transferrin. IgG – immunoglobulin G. IgM – immunoglobulin M. IgA – immunoglobulin A. PA - pre-albumin. Cys-C - cystatin C. BMG - ß2-microglobulin. C3 – complement C3. C4 – complement C4. CRP - C-reactive protein. cTn-I – cardiac troponin I. cTn-T – cardiac troponin T. pH – acidity. pCO2 - partial pressure of carbon dioxide. pO2 - partial pressure of oxygen. HbA1c – glycated haemoglobin. CV% column: the superscript 1,2,3 indicate the CV% determined from the IQC level 1, level 2 or level 3, respectively. N column: *indicate the imprecision calculated from 10 months (March - December 2016), indicate the imprecision calculated from 9 months (April - December 2016), indicate the imprecision calculated from 9 months (January - September 2016), §indicate the imprecision calculated from 7 months (June - December 2016), indicate the imprecision calculated from 11 months (February - December 2016), indicate the imprecision calculated from 6 months (April - September 2016), **indicate the imprecision calculated from 3 months (April - June 2016).

Risk assessment based on Sigma metrics and intended use

The severity of harm due to exceeding TEa was investigated via a questionnaire survey through the Internet (www.wenjuan.com). Construction of questionnaire survey referred the manuscript of “Guidelines for constructing a survey” (13). In the questionnaire, total 42 questions were designed for 42 analytes, and the severity of harm was defined at the level of medical critical decision. For example, “ALT (test name) results deviate from the true results of more than 20% (TEa) at the level of 95U/L (critical decision level), how do you think the impact on clinical diagnosis and treatment? Neglected, minor, serious, critical, catastrophic”. The questionnaire was published in three WeChat work groups in where are 44 doctors in different clinical departments of Peking University Shenzhen hospital, 22 laboratory technicians in Peking University Shenzhen hospital and 23 clinical biochemistry laboratory supervisors of different hospitals in Shenzhen. The doctors answer only the questions within the scope of their practice and the specialists in laboratory medicine answer all the questions. The proportion of the severity of harm classification was statistically summarized and submitted to the FMEA team for discussion. To draw laboratory’s attention to the risk, the test without consensus received a higher level of risk assessment. Intended use of tests referred to the expert advisor, application guide, or reagent manual and categorized using diagnostic, screening, and patient management decisions.

A modified FMEA was applied to produce an analytic risk rating based on three novel factors, each test of which was graded as follows: 1) Sigma metrics; 2) the severity of harm; 3) intended use (diagnosis, screening, patient management decision). Three novel factors were in accordance with the 5 point system, as shown in Table 2. By multiplying the score of Sigma metrics by the score of severity of harm by the score of intended use, each was assigned a typical RPN. When a test had a different intended use in different clinical applications, it was classified according to the use with the highest risk score. RPN > 50 was considered high risk, the degree of risk was unacceptable; 25 < RPN ≤ 50 for the medium risk, laboratory personnel needed to pay attention to the test; and RPN ≤ 25 for low risk was here considered acceptable. According to the intended use and the accumulated score of the severity of harm, the sigma performance expectations were calculated.

Table 2 The risk score of three novel factors
Risk scoreSigma metricsSeverityIntended uses
5σ < 3catastrophicdiagnosis
43 ≤ σ < 4criticalscreening
34 ≤ σ < 5seriousmanagement
25 ≤ σ < 6minor-
1σ ≥ 6negligible-

Results

Sigma metrics at the critical decision levels

The 42 clinical chemical analytes were performed on five instruments. The results of the Passing-Bablok regression and 95% confidence intervals (CI) for slope and intercept are listed in Table 1. The tests whose 95% CI for slope do not include 1 were as follows: ALT, AST, ALP, BT, Alb, AMY, TG, HDL, Ca, Mg, C3, CRP, cTn-T, pH, pO2. Most tests also had the 95% confidence interval of the y-axis intercept including zero; except for ALB, BT, HDL-C, Cl, Ca, Mg, Fe, PA, pO2, HbA1c.

The Sigma metrics for the critical decision level-making was calculated and listed in Table 1 and the normalized method decision chart demonstrating the sigma values was showed in Figure 1. There were 21 analytes with world class performance (σ ≥ 6). The analytes with excellent performance (5 ≤ σ < 6) were urea, IgG, IgM, cTn-I, pH; the analytes with good performance (4 ≤ σ < 5) were Glc, CHOL, Cl, Ca, PA; the analytes with marginal performance were Na, IgA, C4, Cys-C, cTn-T, PCO2 and the analytes with poor or unacceptable performance (σ ≤ 3) were Alb, C3, BMG, pO2, HbA1c.

Figure 1 Normalized method decision chart demonstrating the Sigma metrics. ALT - alanine aminotransferase. AST - aspartate aminotransferase. ALP - alkaline phosphatase. GGT - gamma-glutamyltransferase. TP - total protein. ALB – albumin. BT – bilirubin, total. BD – bilirubin, direct. CREA – creatinine. UA - uric acid. Glc – glucose. CK - creatinine kinase. LD - lactate dehydrogenase. AMY – amylase. TG – triglycerides. CHOL - cholesterol. HDL – high density lipoprotein. LDL – low density lipoprotein. K – potassium. Na – sodium. Cl – chloride. Ca – calcium. Mg – magnesium. Phos – inorganic phosphate. Fe – iron. TRSF - transferrin. IgG – immunoglobulin G. IgM – immunoglobulin M. IgA – immunoglobulin A. PA - pre-albumin. Cys-C - cystatin C. BMG - ß2-microglobulin. C3 – complement C3. C4 – complement C4. CRP - C-reactive protein. cTn-I – cardiac troponin I. cTn-T – cardiac troponin T. pH – acidity. pCO2 - partial pressure of carbon dioxide. pO2 - partial pressure of oxygen. HbA1c – glycated haemoglobin.
bm-28-2-020707-f1

Risk analysis and assessment

A total of 52 professional personal participated in the questionnaire survey, which included 32 doctors, 12 laboratory technicians and 8 clinical biochemistry laboratory supervisors. The number of negligible, minor, serious, critical, and catastrophic was 3, 13, 14, 9 and 3, respectively; the number of diagnostic, screening, and patient management decisions tests was 14, 11, and 17, respectively. There were 7 tests including Glc, Na, Ca, BMG, cTn-T, PCO2 and PO2 with high-risk of RPN > 50; 8 medium risk items with 25 < RPN ≤ 50. The 5 tests with σ < 3 were evaluated as high risk or medium risk items. All of these results were shown in Table 1.

Establishing a differential sigma performance expectations

Here, 13 tests had sigma performance expectations ≥ 6; 15 tests had sigma performance expectations ≥ 5; 3 tests had sigma performance expectations ≥ 4; 11 tests had sigma performance expectations ≥ 3. The results were shown in detail in Table 3.

Table 3 Sigma performance expectations based on severity and intended use classification
SeverityIntended useTestSigma performance expectations
CatastrophicDiagnosisK, cTn-T, cTn-Iσ ≥ 6
Screening-σ ≥ 6
Management-σ ≥ 6
CriticalDiagnosisCREA, Glc, AMY, Na, Ca, pH, PCO2, PO2σ ≥ 6
ScreeningBTσ ≥ 6
Management-σ ≥ 5
SeriousDiagnosisUAσ ≥ 6
ScreeningALT, AST, BD, Urea, CK, BMG, Cys-Cσ ≥ 5
ManagementCl, Mg, Phos, C3, C4, HbA1cσ ≥ 5
MinorDiagnosisFe, TRSFσ ≥ 5
ScreeningGGT, ALP, LDσ ≥ 4
ManagementTP, Alb, TG, CHOL, LDL, IgG, IgM, IgAσ ≥ 3
NegligibleDiagnosis-σ ≥ 3
Screening-σ ≥ 3
ManagementHDL, PA, CRPσ ≥ 3
ALT - alanine aminotransferase. AST - aspartate aminotransferase. ALP - alkaline phosphatase. GGT - gamma-glutamyltransferase. TP - total protein. ALB – albumin. BT – bilirubin, total. BD – bilirubin, direct. CREA – creatinine. UA - uric acid. Glc – glucose. CK - creatinine kinase. LD - lactate dehydrogenase. AMY – amylase. TG – triglycerides. CHOL - cholesterol. HDL – high density lipoprotein cholesterol. LDL – low density lipoprotein cholesterol. K – potassium. Na – sodium. Cl – chloride. Ca – calcium. Mg – magnesium. Phos – inorganic phosphate. Fe – iron. TRSF - transferrin. IgG – immunoglobulin G. IgM – immunoglobulin M. IgA – immunoglobulin A. PA - pre-albumin. Cys-C - cystatin C. BMG - ß2-microglobulin. C3 – complement C3. C4 – complement C4. CRP - C-reactive protein. cTn-I – cardiac troponin I. cTn-T – cardiac troponin T. pH – acidity. pCO2 - partial pressure of carbon dioxide. pO2 - partial pressure of oxygen. HbA1c – glycated haemoglobin.

Discussion

When assessing quality on the σ scale, the higher the σ metric, the better the quality. Here, quality was assessed on the σ scale with a benchmark for minimum process performance of 3σ and a goal for world-class quality of 6σ (14). There were 21 tests with σ ≥ 6 and 5 tests with σ ≤ 3 of the 42 tests in this study. When calculating Sigma metrics, the selection of appropriate TEa and analyte concentration is crucial. A study in Belgium showed the Sigma metrics of Alb ranged from 1.3 to 32 varied with analyte concentration and the TEa target (15). It is desirable that TEa is defined by the highest possible hierarchical model, and then, simple point estimates of sigma at medical decision concentrations are sufficient for laboratory applications (16, 17). However, outcome-based approaches for goal setting may not be possible to set for all analytes (18). In this study, the TEa specifications were obtained from the SVP and the EQA criteria from NCCL of China; the CV values and bias were estimated at the critical decision level and the Sigma metrics at that level was calculated.

The integration of RPN of this study is based on three novel factors of Sigma metrics, the severity and intended use. Sigma metrics are directly related to the probability of risk and they can also be indirectly associated with the detection capability of 6 sigma QC rules. Thus, the use of Sigma metrics directly determined the probability of occurrence, simplifying the process of risk assessment. The evaluation of the severity is usually highly subjective and ultimately depends on the team’s experience and competence. So, the summarized data of the survey collected from clinicians and technicians in this study is benefit to making a relatively objective evaluation. Accounting for the intended use of test will also help design a comprehensive risk assessment model. For example, when HbA1c σ = 2.8, HbA1c is mainly used as patient management decisions in China, so RPN score of 45 is moderate risk. However, HbA1c was approved by the American Diabetes Association for use as a diagnostic indicator of diabetes, and the RPN score would therefore be adjusted to 75, which is high risk.

In this study, bias was estimated by the EQA data. However, it is several limited, such as the acceptance criteria and peer group comparison, compared to the primary method using a reference standard material (19). The intended use of the test is mainly based on the expert advisor, application guide, or reagent manual. Some of them may lack clear criteria. These problems and their solutions still need to be explored and further standardized.

At present, clinical laboratories can’t achieve world class quality (σ ≥ 6) for all tests. The results of the risk assessment also showed that tests that posed negligible risk to the patient could be allowed to reach lower Sigma metrics. Identifying the differentiated sigma performance expectations can avoid repeated residual risk evaluation, which is regarded as a time-consuming task (8, 9). If one test can’t achieve the sigma quality performance, it should be adjusted or changed. If intended use lowers the PRN so that the “Sigma performance expectation” isn’t 6 but is only 3 or 4, that still needs to be aligned with the QC procedures implemented. Currently, a test with 3 sigma or below will need more sensitive QC rules, testing multiple QC samples at each QC event, and more frequent QC events to reducing patient risk (5, 20-22).

In conclusion, this study demonstrates that the implications of Sigma metrics can be extended beyond the QC design and method acceptability. A new RPN based on Sigma metrics and intended use have been explored, which can make a more comprehensive and objective assessment of the risk of tests. Such model can also be used to establish the Sigma performance expectations and meet the low risk requirements of patients and clinicians.

Notes

[1] Conflicts of interest None declared.

References

1 

Agarwal R. Measurement of Errors in Clinical Laboratories. Indian J Clin Biochem. 2013;28:227–34. DOI: http://dx.doi.org/10.1007/s12291-013-0314-3 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/24426216

2 

O’Kane M. The reporting, classification and grading of quality failures in the medical laboratory. Clin Chim Acta. 2009;404:28–31. DOI: http://dx.doi.org/10.1016/j.cca.2009.03.023 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/19302996

3 

Clinical and Laboratory Standards Institute (CLSI). Laboratory quality control based on risk management - Approved Guideline. CLSI document EP23-A. Wayne: CLSI, 2011.

4 

International Organization for Standardization (ISO). ISO 15189:2012. Medical laboratories – requirements for quality and competence. Geneva: ISO, 2012.

5 

Clinical and Laboratory Standards Institute (CLSI). Statistical Quality Control for Quantitative Measurement Procedures: Principles and Definitions - Approved Guideline. CLSI document C24. Wayne: CLSI, 2016.

6 

Capunzo M, Cavallo P, Boccia G, Brunetti L, Pizzuti S. A FMEA clinical laboratory case study: how to make problems and improvements measurable. Clin Leadersh Manag Rev. 2004;18:37–41. PubMed: http://www.ncbi.nlm.nih.gov/pubmed/14968752

7 

Liu HC, Liu L, Liu N. Risk evaluation approaches in failure mode and effects analysis: A literature review. Expert Syst Appl. 2013;40:828–38. DOI: http://dx.doi.org/10.1016/j.eswa.2012.08.010

8 

Shebl N, Franklin B, Barber N, Burnett S, Parand A. Failure Mode and Effects Analysis: views of hospital staff in the UK. J Health Serv Res Policy. 2012;17:37–43. DOI: http://dx.doi.org/10.1258/jhsrp.2011.011031 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/21967824

9 

Shebl NA, Franklin BD, Barber N. Failure mode and effects analysis: too little for too much? BMJ Qual Saf. 2012;21:607–11. DOI: http://dx.doi.org/10.1136/bmjqs-2011-000723 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/22447819

10 

Westgard JO. Perspectives on quality control, risk management and analytical quality management. Clin Lab Med. 2013;33:1–14. DOI: http://dx.doi.org/10.1016/j.cll.2012.10.003 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/23331725

11 

Westgard S. Prioritizing risk analysis quality control plans based on Sigma metrics. Clin Lab Med. 2013;33:41–53. DOI: http://dx.doi.org/10.1016/j.cll.2012.11.008 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/23331728

12 

Bilić-Zulle L. Comparison of methods: Passing and Bablok regression. Biochem Med (Zagreb). 2011;21:49–52. DOI: http://dx.doi.org/10.11613/BM.2011.010 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/22141206

13 

Passmore C, Dobbie AE, Parchman M, Tysinger J. Guidelines for constructing a survey. Fam Med. 2002;34:281–6. PubMed: http://www.ncbi.nlm.nih.gov/pubmed/12017142

14 

Westgard JO, Westgard SA. The quality of laboratory testing today. An assessment of sigma metrics for analytic quality using performance data from proficiency testing surveys and the CLLA criteria for acceptable performance. Am J Clin Pathol. 2006;125:343–54. DOI: http://dx.doi.org/10.1309/V50H4FRVVWX12C79 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/16613337

15 

Hens K, Berth M, Armbruster D, Westgard S. Sigma metrics used to assess analytical quality of clinical chemistry assays: importance of the allowable total error (TEa) target. Clin Chem Lab Med. 2014;52:973–80. DOI: http://dx.doi.org/10.1515/cclm-2013-1090 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/24615486

16 

Sandberg S, Fraser CG, Horvath AR, Jansen R, Jones G, Oosterhuis W, et al. Defining analytical performance specifications: consensus statement from the 1st strategic conference of the European federation of clinical chemistry and laboratory medicine. Clin Chem Lab Med. 2015;53:833–5. DOI: http://dx.doi.org/10.1515/cclm-2015-0067 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/25719329

17 

Westgard JO, Westgard SA. Six Sigma Quality Management System and Design of Risk-based Statistical Quality Control. Clin Lab Med. 2017;37:85–96. DOI: http://dx.doi.org/10.1016/j.cll.2016.09.008 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/28153372

18 

Horvath AR, Bossuyt PM, Sandberg S, John AS, Monaghan PJ, Verhagen-Kamerbeek WD, et al. Setting analytical performance specifications based on outcome studies - is it possible? Clin Chem Lab Med. 2015;53:841–8. DOI: http://dx.doi.org/10.1515/cclm-2015-0214 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/25996384

19 

Friedecky B, Kratochiva J, Budina M. Why do different EQA schemes have apparently different limits of acceptability? Clin Chem Lab Med. 2011;49:743–5. DOI: http://dx.doi.org/10.1515/CCLM.2011.105 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/21235390

20 

Westgard JO, Westgard SA. Quality control review: implementing a scientifically based quality control system. Ann Clin Biochem. 2016;53:32–50. DOI: http://dx.doi.org/10.1177/0004563215597248 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/26150675

21 

Westgard JO, Bayat H, Westgard SA. Planning Risk-Based SQC Schedules for Bracketed Operation of Continuous Production Analyzers. Clin Chem. 2018;64:289–96. DOI: http://dx.doi.org/10.1373/clinchem.2017.278291 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/29097516

22 

Parvin CA. Assessing the impact of the frequency of quality control testing on the quality of reported patient results. Clin Chem. 2008;54:2049–54. DOI: http://dx.doi.org/10.1373/clinchem.2008.113639 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/18927244


This display is generated from NISO JATS XML with jats-html.xsl. The XSLT engine is libxslt.

Posjeta: 497 *