Introduction
Haematology analyser (HA) Siemens Advia 2021i (Siemens, Erlangen, Germany) is designed for mid- to high-volume testing in routine work and it measures complete blood count (CBC) with 6-part white blood cell (WBC) differential count (1). As HA becoming more technologically advanced and report an extended number of parameters for CBC, it is important to establish all the advantages and limitations of HA by verification.
There are numerous studies that assessed only the precision and/or accuracy as comparability of Siemens Advia 2120i to another type of HA (2-4). But, estimation of other analytical parameters, such as analytical measuring range (AMI) (linearity), carryover, limit of blank (LoB), limit of detection (LoD) and limit of quantitation (LoQ) in already published articles are fairly scarce. All HA are prone to errors to a more or less extent, and assessment of bias in comparability studies does not reflect the true deviation of measured parameters. As best we know, until now, none of the published studies was verified trueness by reference material (Siemens, Erlangen, Germany) which would enable to estimate the true bias and thus calculate the total error for all the measured parameters. Because of that, we decided for different approach than other studies had for estimation accuracy of our HA.
To the best of our knowledge, none of the studies published until now have performed extended verification of the analytical performance of Advia 2021i prior to implementation in routine work. The aim of this study was to verify the analytical performance of precision, estimate bias as a measure of trueness, AMI (linearity), carryover, LoB, LoD, LoQ and total error (TE) for CBC parameters which measures HA Siemens Advia 2021i.
Materials and methods
Study design
This study was performed from April to July 2018 at the Department of Medical Laboratory Diagnostics of University Hospital “Sveti Duh” (Zagreb, Croatia). Verification was performed according to the internally developed protocol, based on Clinical and Laboratory Standards Institute (CLSI) H26-A2, Validation, Verification, and Quality Assurance of Automated Haematology Analysers, CLSI EP17-A Protocols for Determination of Limits of Detection and Limits of Quantification, and International Council for Standardization in Haematology (ICSH) guidelines for the evaluation of blood cell analysers including those used for differential leukocyte and reticulocyte counting (5-7).
Materials
For the verification study, the K2 ethylenediaminetetraacetic acid (EDTA) (Kima, Piove di Sacco, Italy) patients’ leftover samples were used for. The study had the approval of the hospital Ethics Committee. For estimation of precision and bias, three levels of the commercial ADVIA 3 in 1 TESTpoint Haematology Controls (Siemens, Erlangen, Germany) were used: ABN1 control lot TP81015, NORM control lot TP82015, and ABN2 control lot TP83015. These control samples are haematology reference materials for monitoring the precision and trueness of ADVIA 120/2120/2120i Haematology systems.
Methods
The analyser Advia 2021i is haematology analyser based on the flow cytometry. Analyser Advia 2021i uses 5 channels to analyse blood samples: i) haemoglobin channel, ii) erythrocyte/platelets channel, iii) peroxidase channel (to distinguish peroxidase-positive cells from peroxidase-negative cells), iv) lobularity/nuclear density channel and v) reticulocyte channel (8). Within-run precision was estimated by analysing commercial control samples in a series of 20 replicates and on three patients’ blood samples (10 replicates in a series). Between-run precision was estimated by analysing commercial control samples for consecutive 20 days.
Within-, between-run precision and estimation of bias were determined for leukocytes, erythrocytes, haemoglobin, haematocrit, mean corpuscular volume (MCV), platelets and mean platelet volume (MPV).
Analytical measuring range (linearity) was assessed for leukocytes, erythrocytes, haemoglobin, and platelets of patients’ whole blood samples, with concentrations close to the upper analytical measuring range (linearity) limit. The initial values for leukocytes were 90 x109/L, erythrocytes 7.06 x1012/L, haemoglobin 220 g/L, and for platelets 970 x109/L. Based on CLSI H26-A2 guidelines the concept of linearity can only apply to measuring the concentration of haemoglobin, while the term analytical measuring range was used for the measuring number of cells (WBC, RBC, Plt) (5). The AMI was verified by preparing serial dilutions of a known high values of certain parameter. Serial dilutions (1:0, 1:2, 1:4, 1:8 and 1:16) were prepared by using the original HA diluent (Sheat rinse ADVIA 2120i, Siemens). Carryover was estimated for leukocytes, erythrocytes, haemoglobin, and platelets by using one sample with low (sample L) and one with high analyte concentration (sample H). Sample H was analysed in triplicate (H1, H2 and H3), followed by the sample L in triplicate (L1, L2 and L3).
The estimation of carryover for each analyte was performed three times, using 3 different H and L samples. Samples with high values had leukocytes > 55.00 x109/L, erythrocytes > 6.00 x1012/L, haemoglobin > 170 g/L, and platelets > 720 x109/L. On the other hand, samples with low values had leukocytes < 3.00 x109/L, erythrocytes < 1.10 x1012/L, haemoglobin < 20 g/L, and platelets < 25 x109/L. Limit of blank was estimated for leukocytes, erythrocytes, haemoglobin, and platelets by measuring a blank sample (distilled water) in 20 replicates in a series.
Limit of detection was estimated by measuring leukocytes and platelets in six blood samples with very low concentrations of analytes, 10 times in a series. The values of six blood samples for leukocytes were lower than 0.3 x109/L and platelets < 7 x109/L.
Coefficient of variation (CV) was calculated for each sample and for each parameter. For verification of LoQ, six blood samples were analysed with leukocytes values between 0.10-0.17 x109/L and platelets between 2-10 x109/L.
Statistical analysis
Trueness was estimated by calculating the bias between the mean observed value for every parameter from the between-run precision experiment, and the mean declared value from the manufacturer by using the following equation (Eq.) 1 (9):
The observed values for verification AMI (linearity) were considered linear if the coefficient of correlation between measured and calculated values was r > 0.99 with P < 0.001. The coefficient of correlation was determined by using MedCalc Statistical Software version 14.8.1 (MedCalc Software bv, Ostend, Belgium).
Carryover was calculated using the following equation (Eq. 2.) (7):
The results were compared with predefined acceptance criteria (criteria from manufacturer and State-of-the-art criteria (SOTA) (10). Equation 3. was used for calculating LoB (6):
For calculating LoD, equation 4 was used (6):
For each sample out of six which was used for verification LoQ, the CV% was determined. The concentration at which CV% was lower than the desired imprecision (15% for leukocytes and 25% for platelets) represented LoQ.
The TE was calculated only for CBC. The TE was calculated according to Eq. 5. (11):
For statistical analysis of obtained data, the Microsoft Office Excel 2010 (Microsoft, Washington, USA) was used. Acceptance criteria for precision, trueness and total error were defined from SOTA 2016 criteria, European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) 2019 Biological Variation Database, and manufacturer technical specifications (10,12,13). Moreover, SOTA performance specifications for haematology parameters was published 2016 by Vis and Huisman (10).
Results
Within-run precision for low concentration of platelets exceeded the SOTA acceptance criterion (4.5%), both in patients’ (7.6%) and control samples (4.8%). The precision of MPV in low concentration control sample was higher that the acceptance criteria both in within-run and between-run precision experiments (4.6 and 4.7% respectively) but was within acceptance criteria in normal and high concentration control samples. Also, within-run precision (1.1%) for low concentrations of Hb (53 g/L) in control samples slightly exceeded from acceptance criteria of the manufacturer and SOTA (0.9%). Other CBC parameters did meet SOTA acceptance criteria, both at normal and high concentration levels, in patients’, as well as in control samples (Table 1).
The estimated bias exceeded even the SOTA acceptance criteria (2.0%) only for MCV at high concentration control sample (2.2%) (Table 2). The estimated percentage bias was within the acceptance criteria for all other CBC parameters.
There was a linear relationship over the defined analytical range for RBC, WBC, Hb and Plt, with no significant constant and proportional difference. All four parameters showed excellent linearity with a coefficient of correlation 1.00 (95%CI 0.99 to 1.00), P < 0.001 (Supplementary Table 1).
No significant carryover effect was observed for RBC, Hb, WBC and Plt. Estimated carryover was within the manufacturer’s criteria, listed in the Supplementary Table 2. Furthermore, the observed results for leukocytes and haemoglobin for carryover were higher than the SOTA criteria.
Manufacturer’s LoB for leukocytes (< 0.1 x109/L) and for platelets (< 5 x109/L) was verified. The manufacturer did not declare acceptance criteria for erythrocytes and haemoglobin. Furthermore, the obtained results for LoB did meet the SOTA criteria for erythrocytes (< 0.01 x1012/L) and haemoglobin (< 0.7 g/L) (data for verification LoB are not shown). LoB Estimated LoD for leukocytes and platelets were 0.05 x109/L and 2 x109/L, respectively. LoQ for leukocytes was estimated at 0.10 x109/L. Estimated LoQ for platelets was 3, even lower than the lower AMI (linearity) limit (Supplementary Table 3.)
The calculated TE for MCV exceeded the acceptance criteria. All other parameters were within the allowable TE (Table 3).
Discussion
The within- and between-run precision, estimated bias and total error results meet the criteria for all parameters across concentration ranges except for Plt and MCV in low concentrations. The AMI (linearity) was verified, and no significant carryover was observed for RBC, Hb, WBC and Plt.
As previously mentioned, within-run precision for Plt at low concentration did not meet criteria but all laboratory findings with Plt count below 100 x109/L, in our Department are revised microscopically and there is no potential harm for patient due to enlarged within-run CV% for Plt. The SOTA criterion has stricter criteria because carryover of e.g., 2% can have a significant impact on results. The largest obtained carryover in this study was for leukocytes and it was 0.8%. For example, if the samples with a higher leukocyte count of 72 x109/L and with a lower count 3 x109/L would be analysed one after the other, and the carryover was 0.8%, the second sample would have falsely increased result of 4 x109/L, which is not clinically significant.
Moreover, obtained results for TE are within desirable the European Biological Variation Study (EuBIVAS) acceptance criteria for all parameters except MCV. The importance of calculating TE is because it describes the precision and estimated bias of certain parameter measurement that can occur. The measurement for certain parameter which do not meet the criteria should be controlled more often and with more consideration of its performance.
Harris et al. results agree with ours for within-run precision at certain concentrations which are similar to our normal (N) values for control and patients’ samples (Table 1) (1). Also, Harris et al. in the other published article only describes technical aspects of Siemens Advia 2021 and states manufacturer claims for analytical measuring range (linearity) of WBC, RBC, Hb and Plt (8). In our study we verified this manufacturer’s claims for these parameters and estimated the limit of detection and quantitation for WBC and Plt.
All other studies (2-4) performed verification of accuracy as comparison and their results showed that the Siemens Advia 2021/2021i was comparable with all other types of HA. In our study, we performed an estimation of bias with reference material and the obtained results implicate that HA Siemens Advia 2021i showed acceptable analytical performance.
As for the limitations of this study, we did not perform validation of morphology flags and calculation of TE for differential blood count nor compare parameters from leukocyte differential count for Advia 2021i with manual differentiation of leukocytes and estimate the diagnostic accuracy of the Advia 2021i with other types of HA. Also, our study has estimated analytical measuring range (linearity), carryover, LoB, LoD and LoQ only for open tube mode because of the limited volume of the samples. The ICSH guidelines for the evaluation of the blood cell analyser advise to assess those analytical performances for both, open and closed tube mode (7).
In conclusion, to the best of our knowledge, this study was the first that performed additional analytical performances (linearity, carryover, LoB, LoD, and LoQ) except precision and trueness which were already obtained in other published studies. The HA Siemens Advia 2021i showed reliable analytical performance for standard CBC parameters and it is suitable for routine use in a clinical laboratory.