Skip to the main content

Original scientific paper

https://doi.org/10.11613/BM.2021.020702

Decision support system through automatic algorithms and electronic request in diagnosis of anaemia for primary care patients

Enrique Rodriguez-Borja orcid id orcid.org/0000-0002-0339-6704
Adela Pozo-Giraldez
Macarena Díaz-Gimenez
Ausias Hervas-Romero
Africa Corchon-Peyrallo
Inmaculada Vinyals-Bellido
Arturo Carratala Calvo


Full text: english pdf 115 Kb

page 250-257

downloads: 329

cite

Download JATS file

Supplements: BM-31-250-s1.pdf


Abstract

An appropriate management of anaemia laboratory tests is crucial for a correct diagnosis and treatment. A non-sequential “shotgun” approach (where every anaemia related test is ordered) causes workload and cost increases and could be potentially harmful. We have implemented a Decision Support System through our laboratory information system (LIMS) based on reflexive algorithms and automatic generation of interpretative reports specifically in diagnosis of anaemia for primary care patients.
When a request contained an “Anaemia Suspicion Study” profile, more than twenty automatic reflexive rules were activated in our LIMS based upon laboratory results. These rules normally involved the addition of reflexive tests. A final report was automatically generated for each interpretation which was always reviewed for their validity by two staff pathologists. We measured the impact of this system in the ordering of most common anaemia related tests and if a proper treatment was established based on the interpretive report.
From all the studies performed, only 12% were positive being “iron deficiency” and “anaemia of chronic disease” the most frequent causes, 62% and 17%, respectively. Proper treatment was established in 88% of these anaemic patients. Total iron, transferrin, ferritin, folate and vitamin B12 demand decreased substantially after implementation representing a cost reduction of 40% only for these five tests.
Our system has easily improved patient outcomes, advising on individual clinical cases. We have also noticeably reduced the number of over-requested tests and laboratory costs.

Keywords

algorithms; anaemia; diagnosis; clinical laboratory information systems; cost – effectiveness; referral and consultation

Hrčak ID:

258880

URI

https://hrcak.srce.hr/258880

Publication date:

15.6.2021.

Visits: 947 *




Introduction

Anaemia is the most common haematological disorder that affects the population in both developing and developed countries. Anaemia adversely affects patient´s quality of life and is a condition associated with higher morbidity and mortality (1). Furthermore, it is a common problem in primary care and generally constitutes an important challenge to health-care systems in terms of diagnosis and management (2).

The proper diagnosis of anaemia is strongly based on laboratory results. In fact, it is considered to be present if the haemoglobin (Hb) concentration is below the lower limit of the 95% reference interval for the individual´s age and sex (3). Several algorithms on the Hb result have been proposed as a guide to better characterize the disorder. In most of them, red cell volume (RCV or MCV) has been traditionally used to classify and define the type of anaemia (microcytic, normocytic and macrocytic). Although other discriminant algorithms have been recently proposed including new red blood cells (RBC) parameters, the anaemia classification system based on MCV proposed almost ninety years ago by Maxwell Wintrobe, remains a useful tool for physicians (4-6).

On balance, an appropriate management of anaemia laboratory tests is crucial for a correct diagnosis and treatment. The cost of these tests may be small in comparison to the costs resulting from delayed diagnosis (additional visit, referrals, etc.) and that might be the main reason why General Practitioners (GPs) often elect to order every possible anaemia related test during the initial visit in primary care environments. Far from being efficient, this non-sequential “shotgun” approach causes workload and cost increases and could be potentially harmful due to diagnostic confusion or forgotten tests (7).

In fact, Salinas et al. recently showed that the demand for and expenditure on anaemia related tests in primary care in Spain is markedly elevated with significant regional differences compared to previous studies performed a couple of years earlier (8). This robust study was conducted analysing data coming from a total of 110 laboratories all over the country, corresponding to a catchment area of nearly 28 million inhabitants (60% of the Spanish population). Their conclusion emphasized the necessity of further studies focused on how laboratories could help GPs in anaemia test management, through computer-aided algorithms (9).

Clinical laboratory consultation has been described as one of the most promising solutions to inappropriate utilization of laboratory services (10). Nowadays, clinical laboratory consultants could be able to fill the gap between raw laboratory data and information easily understandable to the clinicians, adopting a more active role.

In 1999, Smith et al. reported the use of a ‘‘Decision Support System’’ which interacted with providers to assist them in laboratory test selection and result interpretation. Despite the good results in terms of fewer tests being ordered during a diagnostic evaluation, fewer blood samples being collected from the patient and a shortening in the time to diagnosis, there was no data on whether the information reported by this automatic system was correct or not (11). It has been estimated that automatic algorithms for diagnosis or treatment are not 100% effective in terms of test selection and interpretation, so the presence of an expert consultant during this process would be highly recommended.

In 2000, Laposata and his associates, who are considered the pioneers of laboratory consultation services, instituted formal sign out rounds with the combination of reflexive test algorithms and the generation of interpretative reports in assorted areas like coagulation, haemoglobin/anaemia and autoimmune diseases. They advocated for a substantial improvement in the model of laboratory test ordering and interpretation. In this model, laboratory experts regularly supply valuable information regarding test selection and result interpretation to the ordering clinicians. By means of this arrangement, they showed an improvement in the quality of care, a reduction in the cost per case by decreasing the time to diagnosis, the number of tests ordered and the number of patient visit (12).

Two years later, these same authors expressed their concerns regarding computerized “intelligent” laboratory information systems which could guide ordering physicians in terms of requesting advice on the selection and interpretation on laboratory tests. They stated that given that the appropriateness of a particular test could vary tremendously because of the different clinical situations in which this parameter might be ordered, the advice of an “intelligent” software could be extremely difficult to implement (13).

The main aim of our study was to combine both perspectives, implementing a computerized “Decision Support System” through our computer physician order entry (CPOE) and laboratory information system (LIMS), that not only could identify the clinical situation of the patient but also involve an expert laboratory professional in each clinical case for the final review and verification. This system would be based on reflexive algorithms and automatic generation of interpretative reports and would be applied specifically in diagnosis of anaemia for primary care patients.

Additionally, we wanted to measure the impact of this system in the ordering of most common anaemia related tests such as ferritin, transferrin, total iron, folate and vitamin B12 in order to know if it is also a good strategy for test management and cost savings.

And finally, we wanted to determine if the initiative was clinically useful for our GPs in terms of establishing proper treatments in these patients based on the interpretive reports given by the laboratory.

Materials and methods

Subjects

This prospective cohort study for primary care patients was conducted from January 2018 to December 2019 in the Laboratory of Biochemistry and Molecular Pathology of University Clinic Hospital in Valencia (Spain). This hospital is a tertiary referral center that serves around 360,000 people in Valencia´s metropolitan area, the third biggest city in the country by population. All the laboratory requests are ordered via a CPOE system directly linked to our LIMS, Gestlab (Cointec Ingenieros, Inc., Alicante, Spain) since 2011.

Our “Primary Care Anaemia Algorithm Strategy” (Supplementary data) was implemented in July 1st 2018. We collected data over a total 2-year period (January 2018 to December 2019) and divided into two phases for comparison purposes:

Phase PRE: 6-month period before algorithm implementation (from January 2018 to June 2018).

Phase POST: 6-month period after one year of the intervention (from July 2019 to December 2019).

All the data were retrieved from our LIMS and our electronic medical records. Our study was approved by Valencia´s Clinic Hospital Ethics Committee.

Methods

We redesigned our electronic panel formulary for primary care introducing three new clinical profiles or “workups” available for all our GPs that could be selected through a tick-box system. The first profile was called “Anaemia Suspicion Study” and included a complete blood count (CBC) and an order for an extra serum tube venipuncture (in case any serum test was ordered in the request). When this profile was ordered, providers were always asked to answer two simple free-text compulsory questions regarding suspected diagnosis and the patient’s main symptomatology. The second profile was called “Microcytic Anaemia Follow Up” and included a CBC and ferritin test. Finally, the third profile was called “Normo/Macrocytic Anaemia Follow Up” and just included a CBC. A restriction rule through our CPOE made it impossible to order more than one of these profiles in the same request.

Anaemia related tests such as ferritin, transferrin, total iron, folate and vitamin B12 were not included directly in the panel as tick-boxes, but they could be added to the request without any limitation through a search engine function in our CPOE system.

Our “Primary Care Anaemia Algorithm Strategy” was fully agreed between Biochemistry and Haematology Laboratories before its implementation. When a request contained an “Anaemia Suspicion Study” profile, more than twenty automatic reflexive rules were activated in our LIMS based upon laboratory results and reference values. These rules normally involved the addition of reflexive tests. A final report was automatically generated for each interpretation. These reports were always reviewed for their validity by two staff pathologists according to the provided results and the patient’s medical records. These consultors were free to add extra tests and/or introduce specific comments to the automatic report in light of the information obtained and they didn´t represent any additional cost in terms of time and/or input into the process. If anaemia was not detected in the patient (normal haemoglobin levels for age and sex) an automatic result was reported and no more tests added (Report 0): “The patient is not anaemic. Further studies are not necessary”. Previously to its implementation, the Primary Care Anaemia Algorithm Strategy was fully explained to each and every GP in our department via e-mail and face-to-face meetings with the different primary care centers. Several suggestions coming from our GPs were finally adopted (e.g. serum transferrin receptor test, referral to haematologist).

Time of samples collection was always between 8:00–9:30 AM for all the requests of the study. So, thresholds used for total serum iron were those regarding that specific time of collection.

We collected all the number of tests performed for total iron, transferrin, ferritin, folate and vitamin B12, as well as the three profiles mentioned above, for the timeframe of the study. The number of tests that were performed and their change in demand was studied as a ratio of total tests per total primary care requests (in percentage %).

Furthermore, the laboratory cost in euros (€) was calculated according to Valencia´s Autonomic Health Tax Law for each test for the period before pre-intervention (Phase PRE) vs the 6-month period after one year of the intervention (Phase POST). Cost reductions as percentage were calculated comparing both periods of time.

For each “Anaemia Suspicion Study” ordered, the data from the final report from the laboratory were collected. Additionally, if the result was consulted by the GPs in a week (through our results webpage) and if a proper treatment was established according to Laboratory recommendations and Department guidelines, the data were also retrieved.

Statistical analysis

The Kolmogorov-Smirnov test was used to assess the normality of distribution of investigated parameters. All parameters in our study were distributed normally. Data were expressed as mean ± standard deviation. Differences were tested by paired two-tailed t-test. The values P < 0.05 were considered statistically significant. Statistical analysis was done using IBM SPSS Statistics for Windows, Version 26.0. (IBM, Armonk, NY, USA).

Results

We performed 1994 “Anaemia Suspicion” studies, 10,026 “Microcytic Anaemia Follow Up” studies and 745 “Normo/Macrocytic Anaemia Follow Up” studies. From all the “Anaemia Suspicion” studies, 88% were negative and patients were not anaemic (Table 1). The most frequent causes of anaemia were “iron deficiency” and “anaemia of chronic disease”. Altogether 98% of the reports for a confirmed anaemia were consulted by GPs within a week of receiving the result. Proper treatment was established in 88% of these patients.

Table 1 Positive “Anaemia Suspicion Study” results for our Primary Care Algorithm Strategy from July 2018 to December 2019
ResultsAutomatic report on LIMS*Number of casesAnaemia cases consultedAnaemia cases with proper treatment
Iron deficiency1.1, 1.2149147131
CDA: Renal insufficiency4.1222219
CDA: Liver disease4.2433
CDA: Thyroid disease4.3444
CDA: Inflammatory4.41088
Possible posthaemorrhagic anaemia2.1, 2.2, 3.1 & 3.2171713
Refer to haematologist1.4, 2.4 & 3.4141414
Megaloblastic anaemia3.5887
Haemoglobinopathies1.3766
Haemolytic anaemia2.3 & 3.3333
Anaemia of chronic disease with iron deficiency1.5222
Total anaemia cases determinedNA240234210
*Automatic Report on LIMS refers to the comments from algorithm in Supplementary data. CDA - chronic disease anaemia. NA - non applicable. LIMS - laboratory information system.

We found a significantly lower level of test demand in post intervention phase as compared to pre intervention phase for all the tests studied (except the implemented clinical profiles) (Table 2).

Table 2 Tests ratios per total primary care requests in percentage (%) in Phase PRE – intervention (from January 2018 to June 2018) and Phase POST – intervention (from July 2019 to December 2019)
TestPhase PRE (%) (mean ± SD)Phase POST (%) (mean ± SD)P
Total iron26.7 ± 0.712.2 ± 0.6< 0.001
Transferrin9.0 ± 0.15.1 ± 0.4< 0.001
Ferritin26.0 ± 0.319.2 ± 0.8< 0.001
Folate11.3 ± 0.66.6 ± 0.3< 0.001
Vitamin B1213.7 ± 0.78.6 ± 0.5< 0.001
“Anaemia Suspicion Study”NA0.9 ± 0.2NA
“Microcytic Anaemia Follow Up”NA6.5 ± 0.3NA
“Normo/Macrocytic Anaemia Follow Up”NA0.5 ± 0.1NA
Tests ratios are expressed as mean ± standard deviation (SD). Differences were tested by paired two-tailed t-test. NA - not applicable.

Regarding cost reductions after implementing the algorithm, and taking into account all these results, a total reduction of 40% was estimated between pre and post intervention phases. Total iron was the test with the higher cost reduction in percentage while ferritin had the lower cost reduction. This represents a monthly reduction of 33,454 € for these five tests (Table 3).

Table 3 Total test cost in Euros (€) in Phase PRE – intervention (from January 2018 to June 2018) and Phase POST – intervention (from July 2019 to December 2019) and cost reduction in percentage (%)
TestPhase PRE (€)Phase POST (€)Cost reduction (%)
Total iron18,169792157
Transferrin66,98735,05748
Ferritin165,016113,71131
Folate113,71862,68645
Vitamin B12137,14781,39041
Total501,487300,76540

Discussion

We have successfully implemented a complete “Decision Support System” that is able to identify the clinical situation of the patient through our CPOE and LIMS for our primary care providers. For all the “Anaemia Suspicion” studies ordered, our system automatically generates a final report based on the results obtained.

Most of the “Anaemia Suspicion Studies” ordered came back negative and patients were not anaemic despite the initial suspicion of our GPs. As expected from primary care, the most frequent causes of anaemia were “iron deficiency”, “anaemia of chronic disease” and “possible posthaemorrhagic anaemia”. Despite the very low rates of “Anaemia Suspicion Study”, “Microcytic Anaemia Follow Up” and “Normo/Macrocytic Anaemia Follow Up” profiles in our daily primary care requests our results have shown a substantial rate of decrease measured for anaemia related tests (total iron, transferrin, ferritin, folate and vitamin B12).

In particular, the noteworthy decrease and current evidence in the appropriate utilization of total iron and transferrin, show that these tests were over requested in our department. In fact, total iron and transferrin have been considered both redundant in iron deficiency anaemia and their values may overlap between healthy and iron deficient population. Some protocols include adding these tests only if serum ferritin is not diagnostically relevant (when its values are normal or increased) in patients with concomitant chronic inflammation (14). Although we have also observed a decline in its demand, it has not been as significant as total iron or transferrin given that ferritin was also included in the “Microcytic Anaemia Follow Up” clinical profile. This specific profile is finally ordered around six times more than “Anaemia Suspicion Study” profile since there are much more patients with a fully diagnosed microcytic anaemia being followed up with than patients with suspected anaemia.

Regarding folate and vitamin B12, our results suggest they were also inappropriately over requested. Rates of decrease have been higher for folate rather than vitamin B12. This could be explained by the fact that neuropsychiatric symptoms in elderly people is one of the additional indications for vitamin B12 testing in primary care settings prior to neurologist referral (15). Furthermore, folate determination in primary care has been considered of little clinical significance in those patients without known risk factors for folate deficiency (16).

Our “Primary Care Anaemia Algorithm Strategy” has been highly efficient in terms of clinical management of suspected anaemia and it has been clinically useful since a great majority of the reports were consulted within a week of receiving the results enabling a proper treatment establishment. One of the major strengths of our study is that we have been able to improve patient care through our interpretations; to easily influence patient outcome and to notably reduce costs using an “algorithmic – sequential” approach for diagnosing anaemia.

We have noticed that sometimes our algorithm could not offer a direct explanation for some difficult cases, mostly related with anaemia of chronic disease in pluripathological patients. Though few in number, in these cases, the presence of an expert consultant has been really useful to overcome the limitations of the computerized rules (e.g. adding new tests, introducing additional comments). In fact, it is obvious to us that just relying on automatic algorithms could be insufficient and unsatisfactory, and we strongly recommend the participation of a professional in order to ensure the proper functioning of the process.

The interpretation of abnormal test results personally by the laboratory specialist based on the clinical judgment has been recognized as a useful tool to improve the process of patient’s diagnosis and treatment (17). Several studies performed in Netherlands have showed that reflective testing, as a form of consultation, adds value in the service of clinical laboratory to primary health care providers and is generally welcomed by the doctors (18,19). The automated generation of interpretative comments based on results normally implies the application of expert systems. Several approaches have been suggested: from basic algorithms that are sequentially executed (like our study), through Bayesian reasoning (where probability of a diagnosis is calculated given the patient variables) to more complex neural networks (where the larger the amount of data available, the more efficient the outcomes are) (20).

Gunčar et al. recently built two models to predict a haematological disease using machine learning algorithms based on laboratory results (21). Both predictive models produced good results in terms of accuracy being on par with that of haematology specialists, but they were unable to make a complete differential diagnosis of anaemia cases and more importantly they required a full data matrix of test results for each patient in order to make an accurate prediction. As far as we know, these models only work backwards (they don’t perform tests sequentially based on previous results), so from a laboratory point of view, the potential cost savings related to test management remain unclear. Although a promising medical tool, the advice of “intelligent” software in this field is far from being fully developed and the involvement of a laboratory consultant is still necessary to successfully integrate test results and available clinical information.

Our “algorithmic – sequential” approach could be easily adapted with little effort by any clinical laboratory using a LIMS that allows normal reflexive testing. Moving from classical “organ-based” profiles toward “disease-”, “symptom-”, or “question-specific” profiles could be a promising opportunity for laboratories to offer a default test selection for a specific clinical situation that can be supplemented, if necessary, through algorithms (22). Additionally, our expert application fulfils the gap of adding interpretative customized comments and appropriate tests while dealing with the increasing number and complexity of daily requests.

By means of this new procedure we have generally improved patient outcomes, advising on individual clinical cases and potential treatments. We have also noticeably reduced laboratory costs, decreasing the number of over-requested tests and indirectly we have strengthened the position of laboratory professionals through automatic consultation.

Notes

[1] Conflicts of interest Potential conflict of interest

None declared.

References

1 

Pautas E, Siguret V, Kim TM, Chaïbi P, Golmard JL, Gouronnec A, et al. Anaemia in the elderly: usefulness of an easy and comprehensive laboratory screen. Ann Biol Clin (Paris). 2012;70:643–7. https://doi.org/10.1684/abc.2012.0746 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/23207807

2 

Broadway-Duren JB, Klaassen H. Anaemias. Crit Care Nurs Clin North Am. 2013;25:411–26. https://doi.org/10.1016/j.ccell.2013.09.004 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/24267278

3 

Powell DJ, Achebe MO. Anaemia for the Primary Care Physician. Prim Care. 2016;43:527–42. https://doi.org/10.1016/j.pop.2016.07.006 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/27866575

4 

Buttarello M. Laboratory diagnosis of anaemia: are the old and new red cell parameters useful in classification and treatment, how? Int J Lab Hematol. 2016;38 Suppl 1:123–32. https://doi.org/10.1111/ijlh.12500 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/27195903

5 

Wintrobe MM. Anaemia: classification and treatment on the basis of differences in the average volume and hemoglobin content of the red corpuscles. Arch Intern Med (Chic). 1934;54:256–80. https://doi.org/10.1001/archinte.1934.00160140099006

6 

Bessman JD. Gilmer PRjr, Gardner FH. Improved classification of anaemias by MCV and RDW. Am J Clin Pathol. 1983;80:322–6. https://doi.org/10.1093/ajcp/80.3.322 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/6881096

7 

Thibault GE. Clinical problem-solving. Diagnostic strategy--the shotgun versus the arrow. N Engl J Med. 1995;332:321–5. https://doi.org/10.1056/NEJM199502023320509 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/7619113

8 

Salinas M, López-Garrigós M, Flores E, Uris J, Leiva-Salinas C. Pilot Group of Appropriate Utilization of Laboratory Tests (REDCONLAB) working group. Potential over request in anaemia laboratory tests in primary care in Spain. Hematology. 2015;20:368–73. https://doi.org/10.1179/1607845414Y.0000000210 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/25366813

9 

Salinas M, López-Garrigós M, Flores E, Leiva-Salinas C. Pilot Group of the Appropriate Utilization of Laboratory Tests (REDCONLAB) working group. Primary care requests for anaemia chemistry tests in Spain: potential iron, transferrin and folate over-requesting. J Clin Pathol. 2017;70:760–5. https://doi.org/10.1136/jclinpath-2016-204249 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/28213561

10 

Burke MD. Clinical laboratory consultation: appropriateness to laboratory medicine. Clin Chim Acta. 2003;333:125–9. https://doi.org/10.1016/S0009-8981(03)00176-1 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/12849895

11 

Smith BJ, McNeely MDD. The influence of an expert system for test ordering and interpretation on laboratory investigations. Clin Chem. 1999;45:1168–75. https://doi.org/10.1093/clinchem/45.8.1168 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/10430781

12 

Kratz A, Soderberg BL, Szczepiorkowski ZM, Dighe AS, Versalovic J, Laposata M. The generation of narrative interpretations in laboratory medicine: a description of service specific sign out rounds. Am J Clin Pathol. 2001;116 Suppl:S133–40. https://doi.org/10.1309/F9B6-33HK-8B0B-8LNM PubMed: http://www.ncbi.nlm.nih.gov/pubmed/11993699

13 

Kratz A, Laposata M. Enhanced clinical consulting—moving toward the core competencies of laboratory professionals. Clin Chim Acta. 2002;319:117–25. https://doi.org/10.1016/S0009-8981(02)00032-3 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/11955488

14 

Galloway MJ, Smellie WS. Investigating iron status in microcytic anaemia. BMJ. 2006;333:791–3. https://doi.org/10.1136/bmj.38979.358032.BE PubMed: http://www.ncbi.nlm.nih.gov/pubmed/17038737

15 

Moore E, Mander A, Ames D, Carne R, Sanders K, Watters D. Cognitive impairment and vitamin B12: a review. Int Psychogeriatr. 2012;24:541–56. https://doi.org/10.1017/S1041610211002511 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/22221769

16 

Vinker S, Krantman E, Shani M, Nakar S. Low clinical utility of folate determinations in primary care setting. Am J Manag Care. 2013;19:e100–5. PubMed: http://www.ncbi.nlm.nih.gov/pubmed/23534944

17 

Oosterhuis W. Adding clinical utility to the laboratory reports: automation of interpretative comments. Clin Chem Lab Med. 2019;57:365–70. https://doi.org/10.1515/cclm-2018-0623 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/30367781

18 

Verboeket-van de Venne WP, Oosterhuis WP, Keuren JF, Kleinveld HA. Reflective testing in the Netherlands: usefulness to improve the diagnostic and therapeutic process in general practice. Ann Clin Biochem. 2009;46:346–7. https://doi.org/10.1258/acb.2009.009039 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/19454541

19 

Verboeket-van de Venne WP, Aakre KM, Watine J, Oosterhuis WP. Reflective testing: adding value to laboratory testing. Clin Chem Lab Med. 2012;50:1249–52. https://doi.org/10.1515/cclm-2011-0611 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/22850057

20 

Al-Badareen AB, Selamat MH, Samat M, Nazira Y, Akkanat O. A review on clinical decision support systems in healthcare. J Convergence Inf Technol. 2014;9:125–35.

21 

Gunčar G, Kukar M, Notar M, Brvar M, Černelč P, Notar M, et al. An Application of Machine Learning to Haematological Diagnosis. Sci Rep. 2018;8:411. https://doi.org/10.1038/s41598-017-18564-8 PubMed: http://www.ncbi.nlm.nih.gov/pubmed/29323142

22 

Rodriguez-Borja E. Potential of computer physician order entry (CPOE). In: Sonntag O, Plebani M, eds. Laboratory test requesting appropriateness and patient safety. Berlin/Boston:Walter de Gruyter GmbH, 2017:77-100. https://doi.org/ https://doi.org/10.1515/9783110366235-006


This display is generated from NISO JATS XML with jats-html.xsl. The XSLT engine is libxslt.