Acessibilidade / Reportar erro

Evaluation of criteria of manual blood smear review following automated complete blood counts in a large university hospital

Abstract

Background:

There is great interest in reducing the number of automated complete blood counts requiring manual blood smear reviews without sacrificing the quality of patient care. This study was aimed at evaluating and establishing appropriate screening criteria for manual blood smear reviews to improve the performance in a hematology laboratory.

Method:

A total of 1977 consecutive samples from the daily workload were used to evaluate four sets of screening criteria for manual blood smear reviews to identify samples with positive smear findings. Three sets of screening criteria were arbitrarily proposed in this study: Group 1 (narrow ranges), Group 2 (intermediate ranges), and Group 3 (wide limits) and one set (Group 4) was adapted from the International Society for Laboratory Hematology. All samples were run on Sysmex hematology analyzers and were investigated using manual blood smear reviews. Diagnostic accuracy and agreement were performed for each set of screening criteria, including an investigation of microscopic review rate and efficiency.

Results:

The microscopic review rates for Groups 1, 2, 3 and 4 were 73.85%, 54.52%, 46.33% and 46.38%, respectively; the false-negative rates were 0.50%, 1.97%, 2.73% and 3.95%, respectively. The efficiency and negative predictive values of Group 3 were 73.04% and 4.91%, respectively.

Conclusions:

Group 3 had the best relationship between safety (false-negative rate: ≤3%) and efficiency to estimate the limits of automation in performing complete blood counts. This study strengthens the importance of establishing screening criteria for manual blood smear reviews, which account for the different contexts in which hematological determinations are performed. Each laboratory should optimize the screening criteria for manual blood smear reviews in order to maximize their efficiency and safety.

Keywords:
Manual blood smear review; Complete blood counts; Criteria for manual blood smear review; Positive smear findings

Introduction

A manual blood smear review (MBSR) is defined as the thorough and careful microscopic analysis of a well-prepared and stained smear of peripheral blood, with the objective of seeking morphological changes relevant to the diagnosis and monitoring of patients. It is also considered a tool of internal quality control for the evaluation of parameters provided by hematology analyzers. The process of MBSR is among the most time-consuming in hematology laboratories, and requires high technical competence to minimize errors inherent to the subjectivity of MBSR, including manual differential leukocyte counts (MDLC).11 Gulati GL, Alomari M, Kocher W, Schwarting R. Criteria for blood smear review. Lab Med. 2002;33(5):374-7.

2 Pierre RV. Peripheral blood film review: the demise of the eyecount leukocyte differential. Clin Lab Med. 2002;22(1):279-97.

3 Pierre RV. Red cell morphology and the peripheral blood film. Clin Lab Med. 2002;22(1):25-61.

4 Bain BJ. Diagnosis from the blood smear. N Engl J Med. 2005;353(5):498-507.

5 Gulati GL, Song J, Florea AD, Gong J. Purpose and criteria for blood smear scan, blood smear examination, and blood smear review. Ann Lab Med. 2013;33(1):1-7.
-66 Bain BJ. Blood cells: a practical guide. 5th ed. Oxford: Wiley-Blackwell; 2015, 491 p.

Over the last few years, the performance and abilities of automatic hematology analyzers have improved considerably. Although they still cannot identify all morphological abnormalities that may occur in peripheral blood, they can reliably decrease the MBSR without sacrificing quality.77 Ward PC. The CBC at the turn of the millennium: an overview. Clin Chem. 2000;46(8p2):1215-20.

8 Houwen B. The differential cell count. Lab Hematol. 2001;7(2):89-100.

9 Ruzicka K, Veitl M, Thalhammer-Scherrer R, Schwarzinger I. The new hematology analyzer Sysmex XE-2100: performance evaluation of a novel white blood cell differential technology. Arch Pathol Lab Med. 2001;125(3):391-6.

10 Stamminger G, Auch D, Diem H, Sinha P. Performance of the XE-2100 leucocyte differential. Clin Lab Haematol. 2002;24(5):271-80.

11 Hur M, Cho JH, Kim H, Hong MH, Moon HW, Yun YM, et al. Optimization of laboratory workflow in clinical hematology laboratory with reduced manual slide review: comparison between Sysmex XE-2100 and ABX Pentra DX120. Int J Lab Hematol. 2011;33(4):434-40.
-1212 Briggs C, Longair I, Kumar P, Singh D, Machin SJ. Performance evaluation of the Sysmex haematology XN modular system. J Clin Pathol. 2012;65(11):1024-30. The establishment of screening criteria (SC) for MBSR is critical and is based on the determination of screening limits for the major hematological parameters and occurrence of suspect flags. The morphological changes and cell percentages relevant for the diagnosis and monitoring of patients are defined as positive smear findings (PSF). The SC are formulated such that MBSR occurs only when needed for confirming the parameter values, or to provide relevant clinical information represented by the PSF in addition to that generated by hematology analyzers.1313 Corberand JX, Laharrague PF, Fillola GM. Validation criteria of the Sysmex NE-8000™ results. Personal experience in the computerized haematology laboratory of a French teaching hospital. Sysmex J Int. 1992;2(2):103-10.

14 Chapman M. Hematology analyzers offer new technology and user-friendliness. Lab Med. 2000;31(3):146-50.

15 Lantis KL, Harris RJ, Davis G, Renner N, Finn WG. Elimination of instrument-driven reflex manual differential leukocyte counts. Optimization of manual blood smear review criteria in a high-volume automated hematology laboratory. Am J Clin Pathol. 2003;119(5):656-62.

16 Barnes PW, McFadden SL, Machin SJ, Simson E. The international consensus group for hematology review: suggested criteria for action following automated CBC and WBC differential analysis. Lab Hematol. 2005;11(2):83-90.

17 Pratumvinit B, Wongkrajang P, Reesukumal K, Klinbua C, Niamjoy P. Validation and optimization of criteria for manual smear review following automated blood cell analysis in a large university hospital. Arch Pathol Lab Med. 2013;137(3):408-14.
-1818 Comar SR, Malvezzi M, Pasquini R. Establishment and evaluation of review criteria of automated complete blood counts applying receiver operating characteristics (ROC) curve analysis. Int J Lab Hematol. 2013;35(s1):44-5.

The main factors influencing the establishment of SC for MBSR can vary between institutions and include features such as, the type of population served, type of hematology analyzer employed, training and experience of the medical team, volume of work, number of professionals in the laboratory, medical specialties involved, complexity of the services offered, financial considerations, and regulatory policies of institutions.11 Gulati GL, Alomari M, Kocher W, Schwarting R. Criteria for blood smear review. Lab Med. 2002;33(5):374-7.,44 Bain BJ. Diagnosis from the blood smear. N Engl J Med. 2005;353(5):498-507.,1919 Peterson P, Blomberg DJ, Rabinovitch A, Cornbleet PJ, Agosti SJ, Aronson M, et al. Physician review of the peripheral blood smear: when and why. An opinion. Lab Hematol. 2001;7(4):175-9. Although many SC for MBSR have been proposed, they are not completely applicable to all laboratories. Our previous work demonstrated that SC for MBSR adapted from the International Society for Laboratory Hematology (ISLH)1616 Barnes PW, McFadden SL, Machin SJ, Simson E. The international consensus group for hematology review: suggested criteria for action following automated CBC and WBC differential analysis. Lab Hematol. 2005;11(2):83-90. were not adequate or safe for use in the Clinical hematology laboratory of Hospital de Clínicas at the Federal University of Paraná (HC-UFPR).2020 Comar SR, Malvezzi M, Pasquini R. Are the review criteria for automated complete blood counts of the International Society of Laboratory Hematology suitable for all hematology laboratories?. Rev Bras Hematol Hemoter. 2014;36(3):219-25. Thus, as an improvement in searching for the ideal SC for MBSR with broader application in hematology laboratories, the objective of this study was to propose and evaluate new SC for MBSR, which serve as a model for adjustments and consider peculiarities in the profile of the populations served, maintaining safety and efficacy.

Methods

Study site

The investigation was conducted in the hematology laboratory of HC-UFPR, a general Class IV hospital and the largest provider of government healthcare services in the State of Paraná, southern Brazil, with 627 beds (574 in operation). Moderately to highly complex procedures are carried out in 59 departments including a hematologic malignancy unit, bone marrow transplant unit, emergency department and intensive care units. Approximately 30,000 outpatients are seen each month.

Samples, patients and hematology analyzers

The study design was approved by the local Ethics Review Board recognized by the National Research Ethics Committee (CONEP). Whole blood samples were collected in ethylenediaminetetraacetic acid (EDTA)-K2 (1.8 mg/mL) and results were obtained from the laboratory routinely, on seven consecutive days in the months of November and December (spring in the southern hemisphere) after their release into the hospital information system. Altogether 1977 (1100 females and 867 males) consecutive samples meeting the local specimen acceptance criteria were obtained from 1615 patients (946 females and 669 males), with an average age of 39.7 ± 22.7 years (range: 1 day to 96 years). Within these samples, 1320 (66.76%) were outpatients and 657 (33.24%) were being admitted or were hospitalized. Four hundred and ten samples were from the hematology unit, 232 from the emergency department, 154 from the intensive care unit (ICU), 94 from the adult ICU, 45 from the neurology unit, 37 from the bone marrow transplant unit, 27 from the pediatric and neonatal ICU, 27 from the infectious diseases unit, 21 from the liver transplantation unit, and two from the renal transplantation unit, among others. Three hundred and twenty-nine samples were from children aged ≤12 years and 36 were newborn babies. Furthermore, 1573 samples were analyzed in a Sysmex XE-2100D and 404 in a Sysmex XT-2000i hematology analyzer (both from Sysmex Corporation, Kobe, Japan), within 3 h after collection. The results of all 1977 samples provided by the hematology analyzers and MBSR were recorded in a spreadsheet. Of the 1615 patients, 1412 performed a single complete blood count (CBC) during the sample collection period while 203 underwent more than one CBC (117 patients underwent two, 30 patients underwent three; 40 patients underwent four; 15 patients underwent five and one patient underwent six). Both internal and external quality control procedures were followed to monitor performance of the hematology analyzers as well as reliability of the results. The adjustments and settings on the analyzers were performed by the manufacturer's scientific and technical support staff.

Manual blood smear review

For each sample, a blood smear was prepared and stained using the Sysmex SP-1000i automatic slide maker-stainer (Sysmex Corporation, Kobe, Japan). Samples that contained a low volume of whole blood were prepared manually by the wedge-spread film technique, using the May-Grünwald & Giemsa stains. MBSR and MDLC were performed in all samples in accordance with the recommendations of Barnes et al.1616 Barnes PW, McFadden SL, Machin SJ, Simson E. The international consensus group for hematology review: suggested criteria for action following automated CBC and WBC differential analysis. Lab Hematol. 2005;11(2):83-90. regarding the step by step validation of criteria for MBSRs. In most cases, 100 leukocytes were counted in each smear by one of six independent observers with extensive experience (10-30 years) in MBSR. A count of 100 or 200 cells per sample on a single slide for only one of each observer was considered a suitable reference method to compare the findings.1616 Barnes PW, McFadden SL, Machin SJ, Simson E. The international consensus group for hematology review: suggested criteria for action following automated CBC and WBC differential analysis. Lab Hematol. 2005;11(2):83-90.,2121 Comar SR, Malvezzi M, Pasquini R. To follow or not to follow the recommendations regarding microscopic analysis of the Clinical and Laboratory Standards Institute H20-A2 to validate the criteria for blood smear review?. Rev Bras Hematol Hemoter. 2015;37(1):69-70. All observers followed the same guidelines on classification and grading the morphological changes as well as description of specific cell types observed by microscopy such as, atypical lymphocytes, band neutrophils and immature granulocytes.2222 Silva PH, Alves HB, Comar SR, Henneberg R, Merlin JC, Stinghen ST. Análise morfológica do sangue periférico e sua correlação com o hemograma. In: Silva PH, Alves HB, Comar SR, Henneberg R, Merlin JC, Stinghen ST, editors. Hematologia laboratorial: teoria e procedimentos. Porto Alegre: Artmed; 2015. p. 51–65.

Study design

First, new PSF were locally designed and established (Table 1) to meet the consensus of the hematology laboratory at HC-UFPR in terms of morphological changes relevant to the diagnosis and follow-up of patients. Consequently, to identify samples with these PSF, four sets of SC as shown in Table 2 were evaluated: Group 1 (narrow cut-off limits), Group 2 (intermediary cut-off limits), Group 3 (wide cut-off limits) and cut-off limits adapted from the ISLH (Group 4). In the first three sets of SC established in this study, the selection of limits for each hematological parameter was performed arbitrarily and empirically. The SC adapted from the ISLH by Comar et al.2020 Comar SR, Malvezzi M, Pasquini R. Are the review criteria for automated complete blood counts of the International Society of Laboratory Hematology suitable for all hematology laboratories?. Rev Bras Hematol Hemoter. 2014;36(3):219-25. were also evaluated in order to assess their performance in identifying samples with new PSF. The performance indicators for the sets of SC were: (i) rate of microscopic reviews lower than 50%. This was based on the study by Novis et al.2323 Novis DA, Walsh M, Wilkinson D, Loris MS, Ben-Ezra J. Laboratory productivity and the rate of manual peripheral blood smear review. Arch Pathol Lab Med. 2006;130(5):596-601. on local limitations of the hospital laboratory information system with respect to the implementation of delta check rules that recognize discrepancies among the results of the current analysis and previous results of a pre-established period of time, also the amount of work and the number of professionals available to perform the smear reviews; (ii) although Barnes et al.1616 Barnes PW, McFadden SL, Machin SJ, Simson E. The international consensus group for hematology review: suggested criteria for action following automated CBC and WBC differential analysis. Lab Hematol. 2005;11(2):83-90. recommend <5% false negative results as the safety threshold for patients, a rate of ≤3% was defined, as recommended by Cui et al.2424 Cui W, Wu W, Wang X, Wang G, Hao Y, Chen Y, et al. Development of the personalized criteria for microscopic review following four different series of hematology analyzer in a Chinese large scale hospital. Chin Med J. 2010;123(22):3231-7. This study was not performed blinded, as the observers had access to the values of blood parameters and description of suspect flags in the equipment reports. Nevertheless, the observers had no prior knowledge of the cut-off limits in each set of SC and the new PSF proposed in this study.

Table 1
Positive smear findings in microscopic analysis.
Table 2
Sets of screening criteria.

Sample classification

The samples were classified by applying the rules of each set of SC and comparing them with the findings of the peripheral blood smear review. A sample was classified as true positive (TP) if it was selected to review by certain SC (Table 2) and the microscopic analysis produced some PSF (Table 1). A sample was classified as false positive (FP) if it was selected to review by SC with no PSF in microscopy. A sample was classified as false negative (FN) if it was not selected to review by any SC and contained some PSF by microscopic analysis. Finally, a sample was classified as true negative (TN) if it was not selected to review by any SC and the MBSR did not show any PSF.99 Ruzicka K, Veitl M, Thalhammer-Scherrer R, Schwarzinger I. The new hematology analyzer Sysmex XE-2100: performance evaluation of a novel white blood cell differential technology. Arch Pathol Lab Med. 2001;125(3):391-6.,1616 Barnes PW, McFadden SL, Machin SJ, Simson E. The international consensus group for hematology review: suggested criteria for action following automated CBC and WBC differential analysis. Lab Hematol. 2005;11(2):83-90.

Measures of diagnostic accuracy and agreement

Sensitivity, specificity, negative predictive value, positive predictive value, efficiency and confidence intervals for each set of SC were obtained with the Cálculos Estatísticos software for Windows v.1.8.2525 Braile DM, Godoy MF. Programa cálculos estatísticos for Windows V.1.8; 1999. These were calculated using the following equations:

Sensitivity % = TP TP + FN × 1 0 0 ; Specificity % = TN TN + FP × 1 0 0 ; Negative predictive value % = TN TN + FN × 1 0 0 ; Positive predictive value % = TP TP + FP × 1 0 0 ; Efficiency % = TP + TN TP + FP + FN + TN × 1 0 0 .

Efficiency was defined as the capability of a set of SC to discriminate correctly the samples i.e., the true-positive results and true-negative results. The rate of microscopic reviews was computed as (%) = ([TP + FP]/[TP + FP + FN + TN]). Comparisons of receiver operating characteristic (ROC) curves were carried out to verify variations in the sensitivity and false positive fraction (1 − specificity) of different sets of SC using overall cut-off values. The Youden index (J) was calculated using the formula: Y = sensitivity + (specificity − 1). The Youden's J statistic, a function of both sensitivity and specificity, has values ranging from −1 to 1, and has a zero value when a diagnostic test gives the same proportion of positive results for groups with and without the disease, i.e. the test is useless. A value of 1 indicates that there are no false-positive results or false-negative results, i.e. the test is perfect. The index gives equal weight to false positive and false negative values, so all tests with the same value of the index have the same proportion of total misclassified results.2626 Youden WJ. Index for rating diagnostic tests. Cancer. 1950;3(1):32-5.,2727 Clinical and Laboratory Standards Institute (CLSI). Assessment of the diagnostic accuracy of laboratory tests using receiver operating characteristic curves: approved guideline. 2nd ed. Wayne, PA: CLSI Document EP24-A2; 2011.

Statistical analysis

All statistical analyses were performed using the Statistica 8.0 (StatSoft Inc., Tulsa, OK, USA) and MEDCALC® version 7.3.0.1 (MedCalc Software, Mariakerke, Belgium) computer programs. The chi-square test (χ 2) was performed to verify differences in each measure of diagnostic accuracy and agreement evaluated among all sets of SC. Additionally, Fisher's exact test, performed using 2 × 2 tables, was used to compare the sensitivity, specificity, efficiency, rate of microscopic reviews as well as the rates of false-negative results, false-positive results, true-negative results and true-positive results among pairs of sets of SC. A p-value of ≤0.05 was considered statistically significant.

Results

The analyzed samples displayed high amplitudes in the intervals of all hematologic parameters used as quantitative SC, reflecting heterogeneity of the sample at the hematology laboratory of HC-UFPR. Of the 1977 samples analyzed, 2.5% had hemoglobin levels between 2.5 g/dL and 7.1 g/dL and another 2.5% had hemoglobin levels between 16.3 g/dL and 20.0 g/dL. Regarding leukocyte counts, 2.5% of samples had counts of 0.01 × 103/µL to 1.44 × 103/µL and another 2.5% had counts between 22.4 × 103/µL and 107.8 × 103/µL. For the platelet counts, 2.5% of all samples had values between 1 × 103/µL and 22.0 × 103/µL and another 2.5% had counts of 608 × 103/µL to 2110 × 103/µL.

A total of 491 samples (24.84%) were considered positive for the PSF (Table 1) and 1486 (75.16%) were considered negative. Among the positive samples, morphological alterations were observed in 195 (39.71%) in the red blood cell series, 217 (44.19%) in the white blood cell series, seven (1.42%) in platelets, four (0.81%) in red blood cell series and platelets, 64 (13.03%) in the red and white blood cell series, two (0.41%) in white blood cell series and platelets and two (0.41%) had changes in all the three series. The automated count of reticulocytes was performed in 191 samples (only upon medical request).

The three most common, abnormal red blood cell series findings were anisocytosis ≥2+ (123 occurrences), the sum of changes [(anisocytosis ≥1+) + (poikilocytosis ≥1+) + (erythrocyte form ≥1+) + (change of color ≥1+)] (102 occurrences) and dacryocytes ≥1+ (66 occurrences). For the white blood cell series, the three most common findings were band neutrophils ≥15% (188 occurrences), myelocytes ≥1% (115 occurrences), and Döhle bodies (74 occurrences). It is noteworthy that blasts were found in 16 samples. Platelet aggregates (ten occurrences) were more frequent than giant platelets (four occurrences).

The quantitative SC which showed the highest rates of indication for MBSR in Groups 1, 2, 3 and 4 were lymphocytes <20% or >50% (38.89%), neutrophils <35% or >80% (19.92%), leukocytes <3.2 × 103/µL or >20.0 × 103/µL (11.68%) and leukocytes <4.0 × 103/µL or >30.0 × 103/µL (13.7%), respectively.

In Group 3, lower limits of screening for leukocytes (<3.2 × 103/µL) and platelets (<90.0 × 103/µL) were used. Unlike the SC of Group 4, the relative counts of leukocytes and the red blood cell distribution width standard deviation (RDW-SD) were used as SC in Groups 1-3. The cut-off points for platelets ranged from >600 × 103/µL (Group 1) to >1000 × 103/µL (Group 3 and Group 4). The evaluation results of SC among the four sets using the new PSF of HC-UFPR are shown in Table 3.

Table 3
Truth table of the sets of screening criteria.

First, the chi-square test was performed to verify differences in each measure of diagnostic accuracy and agreement evaluated among all the sets of SC, and all performance characteristics showed p-value ≤ 0.001. Consequently, the Fisher's exact test was performed in 2 × 2 tables to compare all the performance characteristics among the different sets of SC. The results of the comparison between the two hematology analyzers employed in this work were similar and for this reason, they are not shown separately. The efficiencies of SC of Groups 3 and 4 were 73.04% and 70.56%, respectively, with no significant differences between them (p-value = 0.09); however, they were statistically more efficient than the SC of Groups 1 and 2 (p-value < 0.001). The rates of false-negative results of Groups 3 and 4 were 2.73% and 3.95%, respectively (p-value = 0.0414), with the latter exceeding the safety limit of 3% of false-negative results established in this study. The rate of reviews in Group 3 (46.33%) was the lowest among the four sets of SC, including Group 4 (46.38%), although these two values are not statistically significant. Group 1 showed a sensitivity of 97.96% and the highest negative predictive value (98.06%) both of which were statistically higher than the values observed in the other sets of SC (p-value < 0.001). Group 3 presented the highest specificity (67.77%), classifying the true-negative samples more accurately. It also showed the highest positive predictive value (46.99%) by classifying the true-positive samples more accurately.

In Groups 1, 2, 3 and 4, the rates of false-negative results in inpatient samples (0.30%, 1.97%, 3.19% and 5.63%, respectively) were not different to the rates of false-negative results in all samples (0.50% - p-value = 0.7413; 1.97% - p-value = 1.0000; 2.73% - p-value = 0.5885 and 3.95% - p-value = 0.1011, respectively). Likewise, the rates of false-negative results in outpatient samples (0.60%; 1.96%; 2.50% and 3.18%, respectively) were not different from the rates of false-negative results in all samples (0.50% - p-value = 0.8104; 1.97% - p-value = 1.0000; 2.73% - p-value = 0.7402 and 3.95% - p-value = 0.2575, respectively). However, the rate of false-negative results in Group 4 (5.63%) was the only one among all the sets of SC that showed a significant increase in inpatients compared to outpatients (3.18% - p-value = 0.0150).

The rates of false-positive inpatient samples in Group 2 and Group 3 (38.05%; 30.13%, respectively) were higher than the total rates of false-positive results (31.66% - p-value = 0.0361 and 24.23% - p-value = 0.0308, respectively). With the exception of Group 1, the rates of false-positive results in inpatients (38.05%, 30.13% and 29.68%, for Groups 2, 3 and 4, respectively) were higher than those observed in the outpatient samples (28.33% - p-value = 0.0020; 21.66% - p-value = 0.0017 and 23.78% - p-value = 0.0320, respectively).

Importantly, the rates of microscopic reviews in inpatient samples of Groups 1, 2, 3 and 4 (90.25%, 73.97%, 64.84% and 61.94%, respectively) were significantly higher than those found in outpatient samples (63.86% - p-value < 0.0001; 44.46% - p-value < 0.0001; 37.27% - p-value < 0.0001 and 38.78% - p-value < 0.0001, respectively).

The rates of microscopic reviews decreased in Group 2 (54.52%) and Group 3 (46.33), and the rate of false-negative results was ≤3% in both. With the exception of Group 4, all the other groups achieved rates of false-negative results <3% and statistically different from the rate in the SC of Group 4 (p-value < 0.05). However, only the SC of Group 1 were capable of screening a sample with 2% plasma cells in a patient with multiple myeloma (confirmed in this patient's medical records).

Figure 1 shows the comparison of the ROC curves of Groups 1-4. Group 3 had the greatest area under the curve (0.784), while Group 1 had the smallest (0.659). Group 3 had the highest Youden index (0.5677), while Group 1 had the lowest (0.3207).

Figure 1
Comparison of receiver operating characteristic (ROC) curves of the screening criteria sets of Groups 1-4.

Note 1: 100 − specificity = false positive rate.

Note 2: Four ROC curves with different values of the area under de ROC curve are illustrated. A perfect test has an area under de ROC curve of 1. The chance level diagonal (black dashed line segment from 0 (x), 0 (y) to 100 (x), 100 (y)) has an area under de ROC curve of 0.5. The ROC curves of Groups 1-4 demonstrated different abilities to distinguish between samples with and samples without positive smear findings (colored dashed and solid lines) and lie between these two extremes. Group 3 with the greatest area under the ROC curve has the best overall diagnostic performance.

Note 3: Group 3 had the highest Youden index and gave the least proportion of misclassified results, whereas Group 1 had the lowest Youden index and gave the highest proportion of misclassified results.

Note 4: The area under the ROC curve for Groups 2 and 4 are almost identical. In the high false positive rate range (or high sensitivity range) Group 2 is better than Group 4, whereas in the low false positive rate range (or low sensitivity range) Group 4 is better than Group 2.

Note 5: Prevalence of positive samples: 24.84% (491 samples in 1977).


In the analysis of positive cases (true-positive results and false-positive results) (Table 4), the qualitative SC related to suspect flags displayed a good positive predictive value. The RDW-CV and the RDW-SD showed increased positive predictive values as the cut-off points were raised. The leukocyte count cut-off point of the SC in Group 1 showed the lowest positive predictive value while Group 2 showed the highest positive predictive value. The set of SC in Group 3 best identified the true-positive samples, with a positive predictive value of 47.7%.

Table 4
Analysis of positive cases observed in the screening criteria of Groups 1-4.

Table 5 provides a breakdown of the false-negative results found in Groups 1-4. The morphological changes that led to the highest number of false-negative results among all the evaluated SC were band neutrophils ≥15%, and myelocytes ≥1%. In Group 3, the negative predictive value found for band neutrophils of ≥15% demonstrated that in 97.4% of the cases that did not indicate the presence of this morphological alteration; the samples actually contained no band neutrophils ≥15%.

Table 5
False-negative results and negative predictive values observed in Groups 1-4.

In Group 3, of the 54 samples with false-negative results, there were 27 cases of left shift ≥15% of band neutrophils, ten with myelocytes ≥1%, 25 with changes in red blood cell series, three cases with the presence of Döhle bodies and one case with plasma cells ≥1%. There were 54 samples with erythroblasts ≥1/100 leukocytes within the 1977 samples analyzed, and only one sample was not flagged by the SC of Groups 2-4. There were no false-negative results for morphological changes in platelets. No cases of blasts were lost by the four SC.

Table 6 shows the top ten single SC that generated false-positive results in Groups 1-4.

Table 6
Top ten single screening criteria which generated false-positive results in Groups 1-4.

The screening criterion that caused most false-positive results in Groups 2-4 was unreliable differential leukocyte counts (227 occurrences). The second major cause of false-positive results in Groups 2, 3 and 4 was platelet counts <100 × 103/µL, platelet counts <90 × 103/µL and leukocyte counts <4.0 × 103/µL, respectively.

Discussion

In studies that have proposed SC for MBSR, challenges exist in respect to standardization of the SC and PSF, since both are not completely applicable in all laboratories. Thus, each hematology laboratory should develop its own better-adapted SC for MBSR to capture samples with morphological findings of clinical significance (PSF), while accounting for the laboratory's peculiarities, as well as the knowledge and experience of the medical team.11 Gulati GL, Alomari M, Kocher W, Schwarting R. Criteria for blood smear review. Lab Med. 2002;33(5):374-7.,22 Pierre RV. Peripheral blood film review: the demise of the eyecount leukocyte differential. Clin Lab Med. 2002;22(1):279-97.,1515 Lantis KL, Harris RJ, Davis G, Renner N, Finn WG. Elimination of instrument-driven reflex manual differential leukocyte counts. Optimization of manual blood smear review criteria in a high-volume automated hematology laboratory. Am J Clin Pathol. 2003;119(5):656-62.,1616 Barnes PW, McFadden SL, Machin SJ, Simson E. The international consensus group for hematology review: suggested criteria for action following automated CBC and WBC differential analysis. Lab Hematol. 2005;11(2):83-90.,1919 Peterson P, Blomberg DJ, Rabinovitch A, Cornbleet PJ, Agosti SJ, Aronson M, et al. Physician review of the peripheral blood smear: when and why. An opinion. Lab Hematol. 2001;7(4):175-9.,2828 Hyun BH, Gulati GL, Ashton JK. Differential leukocyte count: manual or automated. What should it be?. Yonsei Med J. 1991;32(4):283-91.

29 Woo HY, Shin SY, Park H, Kim YJ, Kim HJ, Lee YK, et al. Current status and proposal of a guideline for manual slide review of automated complete blood cell count and white blood cell differential. Korean J Lab Med. 2010;30(6):559-66.
-3030 Cornet E, Mullier F, Despas N, Jacqmin H, Geara C, Boubaya M, et al. Evaluation and optimization of the extended information process unit (E-IPU) validation module integrating the Sysmex flag systems and the recommendations of the French-speaking cellular hematology group (GFHC). Scand J Clin Lab Investig. 2016;76(6):465-71. As recommended by Froom et al.,3131 Froom P, Isakov E, Barak M. Criteria for reflex peripheral smear review in infants. Scand J Clin Lab Investig. 2014;74(4):366-8. SC specifically for children aged under 15 months could also be established, as these authors observed a high rate of false-positive results due to samples with absolute lymphocyte counts above 7.0 × 103/µL. As demonstrated by Tseng et al.,3232 Tseng V, Morgan AS, Leith CP, Yang DT. Efficient assessment of peripheral blood lymphocytosis in adults: developing new thresholds for blood smear review by pathologists. Clin Chem Lab Med. 2014;52(12):1763-70. studies could be conducted through ROC curve analysis to define the best SC cut-off points for identifying the PSF. The SC for MBSR should be verified and improved continuously and, for this purpose, samples should be regularly and seasonally analyzed as a quality control procedure to determine the need for adjustments of the SC for MBSR used at that time; this would take into account changes in the patient's characteristics due to seasonal diseases. Galloway and Osgerby showed that variations can arise with the use of SC for MBSR, which are dependent on the type of hospital, the hematology analyzer used and geographical location of the laboratory.3333 Galloway MJ, Osgerby JC. An audit of the indications for the reporting of blood films: results from the National Pathology Benchmarking Study. J Clin Pathol. 2006;59(5):479-81. A study of the Q-Probe program, reported that the larger the hospital, the greater the percentage of MBSR will be.2323 Novis DA, Walsh M, Wilkinson D, Loris MS, Ben-Ezra J. Laboratory productivity and the rate of manual peripheral blood smear review. Arch Pathol Lab Med. 2006;130(5):596-601. The PSF should encompass clinically significant morphological alterations, thus establishing a minimum threshold of information which must be described in CBCs as per local consensus. The PSF of HC-UFPR have their relevant threshold values either equal to or less than the PSF of ISLH.1616 Barnes PW, McFadden SL, Machin SJ, Simson E. The international consensus group for hematology review: suggested criteria for action following automated CBC and WBC differential analysis. Lab Hematol. 2005;11(2):83-90.

Two basic principles should be followed when developing SC for MBSR: (1) reduction in the rate of false-negative results to an acceptable value. Groups 1-3 obtained false-negative rates below the limit of 3% specified in this study. Group 3 displayed a marginally higher efficiency compared to Group 4 and both were more efficient than Groups 1 and 2. However, the rate of false-negative results in Group 3 was significantly lower than that in Group 4 (p-value = 0.0414). Moreover, Kim et al. found a false-negative rate and specificity of 9.7% and 77.1%, respectively, using the SC of ISLH to capture samples with the PSF of ISLH.3434 Kim SJ, Kim Y, Shin S, Song J, Choi JR. Comparison study of the rates of manual peripheral blood smear review from 3 automated hematology analyzers, Unicel DxH 800, ADVIA 2120i, and XE 2100, using international consensus group guidelines. Arch Pathol Lab Med. 2012;136(11):1408-13.

In Groups 1-3, the rates of false-negative results in inpatients were similar to those observed in outpatients, suggesting that these studies can be used for both profiles, while those observed in Group 4 were significantly higher and thus, constitute a constraint on the safety of hospitalized patients. However, Pratumvinit et al. evaluated their own optimized SC to capture PSF of the ISLH and did not observe this difference in patient profile.1717 Pratumvinit B, Wongkrajang P, Reesukumal K, Klinbua C, Niamjoy P. Validation and optimization of criteria for manual smear review following automated blood cell analysis in a large university hospital. Arch Pathol Lab Med. 2013;137(3):408-14.

It is important that no false-negative result reflects the presence of previously undetected severe hematologic diseases, although false-negative rates of 3%2424 Cui W, Wu W, Wang X, Wang G, Hao Y, Chen Y, et al. Development of the personalized criteria for microscopic review following four different series of hematology analyzer in a Chinese large scale hospital. Chin Med J. 2010;123(22):3231-7. to 5%1616 Barnes PW, McFadden SL, Machin SJ, Simson E. The international consensus group for hematology review: suggested criteria for action following automated CBC and WBC differential analysis. Lab Hematol. 2005;11(2):83-90. are acceptable. To further expand on detecting the undiagnosed hematologic diseases, each institution should perform MBSR in patients within certain hospitalization units, such as the hematology unit, even at the cost of an increase in the rate of microscopic reviews.

The analysis of false-negative results in all groups also revealed a high incidence of neutrophil left shift. However, the interpretation of these results should consider the limitations of the MDLC: (i) observer misclassification and the high variation of leukocyte cell types between observers, (ii) slide cell distribution errors caused by the nonrandom distribution of leukocyte types on blood film prepared by the wedge-type technique, (iii) poor-quality blood film and inconsistent staining, (iv) poor statistical sampling validity due to variability in 100-cell proportional differential counts of given type of leukocyte, i.e., the fewer cells that are counted, the less precise the blood cell percentage is and (v) recording errors.22 Pierre RV. Peripheral blood film review: the demise of the eyecount leukocyte differential. Clin Lab Med. 2002;22(1):279-97. For instance, unlike this study, Hyun et al. consider very high counts as clinically significant such as, promyelocytes ≥3%, neutrophils and band neutrophils ≥20%, atypical lymphocytes ≥7% and erythroblasts ≥2 or 3/100 leukocytes.2828 Hyun BH, Gulati GL, Ashton JK. Differential leukocyte count: manual or automated. What should it be?. Yonsei Med J. 1991;32(4):283-91. In contrast, Jones et al. consider immature granulocytes ≥3%, atypical lymphocytes ≥10% and erythroblasts ≥2/100 leukocytes as significant,3535 Jones RG, Faust A, Glazier J, Matthews R, Potter B. CELL-DYN® 4000: utility within the core laboratory structure and preliminary comparison of its expanded differential with the 400-cell manual differential count. Lab Hematol. 1998;4:34-44. which shows the diversity of PSF in each laboratory.

Another important factor is to find SC that classify less samples as false positive in agreement with the second principle, which is to reduce the rate of microscopic reviews to an acceptable value. In all Groups, the total rates of microscopic reviews were directly influenced by limits established for the SC. Group 1 had the highest total rate of microscopic reviews and the lowest rate of false-negative results compared to other SC (0.5%, p-value < 0.001). Although a high MBSR rate is safe for the patients, it can be a problem in respect to the delay of results for laboratories that do not have a sufficient number of experienced professionals to perform MBSR. Group 1 is a good example of how the lack of SC optimization may result in an unnecessary labor-intensive workload due to the high rate of microscopic reviews.

The pre-set limit of <50% on the rate of microscopic reviews was observed in Group 3 and Group 4; however, the lowest rate of microscopic reviews as well as increased efficiency and safety observed in Group 3 made this set of SC more acceptable. Previous studies by Cui et al.2424 Cui W, Wu W, Wang X, Wang G, Hao Y, Chen Y, et al. Development of the personalized criteria for microscopic review following four different series of hematology analyzer in a Chinese large scale hospital. Chin Med J. 2010;123(22):3231-7. and Pratumvinit et al.1717 Pratumvinit B, Wongkrajang P, Reesukumal K, Klinbua C, Niamjoy P. Validation and optimization of criteria for manual smear review following automated blood cell analysis in a large university hospital. Arch Pathol Lab Med. 2013;137(3):408-14. obtained lower rates of microscopic reviews than those found in Group 3. However, we chose not to make additional adjustments to the SC in Group 3 to further reduce the rates of microscopic reviews, since this could increase the rate of false-negative results above the safety limit. Therefore, we conclude that the SC of Group 3 constitute the limit of automation for the direct release of CBC results in an efficient and safe manner at the Hospital de Clínicas of UFPR.

Through the analysis of false-positive results, one can alter or remove some SC to reduce the rate of microscopic reviews, as high rates overload the professionals causing delays in the release of results. The rate of microscopic reviews of 46.33% obtained in Group 3 is within the capacity of the hematology laboratory at HC-UFPR.1616 Barnes PW, McFadden SL, Machin SJ, Simson E. The international consensus group for hematology review: suggested criteria for action following automated CBC and WBC differential analysis. Lab Hematol. 2005;11(2):83-90.,1717 Pratumvinit B, Wongkrajang P, Reesukumal K, Klinbua C, Niamjoy P. Validation and optimization of criteria for manual smear review following automated blood cell analysis in a large university hospital. Arch Pathol Lab Med. 2013;137(3):408-14.,2424 Cui W, Wu W, Wang X, Wang G, Hao Y, Chen Y, et al. Development of the personalized criteria for microscopic review following four different series of hematology analyzer in a Chinese large scale hospital. Chin Med J. 2010;123(22):3231-7.,3434 Kim SJ, Kim Y, Shin S, Song J, Choi JR. Comparison study of the rates of manual peripheral blood smear review from 3 automated hematology analyzers, Unicel DxH 800, ADVIA 2120i, and XE 2100, using international consensus group guidelines. Arch Pathol Lab Med. 2012;136(11):1408-13.

Parameters such as MCV, RDW-CV, RDW-SD, MCHC, differential counts of neutrophils and suspect flags displayed the highest positive predictive values. Thus, appropriate adjustments to the cut-off limits of these parameters can increase the ability to detect abnormal samples. On the other hand, low leukocyte and platelet counts, as well as the MPV captured samples without morphological abnormalities producing the lowest positive predictive values. Notably, these results reflect the profiles of patients analyzed routinely in the hematology laboratory (quaternary hospital). Kim et al. demonstrated that SC with the best positive predictive values in a tertiary hospital in Korea were: hemoglobin, MCV, RDW and suspect flags.3434 Kim SJ, Kim Y, Shin S, Song J, Choi JR. Comparison study of the rates of manual peripheral blood smear review from 3 automated hematology analyzers, Unicel DxH 800, ADVIA 2120i, and XE 2100, using international consensus group guidelines. Arch Pathol Lab Med. 2012;136(11):1408-13. Likewise, Pratumvinit et al. demonstrated that the rate of false-positive results was higher in hospitalized patients than in outpatients.1717 Pratumvinit B, Wongkrajang P, Reesukumal K, Klinbua C, Niamjoy P. Validation and optimization of criteria for manual smear review following automated blood cell analysis in a large university hospital. Arch Pathol Lab Med. 2013;137(3):408-14.

In this study, for the first time, a comparison of ROC curves was used as an assessment tool for the evaluation of sets of SC for MBSR. Figure 1 shows the behavior of sets of SC with respect to pair sensitivity and fraction of false-positive results (100 - specificity). Group 3, relative to the others, did not display a higher sensitivity, but accurately classified the samples with an efficiency of 73.04% and a Youden index of 0.5677. The Youden index is appropriate for choosing the test that presents the least misclassified results (false-positive results + false-negative results); however, on certain occasions, it may be important to choose the test with fewer false-negative results, i.e., the most sensitive. A high sensitivity occurs due to the high number of microscopic reviews (Group 1), which may not be interesting, since it reduces the amount of correctly classified samples (efficiency). Importantly, the high efficiency of Group 3 was obtained at the expense of a 2.73% false-negative rate, which is still lower than the values suggested by Barnes et al.1616 Barnes PW, McFadden SL, Machin SJ, Simson E. The international consensus group for hematology review: suggested criteria for action following automated CBC and WBC differential analysis. Lab Hematol. 2005;11(2):83-90. (<5%) and by Cui et al.2424 Cui W, Wu W, Wang X, Wang G, Hao Y, Chen Y, et al. Development of the personalized criteria for microscopic review following four different series of hematology analyzer in a Chinese large scale hospital. Chin Med J. 2010;123(22):3231-7. (<3%); thus, conveying more reliability of the CBC results released directly after the application of this set of SC.

SC for MBSR with a high sensitivity may be beneficial in laboratories that mostly attend outpatients for screening purposes, while SC for MBSR with high specificity may be more useful in laboratories that attend inpatients, in order to provide faster and more efficient care. Group 3 displayed the highest specificity (67.77%), which can significantly reduce the delay of results for the patients treated at HC-UFPR, as it allows a better classification of true-negative samples (50.94%).

Importantly, for the performance evaluation of SC for MBSR, one should not only seek higher sensitivity specificity, and efficiency, but also maintain a balance between not overloading with unnecessary MBSR and failure to review microscopic samples containing clinically relevant morphological changes. Therefore, the rate of false-negative results must be maintained within the limits recommended by the laboratory.11 Gulati GL, Alomari M, Kocher W, Schwarting R. Criteria for blood smear review. Lab Med. 2002;33(5):374-7.

In an attempt to reduce the microscopic reviews found in this study, some actions can be adopted for further studies such as, changing the PSF of band neutrophils from ≥15% to ≥20% or even removing it from the PSF, as the International Council for Standardization in Hematology (ICSH) recommends that band neutrophils should be segmented in MDLC due to wide inter-observer variations in their classification.3636 Palmer L, Briggs C, Mcfadden S, Zini G, Burthem J, Rozenberg G, et al. ICSH recommendations for the standardization of nomenclature and grading of peripheral blood cell morphological features. Int J Lab Hematol. 2015;37(3):287-303. This would allow elevation of the leukocyte and neutrophil values in SC. One could also deploy improvements in the laboratory information systems to enable deployment of delta check rules to increase the quality, safety and productivity of results.

The deployment of SC for MBSR is aimed to ensure that satisfactory performance in productivity brings benefits to patients, physicians and the laboratory itself by reducing costs and increasing the quality of exams. The application of Group 3 SC in our hematology laboratory enables approximately 120,000 CBC to be conducted annually, with approximately 64,400 to be released directly, allowing each professional to better utilize their time in the microscopic analysis of difficult cases.

The following limitations of the present study should be considered: (i) this study was not blinded; the observers had access to reports of hematology analyzers, which may have led to over-reports of certain morphological changes, especially those marked by suspect flags. (ii) The MBSR and the MDLC were performed by only one observer for each blood smear. On one hand, the review by two observers in a double-blind study could give more credibility to the results; however, it would negatively impact the practicality of implementation and periodic evaluations of SC for MBSR. Notably, Barnes et al. recommend that MBSR be performed by a single experienced observer in order to provide consistent results.1616 Barnes PW, McFadden SL, Machin SJ, Simson E. The international consensus group for hematology review: suggested criteria for action following automated CBC and WBC differential analysis. Lab Hematol. 2005;11(2):83-90. In this study, the MBSR was performed by observers with extensive experience on morphological reviews in the hematology laboratory. (iii) The data presented were generated from a single population with a specific profile in a university hospital that uses a certain type of hematology analyzer, and at a certain time of the year (spring). Accounting for these local factors, SC for MBSR which were more efficient in the hematology laboratory of HC-UFPR may not be the most appropriate for other laboratories. (iv) The samples were collected consecutively for seven days, and thus, unusual changes that may constitute the PSF were not observed during this study. In order to assess these unusual PSF, further studies are needed with a longer sample collection period.

Automation in the hematology field has grown substantially in recent years, and more functions are available in the hematology analyzers such as, self-check of results, ease of maintenance and simplified interface protocols. These functions contribute to a reduction in the human interaction with analyzers to facilitate the workflow and decrease the delay of results. Hence, human efforts can be directed toward the verification of results of difficult MBSR cases, verification and analysis of the analytical performance of the hematology analyzers, and the evaluation and establishment of SC for MBSR through surveys and daily interactions between professionals in the lab, medical team and the hematology analyzers. All these factors aim to ensure appropriate, relevant, and high quality results released in a timely manner for decision-making and appropriate medical management.

Conclusions

The SC for MBSR of Groups 1-4 can be used in a hematology laboratory and the chosen set of SC depends on the need to increase efficiency, the safety of patients, as well as the availability of expertly trained personnel to perform the MBSR. Group 3 was the most appropriate for the hematology laboratory of UFPR, displaying the best relationship between safety (FN ≤3%) and efficacy for estimating the limits of the automation of CBCs. This study reinforces the importance of heterogeneity in the relevant population, such that the SC for MBSR meet the characteristics of different contexts in which hematological determinations are performed.

References

  • 1
    Gulati GL, Alomari M, Kocher W, Schwarting R. Criteria for blood smear review. Lab Med. 2002;33(5):374-7.
  • 2
    Pierre RV. Peripheral blood film review: the demise of the eyecount leukocyte differential. Clin Lab Med. 2002;22(1):279-97.
  • 3
    Pierre RV. Red cell morphology and the peripheral blood film. Clin Lab Med. 2002;22(1):25-61.
  • 4
    Bain BJ. Diagnosis from the blood smear. N Engl J Med. 2005;353(5):498-507.
  • 5
    Gulati GL, Song J, Florea AD, Gong J. Purpose and criteria for blood smear scan, blood smear examination, and blood smear review. Ann Lab Med. 2013;33(1):1-7.
  • 6
    Bain BJ. Blood cells: a practical guide. 5th ed. Oxford: Wiley-Blackwell; 2015, 491 p.
  • 7
    Ward PC. The CBC at the turn of the millennium: an overview. Clin Chem. 2000;46(8p2):1215-20.
  • 8
    Houwen B. The differential cell count. Lab Hematol. 2001;7(2):89-100.
  • 9
    Ruzicka K, Veitl M, Thalhammer-Scherrer R, Schwarzinger I. The new hematology analyzer Sysmex XE-2100: performance evaluation of a novel white blood cell differential technology. Arch Pathol Lab Med. 2001;125(3):391-6.
  • 10
    Stamminger G, Auch D, Diem H, Sinha P. Performance of the XE-2100 leucocyte differential. Clin Lab Haematol. 2002;24(5):271-80.
  • 11
    Hur M, Cho JH, Kim H, Hong MH, Moon HW, Yun YM, et al. Optimization of laboratory workflow in clinical hematology laboratory with reduced manual slide review: comparison between Sysmex XE-2100 and ABX Pentra DX120. Int J Lab Hematol. 2011;33(4):434-40.
  • 12
    Briggs C, Longair I, Kumar P, Singh D, Machin SJ. Performance evaluation of the Sysmex haematology XN modular system. J Clin Pathol. 2012;65(11):1024-30.
  • 13
    Corberand JX, Laharrague PF, Fillola GM. Validation criteria of the Sysmex NE-8000™ results. Personal experience in the computerized haematology laboratory of a French teaching hospital. Sysmex J Int. 1992;2(2):103-10.
  • 14
    Chapman M. Hematology analyzers offer new technology and user-friendliness. Lab Med. 2000;31(3):146-50.
  • 15
    Lantis KL, Harris RJ, Davis G, Renner N, Finn WG. Elimination of instrument-driven reflex manual differential leukocyte counts. Optimization of manual blood smear review criteria in a high-volume automated hematology laboratory. Am J Clin Pathol. 2003;119(5):656-62.
  • 16
    Barnes PW, McFadden SL, Machin SJ, Simson E. The international consensus group for hematology review: suggested criteria for action following automated CBC and WBC differential analysis. Lab Hematol. 2005;11(2):83-90.
  • 17
    Pratumvinit B, Wongkrajang P, Reesukumal K, Klinbua C, Niamjoy P. Validation and optimization of criteria for manual smear review following automated blood cell analysis in a large university hospital. Arch Pathol Lab Med. 2013;137(3):408-14.
  • 18
    Comar SR, Malvezzi M, Pasquini R. Establishment and evaluation of review criteria of automated complete blood counts applying receiver operating characteristics (ROC) curve analysis. Int J Lab Hematol. 2013;35(s1):44-5.
  • 19
    Peterson P, Blomberg DJ, Rabinovitch A, Cornbleet PJ, Agosti SJ, Aronson M, et al. Physician review of the peripheral blood smear: when and why. An opinion. Lab Hematol. 2001;7(4):175-9.
  • 20
    Comar SR, Malvezzi M, Pasquini R. Are the review criteria for automated complete blood counts of the International Society of Laboratory Hematology suitable for all hematology laboratories?. Rev Bras Hematol Hemoter. 2014;36(3):219-25.
  • 21
    Comar SR, Malvezzi M, Pasquini R. To follow or not to follow the recommendations regarding microscopic analysis of the Clinical and Laboratory Standards Institute H20-A2 to validate the criteria for blood smear review?. Rev Bras Hematol Hemoter. 2015;37(1):69-70.
  • 22
    Silva PH, Alves HB, Comar SR, Henneberg R, Merlin JC, Stinghen ST. Análise morfológica do sangue periférico e sua correlação com o hemograma. In: Silva PH, Alves HB, Comar SR, Henneberg R, Merlin JC, Stinghen ST, editors. Hematologia laboratorial: teoria e procedimentos. Porto Alegre: Artmed; 2015. p. 51–65.
  • 23
    Novis DA, Walsh M, Wilkinson D, Loris MS, Ben-Ezra J. Laboratory productivity and the rate of manual peripheral blood smear review. Arch Pathol Lab Med. 2006;130(5):596-601.
  • 24
    Cui W, Wu W, Wang X, Wang G, Hao Y, Chen Y, et al. Development of the personalized criteria for microscopic review following four different series of hematology analyzer in a Chinese large scale hospital. Chin Med J. 2010;123(22):3231-7.
  • 25
    Braile DM, Godoy MF. Programa cálculos estatísticos for Windows V.1.8; 1999.
  • 26
    Youden WJ. Index for rating diagnostic tests. Cancer. 1950;3(1):32-5.
  • 27
    Clinical and Laboratory Standards Institute (CLSI). Assessment of the diagnostic accuracy of laboratory tests using receiver operating characteristic curves: approved guideline. 2nd ed. Wayne, PA: CLSI Document EP24-A2; 2011.
  • 28
    Hyun BH, Gulati GL, Ashton JK. Differential leukocyte count: manual or automated. What should it be?. Yonsei Med J. 1991;32(4):283-91.
  • 29
    Woo HY, Shin SY, Park H, Kim YJ, Kim HJ, Lee YK, et al. Current status and proposal of a guideline for manual slide review of automated complete blood cell count and white blood cell differential. Korean J Lab Med. 2010;30(6):559-66.
  • 30
    Cornet E, Mullier F, Despas N, Jacqmin H, Geara C, Boubaya M, et al. Evaluation and optimization of the extended information process unit (E-IPU) validation module integrating the Sysmex flag systems and the recommendations of the French-speaking cellular hematology group (GFHC). Scand J Clin Lab Investig. 2016;76(6):465-71.
  • 31
    Froom P, Isakov E, Barak M. Criteria for reflex peripheral smear review in infants. Scand J Clin Lab Investig. 2014;74(4):366-8.
  • 32
    Tseng V, Morgan AS, Leith CP, Yang DT. Efficient assessment of peripheral blood lymphocytosis in adults: developing new thresholds for blood smear review by pathologists. Clin Chem Lab Med. 2014;52(12):1763-70.
  • 33
    Galloway MJ, Osgerby JC. An audit of the indications for the reporting of blood films: results from the National Pathology Benchmarking Study. J Clin Pathol. 2006;59(5):479-81.
  • 34
    Kim SJ, Kim Y, Shin S, Song J, Choi JR. Comparison study of the rates of manual peripheral blood smear review from 3 automated hematology analyzers, Unicel DxH 800, ADVIA 2120i, and XE 2100, using international consensus group guidelines. Arch Pathol Lab Med. 2012;136(11):1408-13.
  • 35
    Jones RG, Faust A, Glazier J, Matthews R, Potter B. CELL-DYN® 4000: utility within the core laboratory structure and preliminary comparison of its expanded differential with the 400-cell manual differential count. Lab Hematol. 1998;4:34-44.
  • 36
    Palmer L, Briggs C, Mcfadden S, Zini G, Burthem J, Rozenberg G, et al. ICSH recommendations for the standardization of nomenclature and grading of peripheral blood cell morphological features. Int J Lab Hematol. 2015;37(3):287-303.

Publication Dates

  • Publication in this collection
    Oct-Dec 2017

History

  • Received
    24 Mar 2017
  • Accepted
    20 June 2017
Associação Brasileira de Hematologia e Hemoterapia e Terapia Celular R. Dr. Diogo de Faria, 775 cj 114, 04037-002 São Paulo/SP/Brasil, Tel. (55 11) 2369-7767/2338-6764 - São Paulo - SP - Brazil
E-mail: secretaria@rbhh.org