Evaluation of data quality, timeliness and acceptability of the tuberculosis surveillance system in Brazil’s micro-regions

Abstract

This study aimed to evaluate quality, acceptability and timeliness of the data in the tuberculosis surveillance system in Brazilian micro-regions. An ecological cross-sectional study was carried out, after a qualitative stage for selecting indicators. All 558 Brazilian micro-regions were used as units of analysis. Data available in the National Notifiable Diseases Information System (SINAN), from 2012 to 2014, were used to calculate 14 indicators relating to four attributes: completeness, consistency, timeliness and acceptability. The study made use of cluster analysis to group micro-regions according to acceptability and timeliness. Three clusters were identified among the 473 micro-regions with optimal or regular completeness (70% to 100%) and with over five notifications. Cluster 1 (n = 109) presented mean timeliness of notification and treatment equal to 62.8% and 24.9%, respectively. Cluster 2 (n = 143) had a mean percentage of cases tested for HIV equal to 55.9%. Cluster 3 (n = 221) had the best performing tuberculosis indicators. Results suggest priority areas for improving surveillance of tuberculosis, predominantly in the central-north part of the country. They also point to the need to increase the timeliness of treatment and the percentage of cases tested for HIV.

Tuberculosis; Epidemiological Surveillance; Information systems

Resumo

Objetivou-se avaliar a qualidade dos dados, a aceitabilidade e a oportunidade do sistema de vigilância da tuberculose nas microrregiões do Brasil. Foi realizado estudo ecológico transversal, após etapa qualitativa para seleção de indicadores, tendo como unidades de análise as 558 microrregiões. Foram utilizados dados do Sistema de Informação de Agravos de Notificação (SINAN), de 2012 a 2014, para cálculo de 14 indicadores referentes a 4 atributos: completitude, consistência, oportunidade e aceitabilidade. Foi empregada análise de cluster para agrupar as microrregiões quanto à aceitabilidade e à oportunidade. Dentre as 473 microrregiões com completitude ótima ou regular (70% a 100%) e número de notificações superior a 5, foram identificados 3 clusters. O cluster 1 (n = 109) apresentou oportunidades médias de notificação e de tratamento iguais a 62,8% e 24,9%, respectivamente. O cluster 2 (n = 143) teve o percentual médio de casos testados para HIV igual a 55,9%. O cluster 3 (n = 221) apresentou o melhor desempenho nos indicadores da tuberculose. Os resultados sugerem áreas prioritárias para aprimoramento da vigilância da tuberculose, predominantemente no centro-norte do país. Também apontam a necessidade de aumento da oportunidade do tratamento e do percentual de casos testados para HIV.

Tuberculose; Vigilância Epidemiológica; Sistemas de informação

Introduction

The Brazilian economic and political crisis could have an impact on the control of tuberculosis (TB). Significant negative outcomes of this crisis, such as food insecurity and unemployment, are determinants that have been evidenced and are associated to the escalation of this disease^1,2. Furthermore, the limited resources imposed by the Constitutional Amendment nº 95/2016³ could further reduce health actions and services related to the surveillance and treatment of TB.

In Brazil, the TB incidence rate in 2016 was 32.4/100,000 inhabitants and the mortality rate, in 2015, was 2.2/100,000 inhabitants. Both these indicators have seen a decline of 2% and 3% per year, respectively^4,5. These results, however, are not sufficient to meet the goals of the End TB Strategy, approved by the World Health Assembly in 2014, whose aim is to ensure TB is eliminated and no longer considered a global public health issue. Its main goals are to bring incidence to levels lower than 10/100,000 inhabitants by 2035 and reduce deaths by 95% in comparison with 2015 death rates⁵.

To move forward with this objective, especially in an unfavorable economic scenario, strategic planning is essential in order to make programs more cost-effective. Furthermore, the fight against TB requires a wide-range of approaches not restricted to curative measures but which include audacious policies such as the social protection of individuals with the disease⁶. In this context, the Epidemiological Surveillance of TB can play a significant role.

Some of the features of the Epidemiological Surveillance System in Brazil include case notification, contact investigation and case follow-up⁷. This system has seen some successes, as can be observed in the decrease in TB indicators in Brazil, and achieved some excellent results such as the improvement of TB detection in prisons⁸. Nevertheless, TB operational indicators are not homogeneous across geographic regions and population subgroups, reflecting variations in surveillance⁹. Even at national level, there are some important challenges related to Epidemiological Surveillance such as the low number of contact investigations and high levels of treatment non-adherence^5,10-12.

The analysis of Epidemiological Surveillance will steer recommendations and contribute to decision-making¹³. Evaluating TB, a chronic disease, is complex because of different social and epidemiological conditions and the need for joined up actions between the various spheres of the health system, because it requires continuous treatment for at least 6 months¹⁴. The Guidelines for Evaluating Surveillance Systems produced by the Center for Disease Control and Prevention (CDC) proposes an analysis of various attributes that could be useful in this context¹⁵.

Many studies in Brazil have used quantitative analysis to evaluate TB surveillance systems. However, in these studies, usually only one of the attributes proposed by the CDC (2001)¹⁵, data quality^16-19 was employed in calculations, they took place in small localities^12,20-22 or in specific states^13,14,23. The most extensive study analyzed the quality of TB surveillance in Brazilian municipalities between 2001 and 2003¹⁰.

Given the lack of wide-ranging and up-to-date research, the aim of this paper is to evaluate the quality of the data, timeliness and acceptability of the tuberculosis surveillance system in the micro-regions of Brazil.

Methods

Study design

A hybrid study was conducted in two stages: (i) a qualitative analysis involving a semi-structured questionnaire in a consultation of TB surveillance specialists, for selecting the indicators and defining the parameters to evaluate the surveillance system; and (ii) a quantitative study with a cross-sectional ecological design where the selected indicators were calculated based on data about notified TB cases, available in the National Information System of Notifiable Diseases (SINAN) and diagnosed between 2012 and 2014 across all 558 Brazilian micro-regions.

First stage: indicators selection and parameter definition for evaluating the tuberculosis surveillance system

Specifically selected TB surveillance specialists, working in different regions of Brazil and with proven technical and scientific knowledge to contribute to this study, were consulted. They were recommended by National Tuberculosis Control and state program staff. Contact was made via telephone, email, or directly by researchers in the area.

Some of the specialists were emailed a questionnaire about indicators related to the following attributes of the tuberculosis surveillance system: (i) data quality (completeness and consistency), timeliness and (iii) acceptability¹⁵. The questionnaire included closed questions, where respondents could select the most appropriate indicators for the TB surveillance system. In addition, specialists could also agree (or disagree) with the suggested cut off points or limits for evaluating the indicators. Some open questions were also included so that, if necessary, specialists could list alternative indicators, attributes and limits to those presented in the closed questions. A copy of the questionnaire is annexed. The format for evaluating attributes was as follows:

Data quality: specialists were questioned about a list of 9 suggested indicators to estimate the completeness of the TB information system^7,12. Furthermore, they were advised that all blank entries or those with the term ‘unknown’, or any other term used to indicate lack of information, should be considered incomplete²⁰. To assess data consistency, 5 scenarios were proposed, according to the Script for analyzing the tuberculosis database available in the National Information System of Notifiable Diseases - SINAN, the calculation of basic indicators²⁴ and the SINAN NET data dictionary v. 4.0²⁵. An example of a suggested consistency scenario involves the percentage of recorded AIDS cases with events associated to TB and positive HIV tests.

ii) Timeliness: specialists were asked about the indicators described in Mandacarú¹⁹. Timeliness indicators proposed were: timeliness of notification, timeliness of investigation, timeliness of typing, timeliness of treatment and timeliness of case closure.

iii) Acceptability: the adherence of health professionals to the TB surveillance guidelines was considered to be the best way of evaluating the acceptability of the system²⁶. Thus, the following indicators were proposed for evaluating acceptability: Braga’s¹⁰ detection and follow up quality indicators, complemented by Ministry of Health indicators⁵. In total, 7 indicators were suggested, including: 1) Percentage of new pulmonary TB cases confirmed by laboratorial tests that received directly observed therapy (DOT), 2) Percentage of new pulmonary TB cases where a sputum smear microscopy was conducted.

To reduce losses, a participation reminder was sent to specialists who, after 7 days, had not replied to the original email. The consultation period took place between October and December 2016. Six specialists working in the Northeast, Southeast and Center-West regions of the country answered the questionnaire. Another three researchers also made suggestions to the variables listed by the specialists in order to refine and conclude the selection.

14 indicators were selected from those classified as relevant for evaluating TB surveillance by at least two of the six specialists and by the three reviewers. These indicators and their form of calculation are shown in Chart 1.

The classification of continuous indicators was conducted in accordance to the parameters recommended by the literature^{7,10,12,27,28} and, in their absence, according to the suggestions of the specialists. An indicator was classified as “invalid” in micro-regions if at least 15% of the records needed for calculation were incomplete or inconsistent. In the micro-regions with valid data, limits L1 and L2, shown in Chart 1, were used to classify the following performance groups: poor (indicator < L1%), regular (indicator > = L1% and <L2%) and optimal (indicator > = L2%).

Second stage: calculation of indicators

The ecological study used all 558 micro-regions as units of analysis, encompassing all 5,570 Brazilian municipalities. All notified TB cases were analyzed per Federation Unit (FU or states) and by notification micro-region. All cases with a change in diagnosis were excluded. Six micro-regions were excluded from the micro-region analysis but were considered in the FU calculations because they had five or less notifications during the period analyzed. Data used was extracted from SINAN in May 2016. The 2013 Digital Geographical Grid, produced by the Brazilian Institute of Geography and Statistics (IBGE), was used for the mapping exercise.

General completeness was calculated as the median of all completeness indicators. Considering that acceptability and timeliness can be evaluated only if the information system is reliable, indicators related to these attributes were calculated only in micro-regions with a median completeness above or equal to 70%.

Data analysis

The indicators selected were calculated for each micro-region of the country and also per FU or state. Total completeness and consistency per FU are shown in a contingency table.

The Burt Table was used to work out the relation between timeliness and acceptability indicators. It is a square table, where the ij box contains the number of micro-regions simultaneously classified in categories i and j, i, j = 1, ..., k, where k is the total of all study categories²⁹.

A theme map was produced for acceptability and timeliness indicators. In these images, each micro-region was represented by a color in accordance to their performance in each specific indicator. “Incomplete” describes micro-regions where the indicator could not be calculated due to low median information system completeness.

In order to describe the regions in terms of the general surveillance system, a hybrid algorithm was used for cluster analysis, combining both the hierarchical and k-means methods³⁰. Given that k-means are reasonably sensitive to the initially defined cluster centers, the hybrid cluster used results produced by the hierarchical method as reference for the initial k-means arguments. The number of clusters was defined using a dendrogram. Cluster overlapping was visually inspected so as to evaluate the separation potential of the clusters selected. In order to do so, a dispersion graph of the first two main variable components was used. It distinguished micro-regions in terms of clusters allocated. The dendrogram, dispersion graph and Burt table are found in the annex.

Gonçalves¹³ recommended the use of cluster analysis to evaluate the National Tuberculosis Control Program (PNCT). To ensure comparability, standardized acceptability and timeliness indicators were used for clustering.

Data analysis was conducted using the R software, 3.4.0 version, and the following packages: GISTools to produce the theme maps, GDAtools to calculate the Burt table and factoextra to analyze the clusters.

Ethical considerations

The study involved consulting specialists on issues related to their professional practice whilst preserving their identity and included an analysis of secondary data accessible to the public. Therefore, the current study could not be registered or assessed by the Research Ethics Committee, in accordance with Resolution n. 510/2016, of the Brazilian National Health Council. Furthermore, secondary data contained individual information on TB cases, although individuals cannot be identified through the variables.

Results

In Brazil, between 2012 and 2014, there were 251,693 TB cases notified in 4,620 municipalities and 558 micro-regions, excluding the cases that underwent a change in diagnosis. There were 206,467 new cases, 20,211 re-entry cases following non-adherence, 17,335 recurrences and 6,202 transferals. In addition, there are 800 cases without information on entry type and 678 after death notifications. Furthermore, there were 210,358 pulmonary cases, 32,901 extra-pulmonary cases, 8,278 cases involving both pulmonary and extra-pulmonary TB simultaneously and 156 without information on the clinical form of the disease. All cases contained information on the municipality of notification. Therefore, there were no losses in the calculation of indicators per micro-region.

The completeness of treatment starting day, closure situation and consistency were optimal (> = 90%) in all FUs except Mato Grosso do Sul, where completeness of closure situations was 89.9%. By contrast, completeness of contacts investigated, and of 2nd and 6th month microscopy were poor (< 70%) or regular (> = 70% and < 90%) in practically all Brazilian states. Completeness of contacts investigated was poor in eight states and Paraíba (36%) particularly stands out. Microscopy completeness in the 2nd month was poor in five states in the Northeast: Rio Grande do Norte, Paraíba, Pernambuco, Alagoas and Bahia. In fifteen states 6th month microscopy completeness was poor, in particular in Paraíba and Pernambuco, with completeness rates lower than 50% (Table 1).

Table 1
General completeness and consistency indicators in the tuberculosis surveillance system per Federation Unit (FU), Brazil 2012 to 2014*.

• Source: produced for this study with data from the National Information System of Notifiable Diseases (SINAN).

It is important to highlight that the state of Acre had one of the best levels of completeness in terms of contacts investigated and 2nd and 6th month microscopy. The South was the only region where 6th month microscopy completeness was above 70% in all states (Table 1).

Among micro-regions with over 5 notifications (n = 552), the median completeness was optimal or regular in 85.7% (n = 473) and consistency was optimal in 98.0% (n = 541). Figures 1 and 2 show the distribution of acceptability and timeliness indicators in micro-regions where the median completeness was either regular or optimal. Micro-regions where median completeness was poor were concentrated in a band that started in the south of the state of Piauí, passing through the state of Bahia, the north and south of the state of Minas Gerais and part of the state of Rio de Janeiro. Areas with poor median completeness were also found in the states of Amazonas, Pará, Rio Grande do Sul, Rio Grande do Norte and Paraíba (Figures 1 and 2).

Figure 1
Distribution of timeliness indicators of the tuberculosis surveillance system in Brazilian micro-regions, 2012-2014*.

Figure 2
Distribution of acceptability indicators of the tuberculosis surveillance system in Brazilian microregion, 2012-2014*.

The timeliness of notification was poor in the micro-regions that cross Brazil vertically from the south of Mato Grosso, past the states of Tocantins, Maranhão and Piauí. Invalid timeliness of typing were concentrated in the micro-regions of São Paulo. Timeliness of treatment and closure were poor in most Brazilian micro-regions. However, in these maps, São Paulo stands out for presenting predominantly regular timeliness of treatment and invalid results for timeliness of closure (Figure 1).

Micro-regions with invalid contacts investigated were found across Brazil, except for São Paulo and Acre. Optimal microscopy of new cases was found mainly in the North region, São Paulo, Espírito Santo, the center of the State of Paraná and in the center-west of Goiás and Tocantins. Mato Grosso do Sul, Goiás, the south of Mato Grosso and Pará presented high treatment non-adherence rates. With the exception of the South region and São Paulo, all states had poor or regular results in terms of the percentage of cases tested for HIV (Figure 2).

The cluster analysis did not include the indicator “percentage of contacts investigated” due to the high percentage of micro-regions with invalid results. Timeliness of typing and of closure were also excluded because of invalid results in the state of São Paulo. The Burt table was developed taking into account the same attributes.

In the Burt table, it is possible to observe that most Brazilian micro-regions with regular or optimal median completeness and over 5 notifications during the period studied (n = 473) had regular timeliness of notification (n = 303), poor timeliness of treatment (n = 381), optimal or regular proportions of cases tested for microscopy (n = 473), poor proportions of treatment adherence (n = 234) and of cases tested for HIV (n = 234). Among the micro-regions with optimal proportions of people tested for HIV (n = 129), only 18.6% (n = 24) showed poor timeliness of notification and 37.2% (n = 48) presented poor performance in terms of adherence to treatment. By contrast, among micro-regions with poor proportions of microscopy (n = 57), 38.6% (n = 22) had poor timeliness of notification and 52.6% (n = 30) presented high proportions of treatment non-adherence.

Three groups of micro-regions had similar surveillance systems. The first cluster (n = 109) was made up of micro-regions with the worst mean timeliness of treatment and notification, 24.9% and 62.8%, respectively. This cluster had the second worst mean rate of individuals tested for HIV (60.2%), approximately five percentage points above the same rate in Cluster 2.

The second cluster (n = 143) presented a mean timeliness of notification, mean percentage of individuals tested for microscopy and mean percentage of individuals who adhered to treatment of around 80%. However, the mean timeliness of treatment was 49.7%, the second worst performance for this indicator, after Cluster 1.

Cluster 3 (n = 221) had a mean percentage of cases tested for microscopy and mean percentage of adherence to treatment equal to approximately 91%. The mean percentage of individuals tested for HIV and the mean timeliness of notification for this Cluster were 81.8% and 81.2%, respectively. The mean timeliness of treatment for this group, however, was 61.0%.

Cluster 1 micro-regions were mainly located in the center-north of the country. This band encompasses the south of the state of Goiás, passing through Mato Grosso, Tocantins, Maranhão, reaching Rio Grande do Norte, Paraíba, Alagoas, Sergipe and part of the state of Bahia. Cluster 2 micro-regions are mainly found in the states of Amazonas, Pará, Mato Grosso, Goiás, Minas Gerais, Rio de Janeiro and Rio Grande do Sul. Finally, Cluster 3 micro-regions are found in the South of Brazil, in São Paulo, Mato Grosso do Sul, Espírito Santo, part of Tocantins and part of the North region, in particular Acre and Rondônia.

Clusters 1 and 3 showed no overlapping when a dispersion graph of the main components was used to compare them. There was some overlapping between Clusters 1 and 2 and slightly greater overlapping between Clusters 2 and 3.

Discussion

The consistency of the tuberculosis information system was optimal in almost all Brazilian micro-regions between 2012 and 2014. However, the completeness of contacts investigated and 2nd and 6th months microscopy needs to improve. Timeliness of notification was regular and timeliness of treatment poor in most micro-regions. Furthermore, the percentage of cases that fully adhered to treatment and cases that were tested for HIV was poor in approximately 40% of units analyzed. A low performance Cluster was identified relating to the following indicators: timeliness of notification, timeliness of treatment and percentage of cases tested for HIV in the center-north region of Brazil.

It is important to highlight that other methods of analyzing clusters presented convergence issues. This is because the performance of the micro-regions was similar in terms of timeliness and acceptability, making it difficult to identify the structure of the cluster. Given the size and diversity of Brazil, similar results in themselves point to possible failures in the entry of surveillance tools.

The results of this study were consistent with those observed in other studies. The percentage of inconsistency of new TB cases in Rio de Janeiro between 2001 and 2006 was equal or less than 3%¹². Furthermore, a study conducted in the Brazilian urban centers with the greatest TB load revealed that between 2001 and 2006, microscopy variables in the 2^nd, 4^th and 6^th months had the lowest proportions of entries in the TB information system³¹. In 2008, the states of Acre, Roraima, São Paulo and Mato Grosso do Sul presented good results in terms of linkage and the analysis of record duplication¹⁶. These findings, though for other indicators, corroborate the good quality found in this study of the Acre and Roraima information systems.

In some parts of the country, the low quality of the information system restricts TB epidemiological analysis. This may be partly connected to health professionals’ lack of understanding of the importance of the records that feed the system. It is important that professionals understand that records are strategic tools to combat TB, and not PNCT bureaucratic requirements³². A change in paradigm would allow local programs to routinely follow PNCT recommended practice, such as data linkage and completeness and consistency analysis.

From 2005 to 2008, approximately 55% of TB cases were notified on the same day of the diagnosis¹⁹. 2012 to 2014 findings suggest an improvement in the timeliness of notification in the country. The timeliness of treatment in Brazil was approximately 70% between 2005 and 2008¹⁹. When comparing poor micro-region performance in the years from 2012 to 2014, there is no evidence of a gain in the timeliness of treatment over time.

Difficulties in improving the timeliness of treatment may be related to the poor skills of care teams. In João Pessoa, one of the weaknesses in controlling tuberculosis in 2007 was the lack of training vacancies and the irregularity of courses provided by the state³³. An evaluation study conducted in five municipalities in 2011 also found that professional training for TB surveillance was inadequate³⁴.

From 2001 to 2005 there was a reduction in TB treatment non-adherence, followed by its stabilization at around 10.0% between 2006 and 2009³⁵. The relationship between patients and health professionals is important for appropriate treatment closure. Studies showed that a high turnover of primary care staff hinders the establishment of these relationships^33,36. High staff turnover is linked to low salaries and inadequate working conditions³⁷. Therefore, an improvement in the TB surveillance system is associated to the professional recognition of staff.

External factors affecting the surveillance system such as the costs of tuberculosis and loss of income due to lower productivity are associated to low levels of treatment adherence³⁸. Thus, in socially disadvantaged regions, surveillance systems should provide care at times that do not clash with times when individuals have to work³⁵. In addition, basic food baskets, free transport and other social protection services for TB patients should be provided in partnership with local governments.

In Brazil, the percentage of cases tested for HIV has risen from 25.8% in 2001 to 55.8% in 2010³⁵. Although these results are an improvement over time, they are still inadequate vis-à-vis Ministry of Health’s targets²⁸ and corroborate the findings in this study.

Primary basic care structure is extremely important for the improvement of the TB surveillance system. The percentage of cases tested for HIV in Brazilian capitals in 2013 was higher than for those cases treated at the primary care level outside state capitals²². Furthermore, the increase in the coverage of Family Health Teams in Curitiba between 2000 and 2009 was linked to a reduction in the percentage of TB treatment non-adherence³⁹.

Nevertheless, primary health care is experiencing difficulties in incorporating tuberculosis control responsibilities. In João Pessoa, in 2009, the percentage of suspected TB cases and high levels of test referrals were found to be insatisfactory⁴⁰. In São Carlos, in 2009, a large number of health community agents had basic knowledge of TB control measures, but believed that the disease is transmitted through household utensils⁴¹.

Between 2001 and 2003, the states that presented the worst surveillance in terms of the quality of information, detection and follow up of TB cases were Pernambuco, Ceará and Bahia, in the Northeast, and Amazonas, Pará and Amapá in the North¹⁰. In this study, the Northeast states are mainly found in Cluster 1, where TB surveillance needs to be prioritized, and the states of the North are found mainly in Cluster 2, where TB is only given average priority. These results reflect the deep geographic inequalities of Brazil, as well as the need for greater investment in the more disadvantaged areas, where there may be a need for differentiated surveillance measures.

Although there is no universal consensus on the best method for evaluating TB surveillance systems, the CDC guidelines are well-established in terms of evaluating surveillance systems in general⁴². In order to adapt them to the Brazilian context, only satisfactory completeness indicators were employed in regions where there were no serious completeness issues. Given this evaluation involved the analysis of secondary data, some CDC (2001) attributes¹⁵, such as sensitivity and predictive value positive could not be assessed.

Nevertheless, the use of secondary data and CDC guidelines ensured the evaluation was comprehensive, both in geographic terms and in terms of the attributes studied. The use of CDC’s quantitative attributes could be reproduced by local surveillance systems, given their low-cost and the fact that this evaluation involves a continuous monitoring method.

Timeliness of typing and of closure indicators were not used for cluster analysis due to the low level of completeness in São Paulo. Given that the completeness of other variables was considered satisfactory in this state, which has its own register for tuberculosis cases, the TBWEB¹⁴, it is possible that there may have been a failure in data transmission between the state and the national systems. Thus, a revision of data transmission between the TBWEB and SINAN is recommended.

Another limitation of this study was the fact that the cluster analysis did not include the percentage of cases followed up with directly observed therapy (DOT) and the percentage of contacts investigated among those identified. Although there are Ministry of Health guidelines regarding the definition of “conducted DOT”²⁵, in practice, there are different understandings of this concept in the various micro-regions. The meaning of “conducted DOT” can change, for example, according to who supervises the treatment (health professional, relative, etc.) and the entry date of this variable vis-à-vis the treatment starting date. Furthermore, contacts investigated could not be estimated due to the low rates of data completeness. The distribution of guidebooks on the importance of these indicators is recommended. It should include detailed explanations on the meaning of these variables and how they should be entered.

It is important to consider as a limitation of this study the fact that consistency analysis was based on only one scenario. Some of the indicators chosen by the specialists were not assessed due to the small number of cases in the indicator interest group in the micro-regions. It was not possible to calculate consistency in the following scenarios: 1) exclusive extrapulmonary forms with negative or no microscopy and 2) less than five years with results of first microscopy(negative or not conducted). The inclusion of these scenarios in studies on TB surveillance systems is recommended in more extensive units of analysis, such as Units of the Federation (states) or macro-regions.

Although micro-regions restrict the implementation of suggestions and comparability, this approach enabled the dissemination of data with lower internal heterogeneity and higher external heterogeneity in comparison with analyses by states. Furthermore, the analysis level chosen resulted in the exclusion of only 1% (n = 6) of micro-regions, due to the small number of notified cases during the three-year period studied. An analysis by municipalities could have resulted in the exclusion of a higher percentage of analysis units.

Finally, given the importance of TB surveillance indicators, we recommend the establishment of national and regional targets. In particular for the Tripartite Resolutions and the National Plan for Combatting Tuberculosis. This will enable the follow up and self-assessment of local managers and the attainment of greater clarity of outcomes. Although some indicators are part of national pacts²⁸, their inclusion in the Tripartite Resolution could have a positive impact on the funding of the TB surveillance system⁴³.

In conclusion, this study identified priority areas for improving the tuberculosis surveillance system, particularly in the states of Mato Grosso and Rio Grande do Norte. Furthermore, it revealed system weaknesses, not only in these regions, but across the country, such as low timeliness of treatment and inadequate entry of contacts investigated. The findings of this work can contribute to the decision-making of managers so as to improve the tuberculosis surveillance system in Brazil. The study stresses that the system’s improvement requires an increase in the training and the recognition of health professionals, and the strengthening of primary health care, indirectly resulting in an increase in the social protection of people diagnosed with this disease.

Chart 1
Indicators chosen by specialists to analyze the tuberculosis epidemiological surveillance system in Brazilian micro-regions between 2012 and 2014, per attribute.

Attributes	N.	Indicator	Form of Calculation	L1*	L2*
Completeness	1	Start of treatment date	Percentage (%) of case entries with start of treatment date	70	90
	2	Number of contacts investigated	Percentage (%) of case entries with number of contacts investigated	70	90
	3	Closure situation	Percentage (%) of case entries with closure situation	70	90
	4	2nd month microscopy	Percentage (%) of case entries with 2nd month microscopy status	70	90
	5	6th month microscopy	Percentage (%) of case entries with 6th month microscopy status	70	90
General Completeness			Indicators Median 1 to 5	70	90
Consistency	6	Notification date greater or equal to diagnosis date	Percentage (%) of cases with notification date greater or equal to diagnosis date	70	90
Timeliness	7	Timeliness of notification	Percentage of cases with an interval between notification date and diagnosis date smaller or equal to 7 days	70	90
	8	Timeliness of typing	Percentage of cases with an interval between typing date and notification date smaller or equal to 30 days	70	90
	9	Timeliness of treatment	Percentage (%) of cases with an interval between the date of starting treatment and diagnosis of less than 1 day	70	90
	10	Timeliness of closure	Percentage (%) of non-resistant cases notified between 2012 and 2012 with interval between closure date and the start of treatment between 180 and 270 days	70	90
Acceptability	11	Investigated contacts among identified cases	Percentage (%) investigated contacts among identified cases with information on investigated and identified contacts	70	90
	12	New pulmonary cases that underwent microscopy	Percentage (%) of new pulmonary tuberculosis cases that underwent sputum smear microscopy	80	90
	13	Pulmonary cases that fully adhered to treatment	Percentage (%) pulmonary tuberculosis cases without primary default or treatment defaut	90	95
	14	HIV test	Percentage (%) of cases tested for HIV (excludes ongoing HIV in the numerator)	70	85

• *Limits L1 or L2 were used for classifying the variables in the following groups: poor performance (value < L1%), regular (value ≥ L1% and < L2%), optimal (value ≥ L2%)
• Source: produced for this study.

Figure 3
Cluster of Brazilian microregion according to timeliness and acceptability indicators of the tuberculosis surveillance system, 2012-2014*.

Acknowledgments

Capes - Brazilian Federal Agency for the Support and Evaluation of Graduate Education for providing PhD grants and PhD sandwich grant to GDM Silva.

Referências

• ¹
  Sales CMM, Nunes GF, Rogério W, Castro T, Santos BR, Maciel ELN. Tuberculose e a questão social: uma revisão sistemática de estudos brasileiros. Rev Bras Pesq Saúde 2015; 17(4):156-175.
• ²
  San Pedro A, Oliveira RM. Tuberculose e indicadores socioeconômicos: revisão sistemática da literatura. Rev Panam Salud Publica 2013; 33(4):294-301.
• ³
  Brasil. Emenda Constitucional n^o 95 de 15 de dezembro de 2016. Altera o Ato das Disposições Constitucionais Transitórias, para instituir o Novo Regime Fiscal, e dá outras providências. Diário Oficial da União 2016; 16 dez.
• ⁴
  Ministério da Saúde (MS). Indicadores prioritários para o monitoramento do Plano Nacional pelo Fim da Tuberculose como Problema de Saúde Pública no Brasil. Boletim Epidemiológico 2017; 48(8).
• ⁵
  Ministério da Saúde (MS). Perspectivas brasileiras para o fim da tuberculose como problema de saúde pública. Boletim Epidemiológico 2016; 47(13).
• ⁶
  Maciel ELN. Estratégias da agenda pós-2015 para o controle da tuberculose no Brasil: desafios e oportunidades. Epidemiol Serv Saude 2016; 25(2):423-426.
• ⁷
  Brasil. Ministério da Saúde (MS). Manual de Recomendações para o controle da Tuberculose no Brasil Brasília: MS; 2011.
• ⁸
  Ministério da Saúde (MS). Secretaria de Vigilância em Saúde. Detectar, tratar e curar: desafios e estratégias brasileiras frente à tuberculose. Boletim Epidemiológico 2015; 46(9).
• ⁹
  Brasil. Ministério da Saúde (MS). Saúde Brasil 2013: uma análise da situação de saúde e das doenças transmissíveis relacionadas à pobreza Brasília: MS; 2014.
• ¹⁰
  Braga JU. Vigilância epidemiológica e o sistema de informação da tuberculose no Brasil, 2001-2003. Rev Saude Publica 2007; 41(Supl. 1):77-87.
• ¹¹
  Maciel ELN, Sales CMM. A vigilância epidemiológica da tuberculose no Brasil: como é possível avançar mais? Epidemiol Serv Saúde 2016; 25(1):175-178.
• ¹²
  Oliveira PB, Oliveira GP, Codenotti SB, Saraceni V, Nóbrega AA, Sobel J. Avaliação do sistema de vigilância da tuberculose no município do Rio de Janeiro, 2001 a 2006. Cad Saúde Coletiva 2010; 18(3):337-346.
• ¹³
  Gonçalves MJF. Avaliação de Programa de Saúde: O Programa Nacional de Controle de Tuberculose no Brasil. Sau & Transf Soc 2012; 3(1):13-17.
• ¹⁴
  Arakawa T, Magnabosco GT, Andrade RLP, Brunello MEF, Monroe AA, Ruffino-Netto A, Scatena LM, Villa TCS. Programa de controle da tuberculose no contexto municipal: avaliação de desempenho. Rev Saude Publica 2017; 51:23.
• ¹⁵
  Centers for Disease Control and Prevention (CDC). Updated guidelines for evaluating public health surveillance systems: recommendations from the guidelines working group. MMWR 2001; 50(RR-13).
• ¹⁶
  Bartholomay P, Oliveira GP, Pinheiro RS, Vasconcelos AMN. Melhoria da qualidade das informações sobre tuberculose a partir do relacionamento entre bases de dados. Cad Saude Publica 2014; 30(11):2459-2469.
• ¹⁷
  Oliveira GP, Codenotti SB, Barreira D, Pinheiro RS, Coeli CM. Linkage entre SIM e SINAN para a melhoria da qualidade dos dados do Sistema de Informação da tuberculose: a experiência nacional. Cad Saúde Coletiva 2010; 18(1).
• ¹⁸
  Oliveira GP, Pinheiro RS, Coeli CM, Barreira D, Codenotti SB. Uso do sistema de informação sobre mortalidade para identificar subnotificação de casos de tuberculose no Brasil. Rev Bras Epidemiol 2012; 15(3):468-477.
• ¹⁹
  Mandacarú PMP. Oportunidade do sistema de vigilância da dengue, doenças exantemáticas, meningite e tuberculose no Brasil [dissertação]. Goiânia: Universidade Federal de Goiás; 2012.
• ²⁰
  Lírio M, Santos NP, Passos LAR, Kritski A, Galvão-Castro B, Grassi MFR. Completude das fichas de notificação de Tuberculose nos municípios prioritários da Bahia para controle da doença em indivíduos com HIV/AIDS. Cien Saude Colet 2015; 20(4):1143-1148.
• ²¹
  Medeiros D, Sucupira ED, Guedes RM, Costa A. Análise da qualidade das informações sobre tuberculose no município de Belford Roxo, Rio de Janeiro, 2006 a 2008. Cad Saúde Coletiva 2012; 20(2):146-152.
• ²²
  Bartholomay P, Pelissari DM, Araujo WN, Yadon ZE, Heldal E. Quality of tuberculosis care at different levels of health care in Brazil in 2013. Rev Panam Salud Pública 2016; 39(1):3-11.
• ²³
  Mendonça SA, Franco SC. Avaliação do risco epidemiológico e do desempenho dos programas de controle de tuberculose nas Regiões de Saúde do estado de Santa Catarina, 2003 a 2010. Epidemiol Serv Saúde 2015; 24(1):59-70.
• ²⁴
  Brasil. Ministério da Saúde (MS). Roteiro para análise da base de dados de tuberculose do sistema de informação de agravos de notificação - SINAN e cálculo de indicadores básicos Brasília: MS; 2006.
• ²⁵
  Ministério da Saúde. Secretaria de Vigilância em Saúde. Sistema de Informação de Agravos de Notificação: Dicionário de Dados – SINAN NET – Versão 5.0.
• ²⁶
  Dias JA. Avaliação do sistema de vigilância da tuberculose, Porto Alegre/RS, 2006-2009. 5o Encontro Científico do Programa de Treinamento em Epidemiologia Aplicada aos Serviços do Sistema Único de Saúde (EPISUS); 2011; Brasília.
• ²⁷
  Brasil. Ministério da Saúde (MS). Instrutivo para preenchimento da Programação das Ações de Vigilância em Saúde nas unidades federadas – 2010 – 2011: Tuberculose Brasília: MS; 2010.
• ²⁸
  Ministério da Saúde. Secretaria de Vigilância em Saúde. Instrutivo Programa de Ações do Sistema Nacional de Vigilância em Saúde, 2013-2015. [Internet]. 2013 [citado 2017 maio 29]. Disponível em: http://www.saude.pi.gov.br/pactuacao2013/pavs2013/Instrutivo-SNVS-2013.pdf
  » http://www.saude.pi.gov.br/pactuacao2013/pavs2013/Instrutivo-SNVS-2013.pdf
• ²⁹
  Husson F, Le S, Pagés J. Exploratory multivariate analysis by example using R Boca Raton: CRC Press; 2011.
• ³⁰
  Kassambara A. Hybrid hierarchical k-means clustering for optimizing clustering outputs [Internet]. 2015. [citado 2017 maio 29]. Disponível em: http://www.sthda.com/english/wiki/hybrid-hierarchical-k-means-clustering-for-optimizing-clustering-outputs
  » http://www.sthda.com/english/wiki/hybrid-hierarchical-k-means-clustering-for-optimizing-clustering-outputs
• ³¹
  Malhão TA, Oliveira GP, Codennoti S, Moherdaui F. Avaliação da completitude do Sistema de Informação de Agravos de Notificação da Tuberculose, Brasil, 2001-2006. Epidemiol Serv Saúde 2010; 19(3):245-256.
• ³²
  Santos NP, Lírio M, Passos LAR, Dias JP, Kritski AL, Castro Filho BG, Grassi MFR. Completude das fichas de notificações de tuberculose em cinco capitais do Brasil com elevada incidência da doença. J Bras Pneumol 2013; 39(2):221-225.
• ³³
  Sá LD, Oliveira AAV, Gomes ALC, Nogueira JA, Villa TCS, Collet N. Cuidado ao doente de tuberculose na Estratégia Saúde da Família: percepções de enfermeiras. Rev esc enferm USP 2012; 46(2):356-363.
• ³⁴
  Scatena LM, Wysocki AD, Beraldo AA, Magnabosco GT, Brunello MEF, Netto AR, Nogueira JA, Sobrinho RAS, Brito EWG, Alexandre PBD, Monroe AA, Villa TCS. Validação e confiabilidade: instrumento para avaliação de serviços que tratam tuberculose. Rev Saude Publica 2015; 49(7):1-11.
• ³⁵
  Oliveira GP, Torrens AW, Bartholomay P, Barreira D. Tuberculosis in Brazil: last ten years analysis – 2001-2010. Braz J Infect Dis 2013; 17(2):218-233.
• ³⁶
  Reis SP, Harter J, Lima LM, Vieira DA, Palha PF, Gonzales RIC. Aspectos geográficos e organizacionais dos serviços de atenção primária à saúde na detecção de casos de tuberculose em Pelotas, Rio Grande do Sul, 2012. Epidemiol Serv Saude 2017; 26(1):141-148.
• ³⁷
  Cunha NV, Cavalcanti MLT, Costa AJL. Diagnóstico situacional da descentralização do controle da tuberculose para a Estratégia Saúde da Família em Jardim Catarina - São Gonçalo (RJ), 2010. Cad Saúde Colet 2012; 20(2):177-187.
• ³⁸
  Mauch V, Bonsu F, Gyapong M, Awini E, Suarez P, Marcelino B, Melgen RE, Lönnroth K, Nhung NV, Hoa NB, Klinkenberg E. Free tuberculosis diagnosis and treatment are not enough: patient cost evidence from three continents. Int J Tuberc Lung Dis 2013; 17(3):381-387.
• ³⁹
  Marquieviz J, Alves IS, Neves EB, Ulbricht L. A Estratégia de Saúde da Família no controle da tuberculose em Curitiba (PR). Cien Saude Colet 2013; 18(1):265-271.
• ⁴⁰
  Paiva RCG, Nogueira JA, Sá LD, Nóbrega RG, Trigueiro DRSG, Villa TCS. Acessibilidade ao diagnóstico de tuberculose em município do Nordeste do Brasil: desafio da atenção básica. Rev Eletr Enf 2014; 16(3):520-526.
• ⁴¹
  Sobrinho ECR, Freitas KG, Figueiredo RM, Caliari JDS. A tuberculose na estratégia de saúde da família: o conhecimento dos agentes comunitários de saúde. Rev Eletr Enf 2013; 15(2):416-421.
• ⁴²
  Drewe JA, Hoinville LJ, Cook AJC, Floyd T, Stärk KDC. Evaluation of animal and public health surveillance systems: a systematic review. Epidemiol Infect 2012; 140(4):575-590.
• ⁴³
  Rede Brasileira de Pesquisa em Tuberculose. Nota Pública contra a retirada de indicadores da Tuberculose nas pactuações do SUS [Internet]. 2017. [citado 2017 maio 29]. Disponível em: http://www.redetb.org/index.php/242-nota-publica-contra-a-retirada-de-indicadores-da-tuberculose-nas-pactuacoes-do-sus
  » http://www.redetb.org/index.php/242-nota-publica-contra-a-retirada-de-indicadores-da-tuberculose-nas-pactuacoes-do-sus

Publication Dates

• Publication in this collection
  Oct 2017

History

• Received
  30 May 2017
• Accepted
  26 June 2017
• Reviewed
  17 July 2017