Validity of food and beverage intake data obtained by telephone survey

Abstracts

OBJETIVO: Avaliar a reprodutibilidade e a validade de indicadores do consumo de alimentos e bebidas obtidos por sistema de vigilância baseado em inquéritos telefônicos. MÉTODOS: Foram realizadas análises de reprodutibilidade e validade em duas subamostras aleatórias (n=112 e n=109, respectivamente) da amostra total (N=2.024) de adultos (>18 anos) estudada pelo sistema em 2005 no município de São Paulo. Os indicadores avaliados incluíram fatores de proteção (consumo diário ou quase diário de frutas e hortaliças) e de risco (consumo diário ou quase diário de refrigerantes, consumo habitual de alimentos fontes de gorduras saturadas de origem animal, e consumo abusivo de bebidas alcoólicas) para doenças crônicas. Para a análise de reprodutibilidade compararam-se resultados obtidos a partir da entrevista telefônica original do sistema e de outra entrevista idêntica repetida após sete a 15 dias. Para a análise de validade compararam-se resultados obtidos a partir da entrevista telefônica original e de três recordatórios de 24 horas (padrão-ouro) realizados até 15 dias após a entrevista original. RESULTADOS: A freqüência dos indicadores estudados mostrou-se relativamente constante entre a primeira e a segunda entrevistas telefônicas e os coeficientes kappa se situaram entre 0,57 e 0,80, indicando boa reprodutibilidade de todos os indicadores. Relativamente ao padrão-ouro, evidenciou-se tendência de superestimação na freqüência do consumo de alimentos protetores, mas não na freqüência de alimentos associados a risco para doenças crônicas. Sensibilidade e especificidade foram elevadas para indicadores do consumo de alimentos associados a risco (próximas a 80%) e variáveis no caso de alimentos protetores (entre 42% e 80%). CONCLUSÕES: A avaliação indicou boa reprodutibilidade e adequada validade para a maioria dos indicadores empregados pelo sistema, o que indica que a manutenção da sua operação nos próximos anos oferecerá ao Brasil um útil instrumento para avaliação de políticas publicas de promoção da alimentação saudável e controle das doenças crônicas não transmissíveis relacionadas à alimentação.

Consumo de Bebidas Alcoólicas; Consumo de Alimentos; Validade dos Testes; Inquéritos Nutricionais; Vigilância Nutricional

ORIGINAL ARTICLES

Validity of food and beverage intake data obtained by telephone survey

Validez de indicadores de consumo de alimentos y bebidas obtenidas por encuesta telefónica

Carlos Augusto Monteiro^{I, II}; Erly Catarina Moura^{I, III}; Patrícia Constante Jaime^{I, II}; Rafael Moreira Claro^{I, II}

^INúcleo de Pesquisas Epidemiológicas em Nutrição e Saúde. Universidade de São Paulo. São Paulo, SP, Brasil

^IIDepartamento de Nutrição. Faculdade de Saúde Pública. Universidade de São Paulo. São Paulo, SP, Brasil

^IIIUniversidade Federal do Pará. Belém, PA, Brasil

^{Correspondence}

ABSTRACT

OBJECTIVE: To evaluate the reproducibility and validity of data on food and beverage intake obtained by means of a telephone-based surveillance system.

METHODS: Reproducibility and validity analyses were carried out in two random subsamples (n=112 and n=119, respectively) of the total sample (N=2,024) of adults (>18 years) studied by the system in 2005 in the municipality of São Paulo, Southeastern Brazil. Indicators evaluated included protective factors (daily or almost daily intake of fruit and vegetables) and risk factors (daily or almost daily intake of soft drinks, frequent intake of foods containing saturated animal fat, and abusive intake of alcoholic beverages) for the development of chronic diseases. Reproducibility was studied by comparing the results of the original telephonic interview with those of another interview carried out 7-15 days later. Validity was analyzed by comparing the results of the telephone interview with those of three 24-hour recalls (our gold-standard) carried out up to 5 days following the original interview.

RESULTS: The frequency of the studied indicators remained relatively constant between the first and second telephone interviews, with kappa coefficients ranging from 0.57 to 0.80, indicating good reproducibility for all indicators. In relation to the gold standard, there was a trend towards overestimating the frequency of intake of protective foods, but of foods associated with increased risk of chronic diseases. Sensitivity and specificity were high for indicators of consumption of risk-associated foods (close to 80%), and variable in the case of protective foods (42% to 80%).

CONCLUSIONS: The evaluation showed evidence of good reproducibility and adequate validity for most indicators employed in the system, which indicates that maintaining this system operational in coming years will provide a useful instrument for evaluating public policies for the promotion of a healthy diet and for control of non-communicable chronic diseases with a dietary component in Brazil.

Descriptors: Alcohol Drinking. Food Consumption. Validity of Tests. Nutrition Surveys. Nutritional Surveillance.

RESUMEN

OBJETIVO: Evaluar la reproducibilidad y validez de indicadores de consumo de alimentos y bebidas obtenidos por sistema de vigilancia basado en encuestas telefónicas.

MÉTODOS: Fueron realizadas análisis de reproducibilidad y validez en dos submuestras aleatorias (n=112 y n=109, respectivamente) de la muestra total (N=2.024) de adultos (>18 anos) estudiada por el sistema en 2005 en el municipio de Sao Paulo. Los indicadores evaluados incluyeron factores de protección (consumo diario o casi diario de frutas y hortalizas) y de riesgo (consumo diario o casi diario de bebidas gaseosas, consumo habitual de alimentos fuentes de grasas saturadas de origen animal, y consumo abusivo de bebidas alcohólicas) para enfermedades crónicas. Para el análisis de reproducibilidad se compararon resultados obtenidos a partir de la encuesta telefónica original del sistema y de otra encuesta idéntica repetida después de siete a 15 días. Para el análisis de validez se compararon resultados obtenidos a partir de la encuesta telefónica original y de tres recordatórios de 24 horas (padrón-oro) realizados hasta 15 días después de la encuesta original.

RESULTADOS: La frecuencia de los indicadores estudiados se mostró relativamente constante entre la primera y la segunda encuesta telefónica y los coeficientes kappa se situaron entre 0,57 y 0,80, indicando buena reproducibilidad de todos los indicadores. Relativamente al padrón oro, se evidenció tendencia de súper estimación en la frecuencia de consumo de alimentos protectores, pero no en la frecuencia de alimentos asociados a riesgo para enfermedades crónicas. Sensibilidad y especificidad fueron elevadas para indicadores de consumo de alimentos asociados a riesgo (próximas a 80%) y variables en el caso de alimentos protectores (entre 42% e 80%).

CONCLUSIONES: La evaluación indicó buena reproducibilidad y adecuada validez para la mayoría de los indicadores empleados por el sistema, lo que indica que la manutención de su operación en los próximos años ofrecerá al Brasil un útil instrumento para evaluación de políticas públicas de promoción de la alimentación saludable y control de las enfermedades crónicas no transmisibles relacionadas a la alimentación.

Descriptores: Consumo de Bebidas Alcohólicas. Consumo de Alimentos. Validez de las Pruebas. Vigilancia Nutricional.

INTRODUCTION

Non-transmissible chronic diseases (NTCDs) play an important role in the current health profile of human populations. Estimates from the World Health Organization (WHO) indicate that these diseases are responsible for 58.5% of all deaths worldwide, and 45.9% of the global burden of disease.¹⁷ In Brazil, NTCDs account for 62.8% of all deaths for which the cause is known.^a Time series of mortality statistics available for Brazilian state capitals indicate that the proportion of NTCD deaths increased more than three-fold between the 1930's and 1980's.⁶ WHO global estimates also indicate that a limited number of risk factors accounts for the great majority of NTCD deaths and for a substantial fraction of the disease burden related to such diseases. Noteworthy among these factors, in addition to smoking and obesity, are food and beverage intake characteristics and physical activity patterns.¹⁷

Since 2006, a surveillance system has been operational in Brazil that monitors the frequency and distribution of NTCD risk factors in the capitals of the 26 Brazilian states as well as in the Federal District. This system, which is called Vigilância de Fatores de Risco e Proteção para Doenças Crônicas não Transmissíveis por Inquérito Telefônico (VIGITEL - Risk Factor Surveillance for Non-Transmissible Chronic Diseases by Telephone Survey), is based on telephone interviews carried out continuously in probabilistic samples of the adult population with access to telephone in each of these cities. Estimates are adjusted for differences in the sociodemographic composition of these samples in relation to the composition of each city's total adult population.

METHODS

The study employed subsamples extracted from the entire sample (N=2.204) of subjects studied by the VIGITEL system in the city of São Paulo in 2005. Sampling procedures for this system, described in detail in a previous publication,8,^b ensure that, in each city, representative samples of the population of individuals aged 18 years or older living in households with telephone are selected. Two systematic subsamples (n=115), with proportion of men and women similar to that of the whole sample, were randomly selected for participation in reproducibility and validity studies. Three subjects in the reproducibility subsample and six in the validity subsample refused to participate in these studies or did not complete the required interviews. The final study sample comprised 112 subjects (44 men and 68 women) for the reproducibility study and 109 subjects (47 men and 62 women) for the validity study. Distribution in terms of age and schooling among men and women included in the reproducibility and validity studies did not differ significantly from the distributions seen in the entire sample of men and women surveyed by the VIGITEL system in the city of São Paulo in 2005 (chi-square test with 5% significance level).

We evaluated indicators of food and beverage intake associated with protection or increased risk of NTCDs. Factors associated with protection were daily or almost daily (> 5 days per week) intake of fruit, vegetables (including greens and other vegetables but excluding tubers such as potato and manioc), as well as fruit and vegetables combined. Indicators associated with risk were frequent intake (thus referred by the subject) of foods rich in saturated fats (red meet with excess fat without removal of visible fat or poultry with skin, and whole milk), daily or almost daily intake of non-sugar-restricted soft drinks (at least one can in > 5 days per week) and abusive intake of alcoholic beverages (ingestion of over four doses for women or over five doses for men in a same day during the last 30 days, considering one dose of alcoholic beverage as equivalent to one beer, one glass of wine, or one dose of distilled spirits).

For the reproducibility study, subjects were contacted by phone seven to 15 days after having participated in the system's original interview, when they were asked to respond once again to the block of questions on food and beverage intake. The second interviewer was always different from that which had conducted the first interview. The results obtained in the two interviews were compared in terms of the proportion of subjects exposed and the agreement between the individual classification of each subject with respect to exposure or not to the factor under study. In this latter case, the degree of agreement between the two interviews was evaluated using the kappa coefficient, classified as follows: above 0.80, almost perfect agreement; between 0.61 and 0.80, substantial agreement; between 0.41 and 0.60, moderate agreement; between 0.21 and 0.80, fair agreement; and below 0.21, slight agreement.⁵

For the study of validity, subjects underwent three 24-hour dietary recalls, carried out also by telephone within a seven-day period up to 15 days after the original interview by the system. Two of the recalls referred to weekdays, and one to a Saturday, Sunday, or holiday. This 24-hour recall consisted in requesting that the subject inform the type and amount of food and drink consumed in the last 24 hours.¹ If the spontaneous report failed to contain mention of consumption of one or more of the items of interest (fruit, vegetables, red meat, poultry, milk, soft drinks, and alcoholic beverages), we asked the subject directly about the occasional consumption of the item or items not mentioned.

In the case of red meat, we asked subjects whether there was any visible fat in the portion served, and whether or not this fat was ingested. For poultry, we asked whether skin was present in the serving and whether or not it was ingested. For milk, we asked whether it was whole, reduced fat, or fat free. For soft drinks, we asked about the amount and type ingested (with or without sugar restriction), and for alcoholic beverage consumption, we asked about the amount of doses ingested.

The validity study consisted in comparing results obtained in the standard VIGITEL telephone interview with the three 24-hour recalls (gold-standard) in terms of the proportion of individuals exposed to the factor of interest and the accuracy of the telephone interview in classifying individuals based on their true exposure status as determined by the gold-standard. We considered as truly exposed to daily or almost daily intake of fruit, vegetables, and soft drinks subjects with recorded consumption of these items in at least two out of three 24-hour recalls. In the case of frequent intake of red meat without removal of visible fat, poultry with skin, or whole milk, we considered as exposed subjects with recorded consumption of these items in at least one of three 24-hour recalls. We considered as exposed to abusive intake of alcoholic beverages subjects that reported daily consumption of more than four (women) or more than five (men) doses in at least one of three 24-hour recalls.

To evaluate the ability of the telephone interview to correctly classify individuals truly exposed to the factor according to the gold-standard, we calculated the proportion of these subjects diagnosed as exposed in the telephone interview (sensitivity of the telephone interview). To evaluate the telephone interview's ability to correctly classify subjects truly unexposed to the factor as established by the gold-standard, we calculated the proportion of these subjects that were not diagnosed as exposed in the telephone interview (specificity of the telephone interview).

In addition, based on the three 24-hour recalls, we estimated the weekly frequency of intake (days per week) of each of the foods and drinks of interest for each subject. We thus multiplied by 2.5 the number of weekdays, and by 2.0 the number of Saturdays, Sundays, or holidays, with recorded consumption for each type of food and drink. We then calculated, by interpolation, the median weekly frequency of intake of a given food or drink among subject classified by the telephone interview as either exposed or unexposed to the critical frequency of intake defined for that indicator (>5 days per week for fruit, vegetables, and soft drinks; >1 day in the preceding month for abusive intake of alcoholic beverages; and frequent intake for the remaining indicators). The statistical significance of the difference between the two groups was evaluated using the test of difference in medians.⁷

The study was approved by the Research Ethics Committee of the Faculdade de Saúde Pública da Universidade de São Paulo.

RESULTS

Table 1 compares the frequencies of indicators of food and beverage intake estimated based on the original VIGITEL interviews and on repeat interviews with the same subjects carried out by other interviewers seven to 15 days after the first one. Differences were negligible with respect to intake of foods with high saturated fat content, soft drinks, and alcoholic beverages, and relatively minor with regard to fruit and vegetable intake. The kappa coefficient indicated "substantial" (0.61 to 0.80) agreement between interviews for all protective and risk factors, with the exception of simultaneous intake of fruit and vegetables, which showed "moderate" agreement (kappa = 0.57). There were variations between levels agreement for men and women, but these did not characterize systematic differences according to gender.

Table 2 compares the frequencies of food and beverage intake indicators estimated based on the original VIGITEL interview and on three 24-hour recalls with the same subjects carried out within a one-week period up to 15 days after the original interview. The frequency of indicators associated with protection against NTCDs was higher when estimated based on the telephone interview than when based on the 24-hour recalls, but differences were relatively small (46.8% vs. 38.5%; 61.5% vs. 55.1%; and 33.0% vs. 25.7% for fruit, vegetables, and both fruit and vegetables, respectively). Frequencies for NTCD risk factors obtained in the telephone interview were lower than those obtained in the 24-hour recalls for foods rich in saturated fat and higher for soft drinks and alcoholic beverages. Again, differences were of relatively small magnitude. Sensitivity of the telephone interview, using as a reference the 24-hour recalls, ranged from 46.4% for simultaneous intake of fruit and vegetables to 87.5% for soft drinks. Specificity based on the same reference ranged from 44.9% for vegetables to 94.1% for soft drinks. Reasonable levels of both sensitivity and specificity (close to or higher than 70%) were found for fruit, whole milk, soft drinks, and alcoholic beverages.

Table 3 presents estimates based on three 24-hour recalls for the median weekly frequency of intake of foods and beverages associated with protection or risk of NTCDs. In this Table, we compare the medians of individuals classified by the telephone interview as exposed or non-exposed to the critical intake frequency defined for each of the indicators. We found that median weekly frequency of intake of all foods and beverages was higher in the group of subjects that declared intake higher than the critical frequency in the telephone interview. With the exception of vegetables, differences between these subjects and the remainder tended to be substantial and statistically significant (p<0.05).

DISCUSSION

The present study shows that indicators of food and beverage intake obtained by means of telephone interviews through the VIGITEL system have good reproducibility, be it at the collective level (similar frequencies of risk factors in the population obtained through repeated interviews) or individual level (kappa coefficients compatible with substantial or moderate agreement in individual classification of exposure to risk factors). The good reproducibility indicates that interviews are conducted in a standardized fashion. This was expected, given the use of computer-assisted telephone interview system in which the interviewer is induced to read questions to the interviewee, thus avoiding interpretations or answer induction. It also indicates that interviewees understand the questions and have no difficulty in answering them, providing answers that remain consistent with time. What is expected from a surveillance system such as VIGITEL is the provision of estimates that, in addition to being accurate, are also reproducible, ensuring that time-related variations in indicators translate actual variation in the behavior of the population, rather than instability of the indicators.^2,13

The indicators employed yielded results that were in general close to those obtained using a method of greater accuracy. The validity of the indicators was evaluated at both the collective and individual levels. Collectively speaking, there was evidence of a trend towards overestimating the frequency of indicators of intake of fruit and vegetables, which may indicate that subjects are aware of the positive effects of these items on health. However, similar bias was not detected for the intake of items associated with risk. At the individual level, we found high levels of sensitivity and specificity for indicators of intake of risk-associated items (usually close to 80%) and unsteady levels for indicators of fruit and vegetable intake (ranging from 42% to 80%). On the other hand, with the exception of vegetables, the comparison of median weekly intake levels obtained using the three 24-hour recalls indicated expressive and statistically significant differences in favor of subjects classified by the VIGITEL system as exposed to the critical frequency of food or beverage intake. This indicates a good discrimination capacity for the simplified questionnaire used during the telephone interview. Poorer performance in estimating vegetable intake may be due to greater difficulty among subjects to recognize foods pertaining to this group. In the version of the questionnaire used by the system in 2007 we attempted to overcome this issue by providing greater detail in the questions on vegetable consumption.

The design employed for assessing reproducibility had no limitations, given that major sources of intra-subject and interviewer variation were accounted for by repeating the same interview with a different interviewer. Moreover, the kappa coefficient, used to evaluate the reproducibility of the telephone interview, is the most recommended measure for evaluating reproducibility of instruments that classify individuals as exposed or unexposed to a given condition.¹⁴

Common limitations among validity studies involve the use of inadequate gold-standards as well as the use of samples that are not representative of the population to which the indicators will be applied.¹⁴ Regarding the former, it would have been desirable for the present study to extend the gold-standard daily recall questionnaires to an entire week, or even a longer period in the case of the indicator of alcohol abuse, which uses a reference period of 30 days. The use of only three daily recalls as a gold-standard may have underestimated the validity of frequency questionnaires employed in VIGITEL, given that the measures obtained in frequency questionnaires refer to the subjects' usual diet whereas daily recalls only estimate the food intake in few and limited days.¹⁰ In any case, an increase in the reference period of daily recalls would likely be unfeasible, and could in fact compromise the quality of individual responses. Carrying out at least three 24 hour recalls in different days of the week is the procedure most widely used as a reference method for the validity evaluation of food frequency questionnaires.^1,16

Regarding the representativeness of our sample, the probabilistic selection of studied individuals ensures that the results obtained are applicable to the performance of VIGITEL throughout the city of São Paulo, but not necessarily to other Brazilian cities where this system is being implemented. In this sense, it will be important to carry out similar studies in at least one state capital of each of the country's five Great Regions. Two important strengths of the validity assessment conducted by the present study are the provision of estimates for the specificity and sensitivity of the indicators, a recommended procedure given the character of the evaluated indicators ,¹⁴ and the comparison of median weekly intake of food or beverage items among subjects classified as exposed or unexposed to the intake condition defined by the indicator of risk or protection.

The majority of studies of reproducibility and validity in food intake surveys compare different data collection instruments and techniques in terms of the amount of energy, nutrients, and food groups consumed, translated into continuous variables, by applying statistical techniques such as correlation tests and tests for differences in means.^3,4,11,15 This limits the comparability of these results to those of the present study. However, in the specific case of fruit and vegetable intake, our results on the reproducibility and validity of the VIGITEL indicators are similar to those obtained in the United States by another telephone-based surveillance system.^10,12

In conclusion, the indicators of food and beverage intake employed by the VIGITEL system seem reproducible and accurate. Maintaining this system operational in years to come will supply the country with a useful instrument for evaluating public policies for promotion of a healthy diet and for control of diet-related non-transmissible chronic diseases.

REFERENCES

Received: 9/6/2007

Reviewed: 3/13/2008

Approved: 4/2/2008

Supported by Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq (Processes n. 477272/2004-5 and 505136/2003-1).

• 1. Buzzard M. 24-hour dietary recall and food-record methods. In: Willet W. Nutritional epidemiology. 2. ed. New York: Oxford University Press; 1998. p.50-73.
• 2. Byers T. Nutrition monitoring and surveillance. In: Willet W. Nutritional Epidemiology. 2. ed. New York: Oxford University Press; 1998. p.347-55.
• 3. Cardoso MA, Stocco PR. Desenvolvimento de um questionário quantitativo de freqüência alimentar em imigrantes japoneses e seus descendentes residentes em São Paulo, Brasil. Cad Saude Publica. 2000;16(1):107-14. doi:10.1590/S0102-311X2000000100011
• 4. Cullen KW, Himes JH, Baranowski T, Pettit J, Stevens M, Slawson DL et al. Validity and reliability of a behavior-based food coding system for measuring fruit, 100% fruit juice, vegetable, and sweetened beverage consumption: results from the Girls Health Enrichment Multisite Studies. Prev Med. 2004;38(suppl):S24-33. doi:10.1016/j.ypmed.2003.05.001
• 5. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159-74. doi:10.2307/2529310
• 6. Malta DC, Cezário AC, Moura L, Morais Neto OL, Silva Jr JB. Construção da vigilância e prevenção das doenças crônicas não trasmissíveis no contexto do sistema único de saúde. Epidemiol Serv Saude. 2006;15(3):47-64.
• 7. Menezes RX, Azevedo RS. Bioestatística não-paramétrica. In: Massad E, Menezes RX, Silveira PSP, Ortega NRS. Métodos quantitativos em medicina. São Paulo: Manole; 2004. p.307-18.
• 8. Monteiro CA, Moura EC, Jaime PC, Lucca A, Florindo AA, Figueiredo ICR, et al. Monitoramento de fatores de risco para doenças crônicas não transmissíveis por meio de entrevistas telefônicas. Rev Saude Publica. 2005;39(1):47-57. doi:10.1590/S0034-89102005000100007
• 9. Monteiro CA, Florindo AA, Claro RF, Moura EC. Validade de indicadores de atividade física e sedentarismo obtidos por inquérito telefônico. Rev Saude Publica. 2008;42(4):575-81.
• 10. Serdula M, Coates R, Byers T, Mokdad A, Jewell S, Chávez N, et al. Evaluation of a brief telephone questionnaire to estimate fruit and vegetable consumption in diverse study populations. Epidemiology. 1993;4(5):455-63. doi:10.1097/00001648-199309000-00012
• 11. Slater B, Philippi ST, Fisberg RM, Latorre MR. Validation of a semi-quantitative adolescent food frequency questionnaire applied at a public school in Sao Paulo, Brazil. Eur J Clin Nutr. 2003;57(5):629-35. doi:10.1038/sj.ejcn.1601588
• 12. Smith-Warner SA, Elmer PJ, Fosdick L, Tharp TM, Randall B. Reliability and comparability of three dietary assessment methods for estimating fruit and vegetable intakes. Epidemiology. 1997;8(2):196-201. doi:10.1097/00001648-199703000-00013
• 13. Stein AD, Courval JM, Lederman RI, Shea S. Reproducibility of responses to telephone interviews: demographic predictors of discordance in risk factor status. Am J Epidemiol. 1995;141(11):1097-106.
• 14. Szklo M, Javier Nieto, F. Epidemiology: beyond the basics. Maryland: Aspen; 2004.
• 15. Thompson FE, Subar AF, Smith AF, Midthune D, Radimer KL, Kipnis V. Fruit and vegetable assessment: performance of 2 new short instruments and a food frequency questionnaire. J Am Diet Assoc. 2002;102(12):1764-72. doi:10.1016/S0002-8223(02)90379-2
• 16. Willett W, Lenart E. Reproducibility and validity of food-frequency questionnaires. In: Willet W. Nutritional epidemiology. 2. ed. New York: Oxford University Press; 1998. p.101-47.
• 17. World Health Organization. Reducing risks, promoting healthy life. Geneva; 2002. (The World Health Report, 2002)

b

VIGITEL was tested successfully in São Paulo in 2003

⁸ and retested in this same city and in another four state capitals in 2005. In the second test carried out in the city of São Paulo, the evaluation of the system's operation was coupled to a study of the reproducibility and validity of its indicators. The present article describes the results of this study with respect to food and beverage intake. Reproducibility and validity for indicators of physical activity and inactivity are described in Monteiro et al.

⁹

a

Ministério da Saúde. Secretaria de Vigilância em Saúde. Departamento de Análise de Situação em Saúde. Saúde Brasil 2006: uma análise da situação de saúde no Brasil. Brasília; 2006. (Série G Estatística informação em Saúde).

b

Ministério da Saúde. VIGITEL Brasil 2006. Vigilância de fatores de risco e proteção para doenças crônicas por inquérito telefônico: estimativas sore freqüência e distriuição sócio-demográfica de fatores de risco e proteção para doenças crônicas nas capitais dos 26 estados rasileiros e no Distrito Federal em 2006. Brasília; 2007 [cited 2008 May 4]. Availale from:

http://portal.saude.gov.br/portal/arquivos/pdf/relatorio_vigitel_2006_marco_2007.pdf

Publication Dates

• Publication in this collection
  13 Aug 2008
• Date of issue
  Aug 2008

History

• Received
  06 Sept 2007
• Reviewed
  13 Mar 2008
• Accepted
  02 Apr 2008