Acessibilidade / Reportar erro

Cross-cultural adaptation of the University Student Depression Inventory for Brazil

Adaptación transcultural del University Student Depression Inventory para Brasil

ABSTRACT

Objectives:

to adapt the University Student Depression Inventory for Brazil.

Methods:

we used 6 methodological stages: initial translation, translation synthesis, back-translation, expert committee, pre-final version testing and document submission to the scale authors for assessing the adaptation process. The judges were 2 methodologists, 1 health professional and 2 translators. For the pre-test, 30 undergraduate and graduate students participated.

Results:

the data were analyzed by Excel®, resulting in satisfactory content validity, a scale composed of 30 items, 3 domains and a total CVC of 0.91. Language clarity and practical relevance had a CVC of 0.91 and theoretical relevance of 0.90.

Conclusions:

the USDI-BR was cross-culturally adapted for Brazil, showing evidence of satisfactory content validity. After an analysis of reliability and convergent validity to be tested in future studies, multidisciplinary teams will be able to apply this scale to Brazilian students.

Descriptors:
Pandemics; Validation Study; Education Higher; Students; Depression

RESUMEN

Objetivos:

adaptar el University Student Depression Inventory para Brasil.

Métodos:

se utilizaron 6 etapas metodológicas: traducción inicial, síntesis de traducciones, traducción inversa, comité de expertos, prueba de la versión pre-final y envío de la documentación a los autores originales para evaluación del proceso de adaptación. Los jueces fueron 2 metodólogos, 1 profesional de la salud y 2 traductores. Para la preprueba participaron 30 estudiantes de grado y posgrado.

Resultados:

los datos fueron analizados por Excel®, resultando una validez de contenido satisfactoria, una escala compuesta por 30 ítems, 3 dominios y un CVC total de 0,91. La claridad del lenguaje y la relevancia práctica tuvieron un CVC de 0,91 y una relevancia teórica de 0,90.

Conclusiones:

el USDI-BR fue adaptado transculturalmente para Brasil, mostrando evidencias de validez de contenido satisfactoria. Después del análisis de confiabilidad y validez convergente para ser probado en futuros estudios, equipos multidisciplinarios podrán aplicar esta escala a estudiantes brasileños.

Descriptores:
Pandemias; Estudio de Validación; Educación Superior; Estudiantes; Depresión

RESUMO

Objetivos:

realizar a adaptação do University Student Depression Inventory para o Brasil.

Métodos:

foram utilizados 6 estágios metodológicas: tradução inicial, síntese das traduções, tradução reversa, comitê de especialistas, teste da versão pré-final e envio da documentação aos autores originais para avaliação do processo de adaptação. Os juízes foram 2 metodologistas, 1 profissional de saúde e 2 tradutores. Para o pré-teste, participaram 30 alunos de graduação e pós-graduação.

Resultados:

os dados foram analisados pelo Excel®, resultando em validade de conteúdo satisfatória, uma escala composta por 30 itens, 3 domínios e CVC total de 0,91. A clareza de linguagem e pertinência prática apresentaram CVC de 0,91 e relevância teórica de 0,90.

Conclusões:

o USDI-BR foi adaptado transculturalmente para o Brasil, apresentando evidência de validade de conteúdo satisfatória. Após análise de confiabilidade e validade convergente a ser testada nos próximos estudos, equipes multiprofissionais poderão aplicar essa escala em estudantes brasileiros.

Descritores:
Pandemias; Estudo de Validação; Educação Superior; Estudantes; Depressão

INTRODUCTION

Depression is estimated to be the leading cause of mortality in adolescents and may extend to disability-adjusted years of life. This disability can lead to several health and social problems, especially in young people and young adults (18 and 29 years). When faced with the uncertainties and challenges encountered as students, they develop intense mental suffering and, consequently, low academic performance due to their dysfunctions(11 Clemens V, Deschamps P, Fegert JM. Potential effects of “social” distancing measures and school lockdown on child and adolescent mental health. Eur Child Adolesc Psychiatry. 2020;(29):739-42. https://doi.org/10.1007/s00787-020-01549-w
https://doi.org/10.1007/s00787-020-01549...
).

Depression is considered a common emotional disorder that causes distress and impairs psychic functioning. These dysfunctions may be related to depressive symptomatology in students, differing from clinical depression, found in the general population, and may also be observed in academia. Usually, in students, they are represented by cognitive, physiological, behavioral and motivational deficits, such as difficulty in managing and organizing time, activities, problem-solving and low skills in decision-making(22 Romaniuk M, Khawaja NG. University student deperssion inventory (USDI): confirmatory fator analysis and review of psychometric properties. J Affective Disord. 2013;150:(3):766-75. https://doi.org/10.1016/j.jad.2013.02.037
https://doi.org/10.1016/j.jad.2013.02.03...
-33 Beck AT. Cognitive therapy for depression: theoretical reflection and personal thinkings. Psychol Soc [Internet]. 2019 [cited 2021 Jul 2021];Sl(1):90-100. Available from: http://pis.wunu.edu.ua/index.php/enpis/article/view/1022. doi: 10.35774/pis2019.01.090
http://pis.wunu.edu.ua/index.php/enpis/a...
).

Some studies reinforce these findings. One, held in southern Brazil, highlights the attention to undergraduate students who presented higher rates of depression, mainly in the area of applied social sciences and humanities, linguistics, languages and arts(44 Flesch BD, Houvèssou GM, Munhoz TN, Fassa AG. Major depressive episode among university students in Southern Brazil. Rev Saúde Pública. 2020;54(11). https://doi.org/10.11606/s15188787.2020054001540
https://doi.org/10.11606/s15188787.20200...
). Studies collected in PubMed, from various regions of the world, highlight that there was an increase in the number of cases of depression in undergraduate students, especially after the beginning of the COVID-19 pandemic(55 Ramón-Arbués E, Gea-Caballero V, Granada-López JM, Juárez-Vela R, Pellicer-García B, Antón-Solanas I. The prevalence of depression, anxiety and stress and their associated factors in college students. 2020;17(19):7001. https://doi.org/10.3390/ijerph17197001
https://doi.org/10.3390/ijerph17197001...
-66 Gao L, Xie Y, Jia C, Wang W. Prevalence of depression among Chinese university students: a systematic review and meta-analysis. [Internet]. 2020 [cited 2021 july 20]; 10 (1):15897. https://doi.org/10.1038/s41598-020-72998-1
https://doi.org/10.1038/s41598-020-72998...
).

With the pandemic, many studies have been conducted addressing depression in undergraduate students. A systematic review with meta-analysis, conducted in China, surveyed 10 different studies related to the coping style of undergraduate students during the COVID-19 pandemic. In all, there were 24,234 undergraduate students. Of these, 25% had mild depression, 7%, moderate depression and 2%, severe depression(77 Guo S, Kaminga AC, Xiong J. Depression and coping styles of college students in china during covid-19 pandemic: a systemic review and meta-analysis. Front Public Health. 2021;9:613321. https://doi.org/10.3389/fpubh.2021.613321
https://doi.org/10.3389/fpubh.2021.61332...
). Even with a not so significant index, a recent study highlighted that young adults, aged 18 to 24 years, present greater risks of depression when subjected to situations of pressure, earthquakes, isolation, among other situations(88 Shi L, Que J, Lu Z, Gong Y, Liu L, Wang Y, et al. Prevalence and correlates of suicidal ideation among the general population in China during the COVID-19 pandemic. Eur Psychiatry. 2021;64(1):e18. https://doi.org/10.1192/j.eurpsy.2021.5
https://doi.org/10.1192/j.eurpsy.2021.5...
).

Glimpsing the reality of young adults in pandemic times, instruments that could be used in this population were surveyed in Brazil, but scales with good reliability were not found, with the purpose of identifying depressive symptoms in students, with only scales intended for application in the general population. Currently, there are several instruments for screening depressive symptoms, and according to the authors of the original scale validated in this study(22 Romaniuk M, Khawaja NG. University student deperssion inventory (USDI): confirmatory fator analysis and review of psychometric properties. J Affective Disord. 2013;150:(3):766-75. https://doi.org/10.1016/j.jad.2013.02.037
https://doi.org/10.1016/j.jad.2013.02.03...
), there are characteristics of this symptomatology that are little noticeable in instruments aimed at the general public, thus being one of the factors that motivated the search for instruments aimed at young undergraduate and graduate students, mainly.

As a result, in what was identified in the literature, related to the increase in students diagnosed with depression, there was a concern to find a specific scale for this population that could be validated for Brazilian Portuguese. This scarcity led to the measuring instrument University Student Depression Inventory (USDI), from Australia, with 30 items. In 2013, the authors(22 Romaniuk M, Khawaja NG. University student deperssion inventory (USDI): confirmatory fator analysis and review of psychometric properties. J Affective Disord. 2013;150:(3):766-75. https://doi.org/10.1016/j.jad.2013.02.037
https://doi.org/10.1016/j.jad.2013.02.03...
) reviewed the instrument psychometric properties, attesting good internal consistency (0.95).

Translation and adaptation of USDI, aimed at Brazil, will encourage health professionals, multidisciplinary teams and nurses to use an instrument that previously did not exist for this context, in order to identify depressive symptoms in this population. Above all, the greatest beneficiaries will be students and health services, who will be able to use an instrument to identify depressive symptoms. Thus, health professionals and multidisciplinary teams can create strategies to promote and prevent students’ mental health, minimizing cases of major depression and suicidal ideation(66 Gao L, Xie Y, Jia C, Wang W. Prevalence of depression among Chinese university students: a systematic review and meta-analysis. [Internet]. 2020 [cited 2021 july 20]; 10 (1):15897. https://doi.org/10.1038/s41598-020-72998-1
https://doi.org/10.1038/s41598-020-72998...
,88 Shi L, Que J, Lu Z, Gong Y, Liu L, Wang Y, et al. Prevalence and correlates of suicidal ideation among the general population in China during the COVID-19 pandemic. Eur Psychiatry. 2021;64(1):e18. https://doi.org/10.1192/j.eurpsy.2021.5
https://doi.org/10.1192/j.eurpsy.2021.5...
).

Considering the historical knowledge of the ineffective detection of depression in students, the increase in cases resulting from events related to the pandemic, the negative impact on students’ lives(99 Mussi FC, Pires CGS, Carneiro LS, Costa ANS, Ribeiro FMSS, Santos AF. Comparison of stress in freshman and senior nursing students. Rev Esc Enferm USP. 2019;53:e03431. https://doi.org/10.1590/S1980-220X2017023503431
https://doi.org/10.1590/S1980-220X201702...

10 Wang C, Pan R, Wan X, Tan Y, Xu L, Ho CS, et al. Immediate psychological responses and associated factors during the initial stage of the 2019 coronavirus disease (COVID-19) epidemic among the general population in China. Int J Environ Res Public Health. 2020;17:(5):1729. https://doi.org/10.3390/ijerph17051729
https://doi.org/10.3390/ijerph17051729...
-1111 Iorio JC, Silva AV, Fonseca ML. O impacto da COVID-19 nos e nas estudantes internacionais no ensino superior em Portugal: uma análise preliminar. Finisterra. 2020;115:153-61. https://doi.org/10.18055/Finis20285
https://doi.org/10.18055/Finis20285...
) and the absence of instruments aimed at this specific population in Brazilian culture, studies that aim to accomplish this purpose are essential.

OBJECTIVES

To cross-culturally adapt the University Student Depression Inventory for Brazil.

METHODS

Ethical aspects

This research was approved by the Institutional Review Board in 2020, in addition to complying with Resolution 466 of 2012. All pilot test participants and judges received and signed an Informed Consent Form (ICF) electronically via platform Google ® through Google Forms.

Study design, place and period

This is a methodological study, guided by the STrengthening the Reporting of OBservational studies in Epidemiology (STROBE), carried out with undergraduate and graduate students from a public university in southern Brazil, from January to July 2021.

Population or sample, inclusion and exclusion criteria

For the pre-test, the study population consisted of 30 undergraduate and graduate students from a public university. Students over 18 years of age and enrolled in the undergraduate or graduate course were included. Students under administrative or health leave were excluded.

Instrument

USDI was developed to measure depression among undergraduate students. The authors created items based on the experiences of assisting in cases of depression of students and university advisors(1212 Khawaja NG, Bryden KJ. The development and psychometric investigation of the university student depression inventory. 2006;96(1-2):21-9. https://doi.org/10.1016/j.jad.2006.05.007
https://doi.org/10.1016/j.jad.2006.05.00...
). They identified that, using clinical depression scales in students, one can present a lower or erroneous accuracy, since the depressive symptomatology in students may differ from the general population’s clinical depression(22 Romaniuk M, Khawaja NG. University student deperssion inventory (USDI): confirmatory fator analysis and review of psychometric properties. J Affective Disord. 2013;150:(3):766-75. https://doi.org/10.1016/j.jad.2013.02.037
https://doi.org/10.1016/j.jad.2013.02.03...
,1212 Khawaja NG, Bryden KJ. The development and psychometric investigation of the university student depression inventory. 2006;96(1-2):21-9. https://doi.org/10.1016/j.jad.2006.05.007
https://doi.org/10.1016/j.jad.2006.05.00...
).

The USDI elaboration process resulted in a 30-item inventory on student depression, with three interrelated subscales: lethargy, cognitive/emotional and academic motivation. The lethargy factor is represented by items 1, 3, 4, 8, 10, 24, 27, 29, 30. This factor is characterized by a combination of physiological, behavioral and cognitive manifestations. Some items reflect low energy consumption and physical fatigue. On the other hand, the items also reflect mental exhaustion and inability to focus on tasks(1212 Khawaja NG, Bryden KJ. The development and psychometric investigation of the university student depression inventory. 2006;96(1-2):21-9. https://doi.org/10.1016/j.jad.2006.05.007
https://doi.org/10.1016/j.jad.2006.05.00...
).

The cognitive/emotional factor is represented by items 2, 5, 6, 9, 11, 14, 18, 20, 21, 22, 23, 25, 26, 28. They represent cognitive symptoms, emotional symptoms and social withdrawal. The cognitive items on this scale include suicidal ideation, low self-assessment, and pessimism. The emotional items on this scale include items such as sadness, emotional emptiness, and anhedonia(1212 Khawaja NG, Bryden KJ. The development and psychometric investigation of the university student depression inventory. 2006;96(1-2):21-9. https://doi.org/10.1016/j.jad.2006.05.007
https://doi.org/10.1016/j.jad.2006.05.00...
).

The academic motivation factor is composed of items 7, 12, 13, 15, 16, 17, 19. It is characterized by motivation and procrastination related to the study. This factor is not found in other depression scales, because it is an item that represents depressed students. The USDI elaboration process had special resources relevant to students, such as the exclusion of items about severe depression not related to students’ depression. This subscale contains items that are often experienced by depressed students and are rarely included in depression scales(1212 Khawaja NG, Bryden KJ. The development and psychometric investigation of the university student depression inventory. 2006;96(1-2):21-9. https://doi.org/10.1016/j.jad.2006.05.007
https://doi.org/10.1016/j.jad.2006.05.00...
).

USDI is a 5-point Likert scale. Respondents should indicate how often they have experienced each item in the last 2 weeks (e.g., “my energy level is low”), such as 1 (Never), 2 (Rarely) 3 (Sometimes), 4 (Often) 5 (All the time). The scale produces a score between 30 and 150, where higher scores indicate high levels of student depression. Cronbach’s alpha coefficient of this scale was 0.95(22 Romaniuk M, Khawaja NG. University student deperssion inventory (USDI): confirmatory fator analysis and review of psychometric properties. J Affective Disord. 2013;150:(3):766-75. https://doi.org/10.1016/j.jad.2013.02.037
https://doi.org/10.1016/j.jad.2013.02.03...
,1212 Khawaja NG, Bryden KJ. The development and psychometric investigation of the university student depression inventory. 2006;96(1-2):21-9. https://doi.org/10.1016/j.jad.2006.05.007
https://doi.org/10.1016/j.jad.2006.05.00...
).

Study protocol

Before starting the cross-cultural adaptation stages of USDI, a literature review was carried out in the databases, where it was possible to identify studies of the original instrument’s culture related to depression in undergraduate students, confirming that depression in this population is considered a public health concern in other countries as well as in Brazil. These studies also highlight the importance of instruments aimed at young adults with good reliability for the Brazilian version(1313 Baptista MN, Borges L. Revisão integrativa de instrumentos de depressão em crianças/adolescentes e adultos na população brasileira. Aval Psicol[Internet]. 2016 [cited 2021 Jul 20];15(spe):19-32. Available from: http://pepsic.bvsalud.org/pdf/avp/v15nspe/v15nspea04.pdf
http://pepsic.bvsalud.org/pdf/avp/v15nsp...

14 Rith-Najarian LR, Maya MB, Chorpita BF. A systematic review of prevention programs targeting depression, anxiety, and stress in university students. J Affect Disord. 2019;257:568-84. https://doi.org/10.1016/j.jad.2019.06.035
https://doi.org/10.1016/j.jad.2019.06.03...

15 Majumdar P, Biswas A, Sahu S. COVID-19 pandemic and lockdown: cause of sleep disruption, depression, somatic pain, and increased screen exposure of office workers and students of India. Chronobiol Int. 2020;37(8):1191-200. https://doi.org/10.1080/07420528.2020.1786107
https://doi.org/10.1080/07420528.2020.17...

16 Jardim MGL, Castro TS, Ferreira-Rodrigues CF. Sintomatologia depressiva, estresse e ansiedade em universitários. Psico-USF[Internet]. 2020 [cited 2021 Jul 7];25(4):645-57. https://doi.org/10.1590/1413/82712020250405
https://doi.org/10.1590/1413/82712020250...
-1717 Maia BR, Dias PC. Ansiedade, depressão e estresse em estudantes universitários: o impacto da COVID-19. Estud Psicol (Campinas). 2020;(37):e200067. https://doi.org/10.1590/1982-0275202037e200067
https://doi.org/10.1590/1982-0275202037e...
).

At this stage, the authors contacted the scale authors, requesting approval to carry out the validation and cross-cultural adaptation study in Brazil, thus obtaining authorization to conduct the study in Brazil.

For cross-cultural adaptation, we chose to use the methodological stages proposed by Beaton et al.(1818 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the processo of crosscultural adaptation of self-report measures. Spine. 2000;25(24):318691. https://doi.org/10.1097/00007632-200012150-00014
https://doi.org/10.1097/00007632-2000121...
), which are divided into 6 stages, as shown in Figure 1.

Figure 1
Illustration of translation and adaptation process descriptions suggested by Beaton et al.(1818 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the processo of crosscultural adaptation of self-report measures. Spine. 2000;25(24):318691. https://doi.org/10.1097/00007632-200012150-00014
https://doi.org/10.1097/00007632-2000121...
), Londrina, Paraná. Brazil, 2021

Stage 1: Initial translation

Translation was performed from English to Brazilian Portuguese. For translation, two different bilingual translators (Portuguese and English) were requested, who had experience with translations and a license to translate (Translator 1 and Translator 2). Thus, it resulted in two distinct translations, translation 1 (T1) and translation 2 (T2).

The chosen translators have different backgrounds. Translator 1 was aware of the concepts examined in this questionnaire. He holds a master’s degree from the University of Toledo, Ohio, and a PhD from the University of Sidney, in addition to translating for more than 20 years. Translator 2, unlike Translator 1, was not aware of the concepts examined, had a background in the administrative area and has been carrying out translations for more than 30 years. This first translation was reported to the scale authors, but they did not list any changes.

Stage 2: Syntheses of translations

At this stage, due to the coronavirus pandemic, an adaptation of the Beaton et al.(1818 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the processo of crosscultural adaptation of self-report measures. Spine. 2000;25(24):318691. https://doi.org/10.1097/00007632-200012150-00014
https://doi.org/10.1097/00007632-2000121...
) recommendations was performed. A meeting with Translators 1 and 2 and a third person was held virtually, and this third person was responsible for observing and recording the meeting. The observer was a translation company coordinator. She has expertise in translation and more than 40 years of teaching in the area of languages. The syntheses were analyzed by the translators and the third person, who clarified some doubts and divergences between the original version and T1 and T2. In consensus, translation 1-2 (T1-2) was obtained from this analysis, which constituted the first version of USDI for Brazilian Portuguese.

In this study, the option of answers to 1 to 5 was modified, since Rensis Likert(1919 Likert RA. Technique for the measurement of attitudes. Arch Psychol. 1932. 44-53p.), theoretical creator of the Summed Classification Method, describes that there is no format for measuring attitudes that includes the zero value, since there would be no null agreement, even if postulated as “totally disagree”.

At this stage, as well as stage 1 translation, it was also reported to the scale authors, but without notes suggested by them.

Stage 3: Back-translation

Back-translation is performed in order to verify validity, highlighting gross inconsistencies or conceptual errors in translation(1818 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the processo of crosscultural adaptation of self-report measures. Spine. 2000;25(24):318691. https://doi.org/10.1097/00007632-200012150-00014
https://doi.org/10.1097/00007632-2000121...
). The first version (T1-2) was sent to two independent translators. It was certified that the translators presented different profiles, were from an English-speaking country, had no prior contact with the original scale or information on the concepts explored. One of the translators majored in biology, and the other, in mathematics and statistics. Both were born in England, live in Brazil and have experience in back-translations.

This process originated back-translations 1 (BT1) and 2 (BT2). After this step, the researchers, together with another translator, analyzed the BT1 and BT2 versions, giving rise to the BT1-2 synthesis version. There were no divergences at this stage; therefore, this synthesis version was sent to the authors of the original scale, who approved it without changes.

Stage 4: Review by a committee of experts

At this stage, a committee of 5 judges was selected, as required by the guideline for the process of cross-cultural adaptation of self-report measures(1818 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the processo of crosscultural adaptation of self-report measures. Spine. 2000;25(24):318691. https://doi.org/10.1097/00007632-200012150-00014
https://doi.org/10.1097/00007632-2000121...
), with 2 methodologists, 1 health professional and 2 translators. The selection took place through Plataforma Lattes (a website with professionals’ resumes), through the analysis of the resume of each professional who met the required criteria. In all, 6 professionals who had fluency in English, experience with methodological studies, more than 20 years of experience in the area of mental health (except translators) and accepted to be a judge voluntarily were listed. Only one judge refused to participate, totaling 5 judges.

The invitation to participate in the research occurred by electronic mail, accompanied by two Informed Consent Forms (ICF), in which one copy belonged to the judge and the other to the researcher. To assess the items, each judge received a kit (equal) composed of guidance on the study, how the sale interpretation is recommended, its scores, the sum, assessment of items and the conceptual definition of each factor of depressive symptomatology according to the original version.

For expert assessment, the instrument was placed in a table of 9 columns. 1st column: original version and synthesis version of 2 translations (T1-2); 2nd column: synthesis version of 2 back-translations; 3rd column: domain to which that item referred; 4th column: language clarity (LC); 5th column: theoretical relevance (TR); 6th column: practical relevance (PR); 7th column: theoretical dimension (TD); and 8th column: option to make some observation in relation to the item. In these columns, the judges had to assign a grade from 1 to 5 (1 - Very little, 2 - Very little, 3 - Medium, 4 - A lot and 5 - Very much).

The judges scored from 1 to 5 regarding LC, which considers the language used in the items, considering the corresponding population’s characteristics. Regarding PR, each item was designed to assess the concept of interest in a given population. For TR, the degree of association between the item and theory was considered. In DT, the adequacy of each item to the theory studied was investigated. This method has been applied by other studies in mental health, such as a study carried out in 2013(2020 Soares MH, Vargas D. Tradução e adaptação cultural da Management of Aggression And Violence Attitude Scale - MAVAS - em enfermeiros brasileiros. Rev Esc Enferm USP. 2013;47(04):899-906. https://doi.org/10.1590/S0080-623420130000400018
https://doi.org/10.1590/S0080-6234201300...
).

Stage 5: Pre-final version test

This step verified the instrument relevance, adequacy and understanding by the target population (pretest). The USDI-BR pre-test took place by applying the instrument to a sample of 30 undergraduate and graduate students from a public university in southern Brazil in the first half of 2021. Data were collected by sending the questionnaires electronically via Google® through Google Forms. An invitation to students was sent via e-mail by the institution’s coordination, and by the researchers, through social media (WhatsApp® and Instagram®).

At the end of the scale, so that students could answer and make observations regarding the scale questions, 8 questions were listed: 1 - Did the test seem to assess what you expected? If not, what was contrary to your expectations? 2 - Was the questionnaire impartial in what it sought to assess? If not, why? 3 - Regarding the test duration, comment on: A) The time it took to complete; B) The number of items; 4 - Did you guess on any test item? If yes, how many items? 5 - Did you employ any particular strategy to guess on or was it random? If so, what strategy did you use? 6 - Do you think your mental state somehow affected the test result? 7- Did you find any anxiety-generating or disturbing parts? Why? 8 - What is your overall impression of this test? What improvement suggestions would you highlight?(2121 Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Measurem. 1960;(20):37-46p.).

Stage 6: Document submission to scale authors

At all stages, the scale authors were informed about the entire ongoing process. At the end, in stage 6, a report was sent to the scale authors and to a committees of judges, but without suggestions from both parties

Analysis of data results

The scores given by the judges in relation to TR, PR and TD, the method used to assess content validity, was the Content Validity Coefficient (CVC) calculation(1818 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the processo of crosscultural adaptation of self-report measures. Spine. 2000;25(24):318691. https://doi.org/10.1097/00007632-200012150-00014
https://doi.org/10.1097/00007632-2000121...
). The CVC assesses agreement among judges. The agreement result shows whether there is content equivalence or not.

To calculate the mean (Mx), 5 judges’ grades were used. ij=1xj represented the sum of the grades, and j, by using the formula: Mx=ij=1xjJ.

To calculate the initial CVC of each item (iCVC), the mean was obtained, in which the maximum value (Vmax) was represented by 5 (maximum value scored by the judge), represented by the formula: iCVC=MxVmax. There is a high chance of bias, even if it is assessed by 5 judges. To clarify this statement, the error calculation (iPe) was performed for each item iPe=(1j)j.

To calculate the final Content Validity Coefficient (fCVC), the following formulas were used: fCVC = iCVC - iPe. iCVC refers to the initial CVC. iPe concerns error calculation. iMcvc refers to the mean of the questionnaire item initial CVC. iMpe refers to the mean of the questionnaire item errors. The total Content Validity Coefficient (tCVC) calculation was obtained by calculating the mean; for this calculation, the formula was used: iCVC and iPe: tCVC = iMcvc - iMpe.

After these calculations, it was identified that all items had CVC ≥ 0.80, considered one of the criteria to keep the item on the scale. The only change in relation to the original scale was the item score, which was from 0 to 5, being changed to 1 to 5. The scale with this change was sent to the authors, but they did not list considerations regarding the score modification. Therefore, there was no need to remove/change any item at this stage.

RESULTS

The pre-test sample consisted of 85.7% men and 14.3% women. Of these, 71.4% were aged between 20 and 23 years, 66.7% lived with family members and 91.4% did not fail any time in undergraduate or graduate courses.

Throughout the translation and back-translation processes, we can observe that the data and observations made by the judges did not present significant nonconformities, allowing the translated and back-translated versions to be sent for analysis by judges.

USDI’s title and acronym were maintained as the original, adding only BR, becoming University Student Depression Inventory Brazil (USDI-BR), which refers to translation and adaptation for use in Brazil. The mean time indicated by students to answer the questionnaire was 2 to 5 minutes. Below, idiomatic and semantic changes and the judges’ agreement scores for the items will be presented.

Idiomatic and semantic changes

The USDI header translation was presented as follows “a frequência de quando se sentiu nas suas últimas duas semanas”; however, in the opinion of a judge, it was suggested that a direct object be added, being as follows “Com que frequência se sentiu nas últimas DUAS semanas.” In T1, the following descriptions were suggested for the frequency of each item: 1 - Never, 2 - Rarely, 3 - Sometimes, 4 - Often and 5 - Always. However, T2 suggested for item 5 to use “5 - All the time”, being by common agreement of all judges, researchers and the original scale authors.

In items 1, 2, 5, 7, 8, 15, 16, 18, 20, 27, 29 and 30 of T1 and 2, according to the original version, the result of sentences that started with unstressed oblique pronoun was obtained. After the judges’ assessment and everyone’s consensus, it was decided to start all these items with a personal pronoun in the first person singular “I...”. In item 7, T1 and T2 were “Não tenho ido muito às aulas como antes”. The judges suggested adding the personal pronoun and the word “frequentado”, as follows: “Eu não tenho frequentado muito às aulas como antes”.

In question 9, the judges suggested changing “Eu me questiono se vale a pena viver” to “Eu me pergunto se vale a pena continuar vivendo”. In item 12, “Eu não sinto vontade de estar em aulas” was replaced by “Eu não sinto vontade de frequentar as aulas”. In item 14, it was suggested to change “Tenho passado mais tempo sozinha (o)” to “Passo mais tempo sozinho (a) do que costumava”.

In item 17, “Tenho dificuldade em iniciar minhas tarefas” was replaced by “Eu tenho dificuldades para conseguir iniciar tarefas”. Previously, in item 23, the translation was “Sinto que não tenho conseguido controlar minhas emoções”. After analysis by the judges, it was decided to replace with “Eu sinto que não consigo controlar minhas emoções”, and item 24, which was “Meus estudos são interrompidos por pensamentos distrativos”, was replaced by “Meus estudos são interrompidos por pensamentos perturbadores”.

In the original version of USDI, in item 16, the scale authors used the term “study tasks”. When back-translation was performed, the judges suggested modifying the word to “homework”.

Agreement scores

Table 1 shows that the tCVC of USDI-BR, in the parameters assessed by the judges, it was 0.91 for LC, 0.91 for PR and 0.90 for TR.

Table 1
Content validity criteria of each item of USDI-BR, final version of the cross-cultural adaptation for use in Brazil, Londrina, Paraná, Brazil, 2021

At the end of the six stages, which are proposed for translation and cultural adaptation of USDI-BR, the scale remained with 30 items. Only item 17 had a score of 0.80 in relation to TR. The average of each item assessed by the five judges showed a tCVC of 0.94. The means of all judges’ CVC were J1 (0.84), J2 (0.91), J3 (1.00), J4 (0.92) and J5 (0.91).

DISCUSSION

Assessing depression in young adults will always be challenging. Depression was identified as the “evil of the 21st century” resulting from generational impacts. It is inferred that this “evil” may have worsened with the COVID-19 pandemic(77 Guo S, Kaminga AC, Xiong J. Depression and coping styles of college students in china during covid-19 pandemic: a systemic review and meta-analysis. Front Public Health. 2021;9:613321. https://doi.org/10.3389/fpubh.2021.613321
https://doi.org/10.3389/fpubh.2021.61332...
,1111 Iorio JC, Silva AV, Fonseca ML. O impacto da COVID-19 nos e nas estudantes internacionais no ensino superior em Portugal: uma análise preliminar. Finisterra. 2020;115:153-61. https://doi.org/10.18055/Finis20285
https://doi.org/10.18055/Finis20285...
). In young adults, in the academic phase, it does not differ, as they are more prone to psychological distress and low academic performance related to depression(2222 Winzer R, Lindberg L, Guldbrandsson K, Sidorchuk A. Effects of mental health interventions for students in higher education are sustainable over time: a systematic review and meta-analysis of randomized controlled trials. Peer J. 2018;2(6):e4598. https://doi.org/10.7717/peerj.4598
https://doi.org/10.7717/peerj.4598...
).

In order to provide an effective assessment and think about prevention strategies for this population, health services must have validated instruments with good reliability to measure depressive symptoms in young adults, especially when it comes to subjective constructs, such as depression(2323 Mokkink LB, Prinsen CAC, Bouter LM, Vet HCW, Terwee CB. The Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) and how to select an outcome measurement instrument. Braz J Phys Ther. 2016;20(2):105-13. https://doi.org/10.1590/bjptrbf.2014.0143
https://doi.org/10.1590/bjptrbf.2014.014...
-2424 Lunardi NMSS, Nascimento A, Sousa JB, Silva NRM, Nogueira TG, Fernandes JSFG. Aulas Remotas Durante a Pandemia: dificuldades e estratégias utilizadas por pais. Educ Realidade. 2021;46(2):e106662. https://doi.org/10.1590/2175-6236106662
https://doi.org/10.1590/2175-6236106662...
).

In a cross-cultural adaptation process, we must take into account the relevance of the concepts and domains understood by the original instrument in the new culture. We must also consider each item that was adapted by the original instrument, so that these capacity terms represent such concepts and domains in the target population(1818 Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the processo of crosscultural adaptation of self-report measures. Spine. 2000;25(24):318691. https://doi.org/10.1097/00007632-200012150-00014
https://doi.org/10.1097/00007632-2000121...
).

Following what is recommended, in the semantic assessment process, carried out by the judges, it was found that all items are understandable for all members of the population to which the instrument is intended. Therefore, with the semantic analysis of this study, we identified, in addition to the data collection instrument adequacy, important points that refer to the pandemic moment in Brazil, such as items 7 and 12.

Reviewing these items, the translated terms alluded only to face-to-face classes. As reported by some studies(2525 Alves L. Educação Remota: entre a ilusão e a realidade. Interfaces Científicas: educação, Aracaju. 2020. 8 (3):348-65. https://doi.org/10.17564/2316-3828.2020v8n3p348-365
https://doi.org/10.17564/2316-3828.2020v...
-2626 Academia Brasileira De Letras. Vocabulário ortográfico da língua portuguesa. 6.ed., Rio de Janeiro: A Academia; 2021.), classes were being held remotely, due to the global outbreak of coronavirus, which began in Brazil in February 2020. Thinking in this context, the judges highlighted the need to change the words “ido às aulas” to one that made sense for both face-to-face and remote classes. In this case, the word “frequentar” better fits this reality, which may become commonplace in the future, becoming more opportune for these items.

In the original version, T1 indicated that items 1, 2, 5, 7, 8, 15, 16, 18, 20, 27, 29 and 30 started with an unstressed oblique pronoun, however, as described by the Brazilian Academy of Languages, it is not recommended to start sentences with an unstressed oblique pronoun (me, se, te, a, o, lhe, nos, vos, as, os, lhes), the sentence should be started with the verb and, if feasible, the pronoun “se” should be placed afterwards(2727 Melo HE, Severian PFG, Eid LP, Souza MR, Sequeira CAC, Souza GGM, et al. Impacto dos sintomas de ansiedade e depressão na autoeficácia percebida em estudantes de enfermagem. Acta Paul Enferm. 2021;34:eAPE01113. https://doi.org/10.37689/acta-ape/2021AO01113
https://doi.org/10.37689/acta-ape/2021AO...
). In the USDI-BR version, all these items had the personal pronoun “eu” (I).

The judges scored, in addition to these changes related to item grammatical adequacy, some technical suggestions related to what they felt in relation to the item response, as there needed to be a relationship with the USDI-BR factors, in addition to making sense with depression in undergraduate students to which the scale construct refers. Research highlights the importance of students strengthening their emotional skills and using positive coping strategies(2828 Abreu EKN, Marcon SR, Espinosa MM, Kogien M, Valim MD, Nascimento FDS. Factors associated to suicide risk in strictu sensu postgraduate students: a cross-sectional study. Rev Latino-Am Enfermagem. 2021;(29):e3460. https://doi.org/10.1590/1518-8345.4590.3460
https://doi.org/10.1590/1518-8345.4590.3...
).

Another study, in this case(2929 Torlig EGS, Resende Junior PC. Validação de instrumento de coleta de dados: experiência com o Coeficiente de Validação de Conteúdo (CVC) e proposição de uma nova abordagem para pesquisas qualitativas. investigação qualitativa em ciências sociais [Internet]. 2019 [cited 2021 Jun 20];(3):50-9. Available from: https://proceedings.ciaiq.org/index.php/CIAIQ2019/article/view/1984/1920
https://proceedings.ciaiq.org/index.php/...
), carried out with graduate students from a stricto sensu program (master’s degree and doctoral degree), describes that, of the 565 graduate students who participated in the research, 52.04% had symptoms of depression. These symptoms may have been exacerbated, due to the challenges that a graduate student may encounter, such as few bonds with colleagues, impaired family relationship, financial situation, non-significant academic work, among others. With the evidence of validity of this study, this identification will be possible to more accurately develop prevention and promotion strategies in mental health.

The literature highlights that the CVC is frequently used in the health area, as it is a method that measures the percentage or agreement regarding the instruments and their items. For it to be considered of good quality, it is necessary to have a CVC > 0.80. According to Table 1, only item 17, which refers to TR, obtained a CVC of 0.80, thus remaining at the minimum acceptable threshold(2929 Torlig EGS, Resende Junior PC. Validação de instrumento de coleta de dados: experiência com o Coeficiente de Validação de Conteúdo (CVC) e proposição de uma nova abordagem para pesquisas qualitativas. investigação qualitativa em ciências sociais [Internet]. 2019 [cited 2021 Jun 20];(3):50-9. Available from: https://proceedings.ciaiq.org/index.php/CIAIQ2019/article/view/1984/1920
https://proceedings.ciaiq.org/index.php/...
).

In addition to presenting a CVC considered ideal, another significant point of the USDI-BR is application time. The literature highlights that an interviewee takes an average of 1 minute for each question and also considers that the apex of 45 minutes is ideal to balance accuracy and quality(3030 Nunnally JC, Bernstein IH. Psychometric theory. 3ed. New York: McGraw-Hill; 1994.). In this study, 30 respondents spent, on average, 2 to 10 minutes to answer the 30 USDI-BR questions. This average shows us that the USDI-BR can be applied without demanding so much time from health professionals and professors.

At the end of the pilot test, 8 questions were added for students to assess the questionnaire(2121 Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Measurem. 1960;(20):37-46p.). With these questions, only one student made an observation: “I was in doubt about 2 questions to answer, because I did not understand well”, but the authors chose not to make any changes, as the interviewee did not describe what the questions would be and took into account the other students’ and judges’ overall assessment. Only the scale score format has changed.

In the original version, the author proposed using a score from 0 to 5 in relation to the score given to each item. In this study, it was changed to a five-point format, starting from 1 to 5, as it allows an adequate level of reliability and adjusts to respondents with different levels of ability(1919 Likert RA. Technique for the measurement of attitudes. Arch Psychol. 1932. 44-53p.).

Study limitations

The results presented in this study refer to the pre-test phase; therefore, it stands out as a limitation of this study that it did not obtain evidence of construct validity, as these will be carried out in future studies. However, the content validity was satisfactory, with a total CVC of 0.94.

Contributions to health

The USDI adaptation to Brazil will encourage researchers to develop research on this topic in different regions of Brazil, in addition to enabling health professionals and multidisciplinary teams to identify early the level of depressive symptoms in young adults at undergraduate and graduate students, enabling the use of an instrument with evidence of satisfactory content validity.

CONCLUSIONS

The USDI-BR was translated and culturally adapted for use in Brazil. The instrument is the first in Brazil to be translated for the population of young adults (to date), with good reliability and satisfactory evidence of content validity, allowing the opening for continuity of the other stages.

Further studies will allow to verify the construct validity evidence as well as other statistical tests with this instrument. In addition to completing the validity evidence stage, it will be possible to develop, through students’ mental health monitoring services, health professionals and multidisciplinary team, mental health prevention and promotion programs for undergraduate and graduate students, aimed at preventing depressive symptoms and cases of major depression in academia.

SUPPLEMENTARY MATERIAL

The present manuscript is the result of the thesis entitled “Evaluation of the psychometric properties of the instruments “University Student Depression Inventory and Assessing Motivations for Suicide Attempts” for the Brazilian context”.

  • FUNDING
    The present work was carried out with support of the Coordination for the Improvement of Higher Education Personnel - Brazil (CAPES - Coordenação de Aperfeiçoamento de Pessoal de Nível Superior) - Financing Code 001 and Fundação Araucária.

REFERENCES

  • 1
    Clemens V, Deschamps P, Fegert JM. Potential effects of “social” distancing measures and school lockdown on child and adolescent mental health. Eur Child Adolesc Psychiatry. 2020;(29):739-42. https://doi.org/10.1007/s00787-020-01549-w
    » https://doi.org/10.1007/s00787-020-01549-w
  • 2
    Romaniuk M, Khawaja NG. University student deperssion inventory (USDI): confirmatory fator analysis and review of psychometric properties. J Affective Disord. 2013;150:(3):766-75. https://doi.org/10.1016/j.jad.2013.02.037
    » https://doi.org/10.1016/j.jad.2013.02.037
  • 3
    Beck AT. Cognitive therapy for depression: theoretical reflection and personal thinkings. Psychol Soc [Internet]. 2019 [cited 2021 Jul 2021];Sl(1):90-100. Available from: http://pis.wunu.edu.ua/index.php/enpis/article/view/1022 doi: 10.35774/pis2019.01.090
    » https://doi.org/10.35774/pis2019.01.090» http://pis.wunu.edu.ua/index.php/enpis/article/view/1022
  • 4
    Flesch BD, Houvèssou GM, Munhoz TN, Fassa AG. Major depressive episode among university students in Southern Brazil. Rev Saúde Pública. 2020;54(11). https://doi.org/10.11606/s15188787.2020054001540
    » https://doi.org/10.11606/s15188787.2020054001540
  • 5
    Ramón-Arbués E, Gea-Caballero V, Granada-López JM, Juárez-Vela R, Pellicer-García B, Antón-Solanas I. The prevalence of depression, anxiety and stress and their associated factors in college students. 2020;17(19):7001. https://doi.org/10.3390/ijerph17197001
    » https://doi.org/10.3390/ijerph17197001
  • 6
    Gao L, Xie Y, Jia C, Wang W. Prevalence of depression among Chinese university students: a systematic review and meta-analysis. [Internet]. 2020 [cited 2021 july 20]; 10 (1):15897. https://doi.org/10.1038/s41598-020-72998-1
    » https://doi.org/10.1038/s41598-020-72998-1
  • 7
    Guo S, Kaminga AC, Xiong J. Depression and coping styles of college students in china during covid-19 pandemic: a systemic review and meta-analysis. Front Public Health. 2021;9:613321. https://doi.org/10.3389/fpubh.2021.613321
    » https://doi.org/10.3389/fpubh.2021.613321
  • 8
    Shi L, Que J, Lu Z, Gong Y, Liu L, Wang Y, et al. Prevalence and correlates of suicidal ideation among the general population in China during the COVID-19 pandemic. Eur Psychiatry. 2021;64(1):e18. https://doi.org/10.1192/j.eurpsy.2021.5
    » https://doi.org/10.1192/j.eurpsy.2021.5
  • 9
    Mussi FC, Pires CGS, Carneiro LS, Costa ANS, Ribeiro FMSS, Santos AF. Comparison of stress in freshman and senior nursing students. Rev Esc Enferm USP. 2019;53:e03431. https://doi.org/10.1590/S1980-220X2017023503431
    » https://doi.org/10.1590/S1980-220X2017023503431
  • 10
    Wang C, Pan R, Wan X, Tan Y, Xu L, Ho CS, et al. Immediate psychological responses and associated factors during the initial stage of the 2019 coronavirus disease (COVID-19) epidemic among the general population in China. Int J Environ Res Public Health. 2020;17:(5):1729. https://doi.org/10.3390/ijerph17051729
    » https://doi.org/10.3390/ijerph17051729
  • 11
    Iorio JC, Silva AV, Fonseca ML. O impacto da COVID-19 nos e nas estudantes internacionais no ensino superior em Portugal: uma análise preliminar. Finisterra. 2020;115:153-61. https://doi.org/10.18055/Finis20285
    » https://doi.org/10.18055/Finis20285
  • 12
    Khawaja NG, Bryden KJ. The development and psychometric investigation of the university student depression inventory. 2006;96(1-2):21-9. https://doi.org/10.1016/j.jad.2006.05.007
    » https://doi.org/10.1016/j.jad.2006.05.007
  • 13
    Baptista MN, Borges L. Revisão integrativa de instrumentos de depressão em crianças/adolescentes e adultos na população brasileira. Aval Psicol[Internet]. 2016 [cited 2021 Jul 20];15(spe):19-32. Available from: http://pepsic.bvsalud.org/pdf/avp/v15nspe/v15nspea04.pdf
    » http://pepsic.bvsalud.org/pdf/avp/v15nspe/v15nspea04.pdf
  • 14
    Rith-Najarian LR, Maya MB, Chorpita BF. A systematic review of prevention programs targeting depression, anxiety, and stress in university students. J Affect Disord. 2019;257:568-84. https://doi.org/10.1016/j.jad.2019.06.035
    » https://doi.org/10.1016/j.jad.2019.06.035
  • 15
    Majumdar P, Biswas A, Sahu S. COVID-19 pandemic and lockdown: cause of sleep disruption, depression, somatic pain, and increased screen exposure of office workers and students of India. Chronobiol Int. 2020;37(8):1191-200. https://doi.org/10.1080/07420528.2020.1786107
    » https://doi.org/10.1080/07420528.2020.1786107
  • 16
    Jardim MGL, Castro TS, Ferreira-Rodrigues CF. Sintomatologia depressiva, estresse e ansiedade em universitários. Psico-USF[Internet]. 2020 [cited 2021 Jul 7];25(4):645-57. https://doi.org/10.1590/1413/82712020250405
    » https://doi.org/10.1590/1413/82712020250405
  • 17
    Maia BR, Dias PC. Ansiedade, depressão e estresse em estudantes universitários: o impacto da COVID-19. Estud Psicol (Campinas). 2020;(37):e200067. https://doi.org/10.1590/1982-0275202037e200067
    » https://doi.org/10.1590/1982-0275202037e200067
  • 18
    Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the processo of crosscultural adaptation of self-report measures. Spine. 2000;25(24):318691. https://doi.org/10.1097/00007632-200012150-00014
    » https://doi.org/10.1097/00007632-200012150-00014
  • 19
    Likert RA. Technique for the measurement of attitudes. Arch Psychol. 1932. 44-53p.
  • 20
    Soares MH, Vargas D. Tradução e adaptação cultural da Management of Aggression And Violence Attitude Scale - MAVAS - em enfermeiros brasileiros. Rev Esc Enferm USP. 2013;47(04):899-906. https://doi.org/10.1590/S0080-623420130000400018
    » https://doi.org/10.1590/S0080-623420130000400018
  • 21
    Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Measurem. 1960;(20):37-46p.
  • 22
    Winzer R, Lindberg L, Guldbrandsson K, Sidorchuk A. Effects of mental health interventions for students in higher education are sustainable over time: a systematic review and meta-analysis of randomized controlled trials. Peer J. 2018;2(6):e4598. https://doi.org/10.7717/peerj.4598
    » https://doi.org/10.7717/peerj.4598
  • 23
    Mokkink LB, Prinsen CAC, Bouter LM, Vet HCW, Terwee CB. The Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) and how to select an outcome measurement instrument. Braz J Phys Ther. 2016;20(2):105-13. https://doi.org/10.1590/bjptrbf.2014.0143
    » https://doi.org/10.1590/bjptrbf.2014.0143
  • 24
    Lunardi NMSS, Nascimento A, Sousa JB, Silva NRM, Nogueira TG, Fernandes JSFG. Aulas Remotas Durante a Pandemia: dificuldades e estratégias utilizadas por pais. Educ Realidade. 2021;46(2):e106662. https://doi.org/10.1590/2175-6236106662
    » https://doi.org/10.1590/2175-6236106662
  • 25
    Alves L. Educação Remota: entre a ilusão e a realidade. Interfaces Científicas: educação, Aracaju. 2020. 8 (3):348-65. https://doi.org/10.17564/2316-3828.2020v8n3p348-365
    » https://doi.org/10.17564/2316-3828.2020v8n3p348-365
  • 26
    Academia Brasileira De Letras. Vocabulário ortográfico da língua portuguesa. 6.ed., Rio de Janeiro: A Academia; 2021.
  • 27
    Melo HE, Severian PFG, Eid LP, Souza MR, Sequeira CAC, Souza GGM, et al. Impacto dos sintomas de ansiedade e depressão na autoeficácia percebida em estudantes de enfermagem. Acta Paul Enferm. 2021;34:eAPE01113. https://doi.org/10.37689/acta-ape/2021AO01113
    » https://doi.org/10.37689/acta-ape/2021AO01113
  • 28
    Abreu EKN, Marcon SR, Espinosa MM, Kogien M, Valim MD, Nascimento FDS. Factors associated to suicide risk in strictu sensu postgraduate students: a cross-sectional study. Rev Latino-Am Enfermagem. 2021;(29):e3460. https://doi.org/10.1590/1518-8345.4590.3460
    » https://doi.org/10.1590/1518-8345.4590.3460
  • 29
    Torlig EGS, Resende Junior PC. Validação de instrumento de coleta de dados: experiência com o Coeficiente de Validação de Conteúdo (CVC) e proposição de uma nova abordagem para pesquisas qualitativas. investigação qualitativa em ciências sociais [Internet]. 2019 [cited 2021 Jun 20];(3):50-9. Available from: https://proceedings.ciaiq.org/index.php/CIAIQ2019/article/view/1984/1920
    » https://proceedings.ciaiq.org/index.php/CIAIQ2019/article/view/1984/1920
  • 30
    Nunnally JC, Bernstein IH. Psychometric theory. 3ed. New York: McGraw-Hill; 1994.

Edited by

EDITOR IN CHIEF: Antonio José de Almeida Filho
ASSOCIATE EDITOR: Maria Itayra Padilha

Publication Dates

  • Publication in this collection
    17 Oct 2022
  • Date of issue
    2022

History

  • Received
    23 Jan 2022
  • Accepted
    12 June 2022
Associação Brasileira de Enfermagem SGA Norte Quadra 603 Conj. "B" - Av. L2 Norte 70830-102 Brasília, DF, Brasil, Tel.: (55 61) 3226-0653, Fax: (55 61) 3225-4473 - Brasília - DF - Brazil
E-mail: reben@abennacional.org.br