Cultural adaptation and validation of the Strategies to end seclusion restraint module of the QualityRights ToolKit*

Abstract

Objective

to adapt to the Brazilian culture and validate the module “Strategies to end seclusion restraint” of the QualityRights toolkit of the World Health Organization on mental disorders to train health professionals in Brazil.

Method

it is a methodological study divided into three stages. The modules were translated from the original language (English) to the target language (Brazilian Portuguese) in the first stage. In the second, the translation was assessed by a committee of judges with seven experts. In the third stage, the assessment was conducted by mental health professionals (nurses, psychologists, and lawyers), in which seven mental health professionals participated. They assessed the material using the Suitability Assessment of Materials instrument.

Results

in the assessment conducted by the experts (n=7), 8 items assessed obtained 100% approval and the other 6 items obtained lower approvals, with a total approval of 92%. Regarding the assessment by health professionals (n=7), 2 items had a maximum approval of 100% and the other had the approval of 86% each, with a total approval of 88%.

Conclusion

based on the results, it is considered that this module is adapted to the Brazilian culture and can be used to train Brazilian health professionals.

Descriptors:
Mental Health; Mental Disorders; Human Rights; Physical Restraint; Validation Study; Inservice Training

Resumo

Objetivo

adaptar para a cultura brasileira e validar o módulo “Strategies to end seclusion restraint” do toolkit QualityRights da Organização Mundial da Saúde sobre transtornos mentais para a capacitação de profissionais de saúde no Brasil.

Método

trata-se de estudo metodológico, dividido em três etapas. Na primeira, foi realizada tradução dos módulos da língua original (inglês) para a língua-alvo (português brasileiro). Na segunda, foi realizada a avaliação da tradução por um comitê de juízes composto de sete especialistas. Na terceira etapa, foi realizada a avaliação por profissionais de saúde mental (enfermeiros, psicólogos e advogados), da qual participaram sete profissionais de saúde mental. Eles avaliaram o material por meio do instrumento Suitability Assessment of Materials.

Resultados

na avaliação realizada pelos especialistas (n=7), 8 itens avaliados obtiveram 100% de aprovação e os outros 6 itens aprovações menores, obtendo-se uma aprovação total de 92%. Quanto à avaliação realizada pelos profissionais de saúde (n=7), 2 itens tiveram aprovação máxima de 100% e os demais tiveram aprovação de 86% cada um, obtendo-se aprovação total de 88%.

Conclusão

com base nos resultados, considera-se que este módulo está adaptado para a cultura brasileira, podendo ser utilizado para a capacitação de profissionais de saúde brasileiros.

Descritores:
Saúde Mental; Transtornos Mentais; Direitos Humanos; Restrição Física; Estudo de Validação; Capacitação em Serviço

Resumen

Objetivo

adaptar a la cultura brasileña y validar el módulo “Strategies to end seclusion restraint del ‘toolkit QualityRights’” de la Organización Mundial de la Salud sobre trastornos mentales para la capacitación de profesionales de la salud en Brasil.

Método

se trata de un estudio metodológico, dividido en tres etapas. En la primera, fue realizada la traducción de los módulos de la lengua original (inglés) a la lengua objetivo (portugués brasileño). En la segunda, fue realizada la evaluación de la traducción por un comité de jueces compuesto de siete especialistas. En la tercera etapa, fue realizada la evaluación por profesionales de la salud mental (enfermeros, psicólogos y abogados), de la cual participaron siete profesionales de la salud mental. Ellos evaluaron el material por medio del instrumento Suitability Assessment of Materials.

Resultados

en la evaluación realizada por los especialistas (n=7), 8 ítems evaluados obtuvieron 100% de aprobación y los otros 6 ítems aprobaciones menores, obteniéndose una aprobación total del 92%. En cuanto a la evaluación realizada por los profesionales de la salud (n=7), 2 ítems tuvieron aprobación máxima del 100% y los demás tuvieron aprobación del 86% cada uno, obteniéndose aprobación total del 88%.

Conclusión

con base en los resultados, se considera que este módulo está adaptado a la cultura brasileña, pudiendo ser utilizado para la capacitación de profesionales de la salud brasileños.

Descriptores:
Salud Mental; Trastornos Mentales; Derechos Humanos; Restricción Física; Estudio de Validación; Capacitación en Servicio

Highlights

(1) The paper is the first study to validate one of the modules of the QualityRights Initiative.

(2) It aims to promote the human rights of people with mental disorders.

(3) It promotes alternatives to the non-use of coercive practices.

(4) It was validated with the target audience, ensuring it was understandable for everyone.

Introduction

Currently, despite considerable advances in research on how to prevent and treat people with mental disorders, respecting their dignity and diversity, besides promoting mental health, the translation of these assumptions into real-world effects has been slow. The global burden of mental disorders has increased in all countries, especially in the context of major demographic, environmental, and sociopolitical transitions. Additionally, human rights violations and abuses of this population persist, with many people locked away in mental health services and prisons or living on the streets without any political and legal protection. Still, the quality of mental health services is worse than that of other health services in general, as government investment and mental health care remain small¹.

Among the risk factors that can lead to the development of a mental disorder, the following are emphasized: physical, sexual, and emotional abuse, neglect, poverty, loss of a parent, domestic violence, serious physical illness, exposure to parental mental illness, and misuse of substances². People living in low- and middle-income countries are exposed to many factors that make them vulnerable to the development of mental disorders³.

Concerning the treatment possibilities, different principles for mental health care advocate that each institution should provide a therapeutic environment that supports a culture of recovery, individual training, and responsibility, in which the patient has an active voice in determining their treatment options⁴. However, a study conducted in Norway concluded that 13 people per 100,000 inhabitants per year (1.7% of hospitalized patients) were submitted to restraint in the wards in the eight-year period from 2004 to 2011 in the country⁵.

Physical restraint involves direct physical contact between people, a procedure in which force is applied against resistance, either to restrict movement or mobility or to get rid of the harmful behavior presented by an individual. Chemical restraint includes the use of medicines, and mechanical restraint includes the use of equipment⁴. Physical restraints cause a series of severe clinical and ethical problems, violating the patient’s autonomy, the principles of justice, beneficence, and non-maleficence, since restraints can cause physical injuries, including skin lesions, damage to the nervous system, lung disease, deep vein thrombosis, or even death, in addition to causing trauma to health professionals, therefore, such practice should be considered illegal⁶.

Thus, it is relevant to ensure that people with mental disorders enjoy different means of access to the exercise of their rights to deal with their growing vulnerability and social exclusion⁷. The training of mental health services and different actors, such as health professionals, people with mental disorders, their families, and the population in general, is an urgent need that has not been able to attract sufficient attention and funding⁸.

Thus, the World Health Organization (WHO) developed the QualityRights initiative, with an initial emphasis on promoting sustainable changes in attitudes and practices in mental health and ensuring respect for the human rights of people with mental health problems and psychosocial disabilities. An important goal of the WHO QualityRights initiative is to provide practical solutions to promote human rights in all mental and social health systems and, in particular, support countries in enforcing the rights of the Convention. QualityRights resources are designed to train people in mental health, focusing on respect for human rights and recovery, reaching a wide range of stakeholders⁹.

The QualityRights project is the result of the efforts of an international working group, divided into two parts, the first consists of the formatting and dissemination of a “toolkit” to support States in assessing and improving quality and respect for human rights in national, regional, and local mental health and social assistance services¹⁰; the second part of the QualityRights Initiative refers to training and guidance materials, which can be used to train mental health professionals, people with psychosocial, intellectual, and cognitive disabilities, people who use mental health services, families, caregivers and other supporters such as non-governmental organizations, organizations of people with disabilities and others, on how to implement a human rights and recovery approach in the area of mental health and in line with the Convention on the Rights of Persons with Disabilities (CRPD) and other international human rights standards¹¹.

These resources include five basic training modules addressing human rights, mental health, disability, capacity, recovery, and the right to freedom from coercion, violence, and abuse. There are also three specialized training modules addressing recovery practices, strategies to end seclusion and restraint, and support in decision making and early planning. These modules are designed to be taught in workshops conducted by multidisciplinary teams, including people experienced with mental disorders. They are addressed to all people involved in mental health services, from service users and family members to physicians and managers. The modules are flexible and can be adjusted to meeting the participants’ needs¹².

A study that showed the application of the QualityRights training program in Iceland reports that the results revealed changes in attitude among the participants after completing the program. High levels of attitude change are demonstrated in more than three quarters of the statements from the pre-test to the post-test of the training. The use of coercive practices such as chemical restraint also presented changes in attitude¹³. In this perspective, to improve the quality and safety of care in psychiatric hospitals and reduce restrictive measures, it is recommended to use the personnel training led by the WHO¹⁴.

This study has the following guiding question: “Will the validation and cultural adaptation of QualityRights modules be understandable aiming at training health professionals in Brazil?”. It aims, therefore, from its validation, to contribute to the care provided in health services throughout the national territory, promoting knowledge and demonstrating means to ensure the exercise of human rights of people with mental disorders for all actors involved in care, including people with mental disorders themselves; thus, it highlights strategies to reduce the use of coercive measures such as seclusion and restraint, improving the quality of life and care provided to people with mental disorders.

Therefore, the validated modules will be important allies in the training of health professionals in Brazil, especially in the category of nursing professionals, who constitute the largest class of health professionals in the country, playing a unique, crucial and close role to people with mental disorders, because the modules allow professionals to improve the care offered, based on the guarantee of human rights and the principles of ethics, considering the patient as the main actor of their life and recovery.

The research aimed to adapt to the Brazilian culture and validate the module “Strategies to end seclusion restraint” of the QualityRights toolkit of the World Health Organization on mental disorders to train health professionals in Brazil.

Method

Type of study

This is a methodological study focused on developing, assessing and improving an instrument or strategy¹⁵, organized according to the Revised Standards for Quality Improvement Reporting Excellence (SQUIRE 2.0) guidelines of the Equator Network. This type of study aims to elaborate, assess, and validate the technologies created to ensure their reliability for use in educational and care environments¹⁶. The methodological proposal for validating the modules was adapted for this study based on the models of Beaton¹⁷ and Pasquali¹⁸. The stages completed are described below:

1. Translation¹⁷;

2. Analysis of the Judges¹⁸;

3. Pre-test¹⁸.

Study stages

1^stStage: Translation: the modules were translated from the original language (English) into the target language (Brazilian Portuguese) by two independent translators, native to the target language and with different occupations. This technique makes it possible to detect divergent errors and interpretations. This process aims to preserve the meaning of each item between the two languages and maintain the integrity of the measuring instrument¹⁷. After analyzing the two versions of translations, there was a consensus, reaching a single version, called the final version1.

2^ndStage: Committee of judges: a total of ten experts on the themes of this study were invited; however, two responses were not obtained and one of them refused to participate. Thus, seven experts agreed to participate, receiving the final version of the module’s translation to read, analyze, and assess the material through the Suitability Assessment of Materials (SAM) scale (adapted for this study). For this type of validation, six to ten experts are recommended¹⁹. After this stage, the analysis of the data sent by the experts and the adjustments in the module were conducted, resulting in the final version2.

3^rdStage: Pre-test: seven professionals from a Psychosocial Care Center in the countryside of the state of São Paulo were invited; however, only four professionals analyzed the material and sent it back to the researchers. Mental health professionals from other services were also invited, using the convenience sampling technique^15-16. Nine more health professionals from other mental health services were invited. Among these, four did not respond to the email if they would accept to participate in the research; two health professionals agreed to participate in the research but did not send the analyzed material back to the researchers and three agreed to participate in the research and sent back the analyzed material.

In total, seven health professionals participated in this stage and they received the final version2 of the translation of the module to read, analyze, and assess the material through the Suitability Assessment of Materials (SAM) scale (adapted for this study). For this type of validation, six to ten participants are recommended¹⁹.

After data analysis, the suggestions of the professionals were grouped, analyzed, and accepted. After the modifications suggested by them were made, a new version of the module was obtained. It was the last version, that is, the final version3.

Figure 1
Stages of the translation, cultural adaptation, and validation process. Ribeirão Preto, SP, Brazil, 2021

Instruments used to collect information

To verify the agreement of the participants in relation to the items of the analysis, the adaptation of the Suitability Assessment of Materials (SAM) instrument was used, which includes questions to assess the difficulty and convenience of educational materials²⁰, adapted and culturally validated²¹.

The American instrument called SAM consists of a list or checklist with six categories (content, understanding of the text, illustration, presentation, motivation and cultural adaptation). The application requires less than 15 minutes. The sum of the points attributed to each instrument item categorizes the material as to the suitability for the target audience²¹.

According to how it was adapted for this study, the instrument presented the following subcategories: In the item Content: Is the objective evident, facilitating the understanding of the material? The content addresses information related to mental disorders and human rights; Is the material proposal suitable to the objectives? In the item Language: Is the information passed on within a clear context? Is the reading level suitable for the reader’s understanding? Does the vocabulary use common words? Is learning facilitated by topics? In the Graphic illustrations item: Are the illustrations relevant? In the item Presentation: Is the material organization suitable? Are the font size and font suitable? In the item Stimulation/Motivation: Are the desired behavior patterns well modeled or demonstrated? Is there motivation to change behavior? In the item Cultural Suitability: Is the material culturally suitable to the logic, language, and experience of the target audience? Does it present culturally suitable examples?

To better understand the participants, the Likert scale was used, a psychometric scale that intends to record the level of agreement or disagreement of a given information^22-23.

Data processing and analysis

The professional information about the experts and health professionals and their sociodemographic data were coded and typed in spreadsheets of the Excel application. Descriptive analysis was performed with the calculation of frequencies and percentages through the IBM SPSS Statistics v.25 software.

To analyze the data of the assessment performed by the SAM instrument, the mean agreement between participants was calculated²⁴ through the content validity index (CVI), which is a measure calculated based on the representativeness of positive responses through various methods. First, it is recommended to calculate the CVI for each item, counting the number of experts or professionals who classified the item as three or four and dividing this number by the total number of experts. This results in the proportion of experts who considered the item as valid content²⁵.

Thus, the CVI measures the proportion or percentage of judges who agree on certain aspects of the instrument and its items. Items marked with “Agree” or “Strongly Agree” are considered representative, obtaining an index score of 1.00 and the item that has all assessments equal to 1.00 will have 100% agreement²⁶.

To perform this calculation, the responses of the items were regrouped and the values that corresponded to 0 and 1 on the Likert scale (strongly disagree and disagree) started to correspond to (-1); when the value was 2 (neutral/indifferent), it became (0) and when the values were 3 and 4, it became (+1). Thus, the response of each judge could vary from -1 to +1, and the closer to +1, the greater the agreement that the item was pertinent. Based on these responses, it was possible to calculate the means of agreement of the committee of judges, calculating the percentage of responses corresponding to the value +1²⁴. For the item to be approved, an agreement of at least 80% among professionals is required¹⁸.

The assessment of the instrument in its entirety does not require consensus in the literature. Besides, there are three ways in which the mean of the proportions of the items considered relevant by the judges; the mean of the values of the items calculated separately, that is, all CVIs calculated separately are added and divided by the number of items considered in the assessment. The last way would be to divide the “total number of items considered relevant by the judges by the total number of items”. In the case of six or more, a rate of not less than 0.78 is recommended¹⁹. Thus, it was decided to divide the total number of items considered relevant (with response 1 - agree or strongly agree) by the total number of items answered in the instrument.

The SAM instrument allows participants to express opinions and suggestions on each item. Thus, the experts’ suggestions were grouped, analyzed and reasonable modifications were made.

Ethical aspects

This study was approved by the Research Ethics Committee of the University of São Paulo at Ribeirão Preto College of Nursing (CAAE: 21828819.4.0000.5393 and Opinion Number: 3,743,964). The Free and Informed Consent Form was given to the committee of judges and the health professionals who participated in the study.

Results

Regarding the Committee of Judges, of the seven participating experts, all (100%) were female. The age of each expert varied, with a mean of 42.3 years. Regarding the professions, one expert (14.3%) was a lawyer, three (42.9%) were nurses, one (14.3%) was a nurse and university professor and two (28.6%) were psychologists. The time since graduation also ranged from seven years to 31 years, with a mean of 19.1 years.

Regarding the degree, four (57.1%) had a doctoral degree, two (28.6%) had a master’s degree and one (14.3%) had a postdoctoral degree.

The seven experts (100%) participated in a training course in the last five years, with a mean of 9.3 participations; all (100%) published scientific articles in the last five years with a mean of 6.6 publications. Besides, the seven experts (100%) stated that they presented works in the last five years, with a mean of 21.1 presentations per expert.

The tables in sequence summarize the participants’ information.

Table 1
Participants in the Committee of Judges stage (n=7) according to sociodemographic characteristics. Ribeirão Preto, SP, Brazil, 2021

Characteristics of Study Participants (Committee of Judges)	% of respondents (N=7)
Age (years old)
31	14.3	Mean	42.3
33	14.3	Median	43.0
36	14.3	Standard Deviation	9.2
43	14.3	Minimum	31
47	14.3	Maximum	53
53	28.6
Sex
Female	100.0
Profession
Lawyer	14.3
Nurse	42.9
Nurse and University Professor	14.3
Psychologist	28.6
Time since graduation (years)
7	14.3	Mean	19.1
10	14.3	Median	19.0
13	14.3	Standard deviation	9.5
19	14.3	Minimum	7
25	14.3	Maximum	31
29	14.3
31	14.3
Current working time (years)
0.08	14.3	Mean	12.05
0.25	14.3	Median	6
4	14.3	Standard deviation	12.55
6	14.3	Minimum	0.08
18	14.3	Maximum	31
25	14.3
31	14.3
Title/Degree
Master’s	28.6
Doctorate	57.1
Post-doctorate	14.3
Do you work in the area of interest?
Yes	100.0
What is the area of interest?
Teaching	14.3
Mental health	71.4
Mental Health/Scholar	14.3
Participation in training courses
Yes	100.0
Amount of participation
2	14.3	Mean	9.3
3	14.3	Median	8.0
5	14.3	Standard deviation	6.9
8	14.3	Minimum	2
10	14.3	Maximum	20
17	14.3
20	14.3
Article publication in the last 5 years
Yes	100.0
Number of articles published
2	28.6	Mean	6.6
6	14.3	Median	7.0
7	14.3	Standard deviation	3.8
8	28.6	Minimum	2
13	14.3	Maximum	13
Presentation of works in the last 5 years
Yes	100.0
Number of presentations
2	14.3	Mean	21.1
3	14.3	Median	8.0
6	14.3	Standard deviation	36.8
8	14.3	Minimum	2
12	14.3	Maximum	104
13	14.3
104	14.3

Regarding Health Professionals, six participants (85.7%) were female and one (14.3%) was male. The age of each participant ranged from 25 to 48 years, with a mean age of 35.9 years. Regarding the professions, one professional (14.3%) was a social worker, two (28.6%) were nurses, one (14.3%) was a psychiatric nurse, two (28.6%) were psychologists and one (14.3%) was an occupational therapist. The time that the professionals were working or had already worked in mental health also varied for each expert, between a minimum of six months and a maximum of 24 years and the mean was 9.5 years, as shown in the following table (Table 2).

Table 2
Health professionals (n= 7) according to sociodemographic characteristics. Ribeirão Preto, SP, Brazil, 2021

Characteristics of Health Professionals participating in the study	% of respondents (N=7)
Age (years old)
25	14.3	Mean/Median	35.9/35.0
27	14.3	Standard deviation	8.5
32	14.3	Minimum	25
35	14.3	Maximum	48
41	14.3
43	14.3
48	14.3
Sex
Female	85.7
Male	14.3
Profession
Social Worker	14.3
Nurse	28.6
Psychiatric Nurse	14.3
Psychologist Occupational therapist	28.6 14.3
Time since graduation (years)
2	14.3	Mean/Median	11.3/12.0
4	14.3	Standard deviation	7.5
10	14.3	Minimum	2
12	28.6	Maximum	25
14	14.3
25	14.3
Time working/worked in the mental health (years)
0.50	14.3	Mean/Median	9.58/9
0.58	14.3	Standard deviation	8.79
5	14.3	Minimum	0.5
9	14.3	Maximum	24
10	14.3
18	14.3
24	14.3
Title/Degree
Bachelor’s and Teaching Degree	14.3
Specialization/Residency	42.9
Doctorate	28.6
Specialization/Residency and master’s degree	14.3
Do you work in the area of interest
No answer	14.3
Yes	85.7
What is the area of interest?
Research	14.3
Mental health	71.4
No answer	14.3
Participation in training courses
Yes	85.7
No	14.3
Amount of participation
0	14.3	Mean/Median	3.9/3.0
1	14.3	Standard deviation	3.6
3	28.6	Minimum	0
4	14.3	Maximum	11
5	14.3
11	14.3
Article published in the last 5 years
Yes	42.9
No	57.1
Number of articles published
0	57.1	Mean/Median	1.3/0.0
2	28.6	Standard deviation	1.9
5	14.3	Minimum	0
		Maximum	5
Presentation of works in the last 5 years
Yes	42.7
No	57.1
Number of presentations
0	57.1	Mean/Median	1.6/0.0
2	14.3	Standard deviation	2.1
4	14.3	Minimum	0
5	14.3	Maximum	5

Regarding the assessment conducted by the experts, of the 14 items assessed, 8 obtained 100% approval (57.14% of the items) and in 2 of them (Q6 and Q8), the lowest approvals (71%) were obtained. The total approval percentage of the module was 92%.

Regarding the assessment conducted by health professionals, the percentage of approval varied by item and two (Q9 and Q10) - corresponding to 14.2% of the items - had a maximum approval of 100% and the other (corresponding to 85.71% of the items) had the approval of 86% each. The total approval percentage of the module was 88%.

The results of the analysis of the judges and health professionals can be seen in the following Table 3.

Table 3
Analysis of the committee of judges (n=7) and health professionals (n=7) according to the approval. Ribeirão Preto, SP, Brazil, 2021

Judge/Assessment in each question (Q1; Q2...)	J1	J2	J3	J4	J5	J6	J7	CVI*	Approval percentage per item
Q1 - Is the objective evident, facilitating the understanding of the material?	1	1	1	1	1	1	1	1.0	100%
Q2 - Does the content address information related to mental disorders and human rights?	1	1	1	1	1	1	1	1.0	100%
Q3 - Is the material proposal suitable to the objectives?	1	1	1	1	1	1	1	1.0	100%
Q4 - Is the information passed on within a clear context?	1	1	1	1	1	1	1	1.0	100%
Q5 - Is the reading level suitable for the reader’s understanding?	1	1	1	1	1	1	0	0.86	86%
Q6 - Does the vocabulary use common words?	1	0	1	1	1	1	0	0.71	71%
Q7 - Is learning facilitated by topics?	1	1	1	1	1	1	1	1.0	100%
Q8 - Are the illustrations relevant?	0	1	1	1	1	-1	1	0.71	71%
Q9 - Is the material organization suitable?	1	1	1	1	1	1	1	1.0	100%
Q10 - Are the font size and font suitable?	1	1	1	1	1	1	1	1.0	100%
Q11 - Are the desired behavior patterns well modeled or demonstrated?	1	1	1	1	1	1	0	0.86	86%
Q12 - Is there motivation to change behavior?	1	1	1	1	1	1	1	1.0	100%
Q13 - Is the material culturally suitable to the logic, language, and experience of the target audience?	1	1	1	1	1	1	0	0.86	86%
Q14 - Does it present culturally suitable examples?	1	0	1	1	1	1	1	0.86	86%
Total Approval								0.92	92%
Health Professionals/Assessment on each question (Q1; Q2...)	P1	P2	P3	P4	P5	P6	P7	CVI	Approval percentage per item
Q1 - Is the objective evident, facilitating the understanding of the material?	1	1	1	1	1	1	0	0.86	86%
Q2 - Does the content address information related to mental disorders and human rights?	1	1	1	1	1	1	0	0.86	86%
Q3 - Is the material proposal suitable to the objectives?	1	1	1	1	1	1	0	0.86	86%
Q4 - Is the information passed on within a clear context?	1	1	1	1	1	1	0	0.86	86%
Q5 - Is the reading level suitable for the reader’s understanding?	1	1	1	1	1	1	0	0.86	86%
Q6 - Does the vocabulary use common words?	1	1	1	1	1	1	0	0.86	86%
Q7 - Is learning facilitated by topics?	1	1	1	1	1	1	0	0.86	86%
Q8 - Are the illustrations relevant?	1	1	1	1	1	1	0	0.86	86%
Q9 - Is the material organization suitable?	1	1	1	1	1	1	1	1.0	100%
Q10 - Are the font size and font suitable?	1	1	1	1	1	1	1	1.0	100%
Q11 - Are the desired behavior patterns well modeled or demonstrated?	1	1	1	1	1	1	0	0.86	86%
Q12 - Is there motivation to change behavior?	1	1	1	1	1	1	0	0.86	86%
Q13 - Is the material culturally suitable to the logic, language, and experience of the target audience?	1	1	1	1	1	1	0	0.86	86%
Q14 - Does it present culturally suitable examples?	1	1	1	1	1	1	0	0.86	86%
Total Approval								0.88	88%

• *CVI = Content Validity Index

Still, the committee of judges and health professionals made suggestions regarding the material, summarized in the following figure:

Figure 2
Suggestions from study participants. Ribeirão Preto, SP, Brazil, 2021

Main suggestions of the judges (J1; J2...) in FV2*	Main suggestions of health professionals (P1; P2...) in FV3†
(...) I suggest reflecting on the vocabulary/language presented, mainly in the initial topics. (J7)	Continuous reading becomes tiresome, but it becomes interesting and enlightening for items. The translation was performed very well, and reading is possible without reservations. (P3)
It would be interesting to invest in mental maps to facilitate the understanding of elementary and middle-level professionals. (J2)	The final graphic assists in understanding the material as a whole. (P4)
The material does not contain illustrations (photos, images, and figures). However, considering the tables and flowchart that appear as illustrations, we can consider them relevant. Link images can also be considered relevant. (J1)	I found the reading only a little extensive, tables and summary helped in the synthesis and overview of the set (P6)
I did not see the need for illustrations of the material, in addition to the QualityRights initiative symbol. (J6)	I believe that just by reading it becomes difficult, motivating the practical experience with this material would be richer. (...) Very rich material, but the reading becomes tiresome and extensive. (P4)
It would be interesting to include clearer and more frequent examples in the Brazilian reality. (J2)	I could attach real Brazilian cases to exemplify the topics and approach culturally. (P5)
The material content is very rich!!! (...) I believe that the topic of the module that will imply greater implementation challenges will be Topic 4- “Challenging assumptions about seclusion and restraint”, as it involves everyday beliefs and situations of health services related to experiences of violence, anchored in fear and dangerousness and justified by the desire to protect. It may be interesting to encourage, indeed, the exposure of own examples, using exercises with strategies that involve more sensitivity, emotions. (J5)	The material is excellent, it can be adapted to various target audiences, bringing the discussion of a topic of extreme importance in mental health services in Brazil. (P2)

• ^*Final version 2; ^†Final version 3.

Discussion

The discussion was divided into two categories: Understanding the analysis of the Committee of Judges and Understanding the analysis of Health Professionals.

Understanding the analysis of the Committee of Judges

It is necessary to validate educational materials to create a version that achieves equivalence between the original and translated versions. The translation and validation process requires high methodological rigor that consists of the instrument’s translation and revision by a committee of experts²⁷. The validation process with assessing items related to the objective, structure/presentation and relevance is vital so that educational materials do not have mistaken or incomplete information, that can mislead the target population or hinder the understanding of the theme²⁸. After translation, assessment by the panel of experts is an important stage to identify terms that the target audience may not understand and, thus, change them²⁹.

The Committee of Judges of this study assessed a module of the QualityRights Initiative. The items that obtained agreement indexes between the judges greater than or equal to 80% were considered validated^18,24. Although the literature indicates that an agreement index greater than or equal to 70% is sufficient for an item to be considered validated, a higher agreement index was chosen, since there is no knowledge of studies already conducted validating educational modules such as this one²⁴.

Some categories did not achieve 100% approval in this process, obtaining less than 80%. To improve the assessments and achieve an excellent acceptability index of the module regarding its cultural adaptation, all changes were based on the judges’ suggestions, besides the assessments conducted. In addition, it was decided not to insert more illustrations due to the suggestions of some judges, for whom the illustrations were unnecessary.

As in other material validation studies, the main suggestions for modifications were concerning the wording of the items, such as the substitution of some words and standardization of others³⁰, which allowed the suitability of the terminology used and clarification of the information transmitted, thus ensuring the consistency of the textual and visual resources of the material³¹.

It is important to draw attention to the domains with the lowest proportion of positive responses (71%). This fact can be explained due to the amount of information presented in the material. Nevertheless, this can be minimized by correctly using the material, offering it as a course associated with health education actions, not only reading³². It is noteworthy that, despite these lower assessments, the items did not receive negative assessments from any judge; however, adjustments were made in the translations of the words/phrases to enable a more understandable language for the Brazilian population. As in another study, some items achieved lower scores, being corrected, guided by the judges’ recommendations, and the content was reviewed for the scientific basis, the cultural context of the target audience and grammatically reviewed³³.

Regarding the validation process, the professional diversity of the committee of judges proved to be a very favorable factor since it grouped different knowledge of different specialties within the theme addressed by the module, resulting in a multidisciplinary and complete work³⁴. Thus, the semantic, idiomatic, cultural and conceptual equivalences obtained by the assessment of a committee of experts in relation to the original Brazilian Portuguese version were certified and good content validity indexes assessed by the committee of judges were obtained³⁵. All suggestions were accepted or justified and the module received total approval of 92%, being considered culturally adapted and validated for Brazilian culture, according to the face and content validation by the committee of judges.

Understanding the analysis of health professionals

Besides having correct information and being valid concerning the content, health education materials must be understandable by the target audience. In this perspective, health professionals experienced with mental health conducted the content validation and suggested minor adjustments^28,36.

It is essential to highlight that the planning of this study was built in a systematic way to understand the scenario and facilitate the approach and the type of action for the transformation of practice and, consequently, of reality, seeking to maintain the creative, consistent, and innovative didactic design that the material already had³⁷.

The assessment conducted by the team of mental health professionals of this investigation resulted in some items with maximum approval (100%) and others with 86% approval. After the necessary adjustments were made, the target audience (health professionals) positively assessed the material in the previous stage, considering it interesting, interactive, explanatory, and motivating. This assessment showed that the material could be used for Brazilian health professionals, with levels of agreement of positive responses greater than 80%³².

The study results approached the validation of another material validation research, in which a positive level of agreement equal to 88.4% was observed in the responses of the target audience. Despite being a good result, the difficulty faced when dealing with such a demanding audience is evident, as was also noticed in this study³⁸.

The professionals’ suggestions were analyzed and used to modify the content to improve the material related to the cultural adaptation process. This process contributed to enriching the educational proposal, especially in the items that did not have 100% approval since these assessments and suggestions came from professionals who share the purpose of qualification in mental health³⁹. The results indicate the importance of investigating the opinion of the target population of the study on the use of materials so that the final version available is as compatible as possible with their autonomy. This corroborates the population’s active participation in the teaching-learning processes on prevention, recovery, and health rehabilitation³⁶. As in another study in the literature, the target audience’s contributions and observations were recorded to ensure the best quality of the educational material for the population³⁸.

The material approached, used as a course, has great potential to raise awareness of the target audience and needs to be understandable by anyone, clear in its technical-scientific approach. Thus, participants need to understand and apprehend the guidelines to be transmitted, besides being clear, simple, and direct, making communication effective³¹.

Therefore, the importance of this module for the experience of health professionals is emphasized since the constant and dynamic transformations undergone by modern society impose an increase in qualified professional demands, requiring more and more people with specific knowledge and skills to achieve the expected levels of development⁴⁰. Finally, as in another innovative study, it is noteworthy that this Brazilian version of the module is the first to be made available since other validation versions for this specific context and material were not found in the literature⁴⁰. It is clear, then, the need to develop innovative methods such as this one, capable of promoting health actions⁴¹.

It is noteworthy that the suggestions were widely discussed until the final version was obtained. The analysis of the conceptual and material equivalence between the original version and the one translated and culturally adapted contributed to consolidating a consensual version of the module into Brazilian Portuguese⁴². Therefore, it is considered that the instrument was able to meet the purposes for which it was developed, being able to guide the construction of knowledge in health in different formats³⁰. Although the results show that the content of this module is validated by health professionals and is therefore easy to understand for the target audience, it is considered necessary to develop other studies that prove the effectiveness of transforming the reality of this material⁴³. It is noteworthy as a limitation the lack of offer of the module as a course for the target audience, requiring, therefore, more studies to test the effectiveness of its application in practice, also considering the question of how this material will affect the knowledge and practices of health professionals.

It is also reinforced that the study can contribute to the advancement of scientific knowledge in health and nursing, improving the care provided based on respect for the human rights of people with mental disorders.

Conclusion

The module was translated into Brazilian Portuguese by three professionals from different occupations. It was assessed by a committee of judges, experts in the subject, receiving a total approval of 92%. Most of the suggestions were accepted. Soon after, to certify that the material was understandable to the entire population, especially to the target audience, the content was assessed by mental health professionals, receiving a total approval of 82%. Besides that, almost all suggestions were accepted, and those that were not had justifications.

Based on the results evidenced, this module is considered validated and adapted to the Brazilian culture, according to the face and content and can be used, aiming at the training of Brazilian health professionals. It is crucial that, after this validation, the module is offered through a course for mental health professionals, aiming to analyze its effectiveness.

Finally, it is emphasized that with the results of this study important measures to reduce coercive practices can be implemented in the daily life of services, improving the quality of care provided and the quality of life of people with mental disorders.

Referências

• ¹
  Patel V, Saxena S, Lund C, Thornicroft G, Baingana F, Bolton P, et al. The Lancet Commission on global mental health and sustainable development. Lancet [Internet]. 2018 [cited 2021 Aug 5] Oct;392(10157):1553-98. Available from: https://linkinghub.elsevier.com/retrieve/pii/S014067361831612X
  » https://linkinghub.elsevier.com/retrieve/pii/S014067361831612X
• ²
  Jorm AF, Mulder RT. Prevention of mental disorders requires action on adverse childhood experiences. Aust New Zeal J Psychiatry [Internet]. 2018 [cited 2021 Aug 5] Apr 5;52(4):316-9. Available from: http://journals.sagepub.com/doi/10.1177/0004867418761581
  » http://journals.sagepub.com/doi/10.1177/0004867418761581
• ³
  Purgato M, Gastaldon C, Papola D, van Ommeren M, Barbui C, Tol WA. Psychological therapies for the treatment of mental disorders in low- and middle-income countries affected by humanitarian crises. Cochrane Database Syst Rev [Internet]. 2018 [cited 2021 Aug 5] Jul 5. Available from: http://doi.wiley.com/10.1002/14651858.CD011849.pub2
  » http://doi.wiley.com/10.1002/14651858.CD011849.pub2
• ⁴
  Raveesh BN, Lepping P. Restraint guidelines for mental health services in India. Indian J Psychiatry [Internet]. 2019 [cited 2021 Aug 5] Apr;61(Suppl 4):S698-705. Available from: http://www.ncbi.nlm.nih.gov/pubmed/31040460
  » http://www.ncbi.nlm.nih.gov/pubmed/31040460
• ⁵
  Reitan SK, Helvik AS, Iversen V. Use of mechanical and pharmacological restraint over an eight-year period and its relation to clinical factors. Nord J Psychiatry [Internet]. 2018 [cited 2021 Aug 5] Jan 2;72(1):24-30. Available from: https://www.tandfonline.com/doi/full/10.1080/08039488.2017.1373854
  » https://www.tandfonline.com/doi/full/10.1080/08039488.2017.1373854
• ⁶
  Ye J, Xiao A, Yu L, Wei H, Wang C, Luo T. Physical restraints: An ethical dilemma in mental health services in China. Int J Nurs Sci [Internet]. 2018 [cited 2021 Aug 5] Jan;5(1):68-71. Available from: https://linkinghub.elsevier.com/retrieve/pii/S2352013217301217
  » https://linkinghub.elsevier.com/retrieve/pii/S2352013217301217
• ⁷
  Zanardo ABR, Rodríguez AMMM, Ventura CAA. Living conditions of persons with mental and behavioral disorders in a psychiatric hospital, São Paulo, Brazil. Arch Psychiatr Nurs [Internet]. 2021 [cited 2021 Aug 5] Feb;35(1):49-55. Available from: https://linkinghub.elsevier.com/retrieve/pii/S0883941720306026
  » https://linkinghub.elsevier.com/retrieve/pii/S0883941720306026
• ⁸
  Wainberg ML, Scorza P, Shultz JM, Helpman L, Mootz JJ, Johnson KA, et al. Challenges and Opportunities in Global Mental Health: a Research-to-Practice Perspective. Curr Psychiatry Rep [Internet]. 2017 [cited 2021 Aug 5] May 19;19(5):28. Available from: http://link.springer.com/10.1007/s11920-017-0780-z
  » http://link.springer.com/10.1007/s11920-017-0780-z
• ⁹
  Funk M, Bold ND. WHO's QualityRights Initiative: Transforming Services and Promoting Rights in Mental Health. Health Hum Rights [Internet]. 2020 [cited 2021 Aug 5] Jun;22(1):69-75. Available from: http://www.ncbi.nlm.nih.gov/pubmed/32669790
  » http://www.ncbi.nlm.nih.gov/pubmed/32669790
• ¹⁰
  Barbosa MRN, Pitta AMF. A dignidade humana em Centros de Atenção Psicossocial do Nordeste brasileiro. Cad CEAS Rev Crítica Human [Internet]. 2019 [cited 2021 Aug 5] Jun 28;(246):69. Available from: https://cadernosdoceas.ucsal.br/index.php/cadernosdoceas/article/view/524
  » https://cadernosdoceas.ucsal.br/index.php/cadernosdoceas/article/view/524
• ¹¹
  World Health Organization. QualityRights materials for training, guidance and transformation [Internet]. Geneva: WHO; 2019 [cited 2021 Mar 9]. Available from: https://www.who.int/publications/i/item/who-qualityrights-guidance-and-training-tools
  » https://www.who.int/publications/i/item/who-qualityrights-guidance-and-training-tools
• ¹²
  Duffy RM, Kelly BD. Can the World Health Organisation's 'QualityRights' initiative help reduce coercive practices in psychiatry in Ireland? Ir J Psychol Med [Internet]. 2020 [cited 2021 Aug 5] Aug 17;1-4. Available from: https://www.cambridge.org/core/product/identifier/S0790966720000816/type/journal_article
  » https://www.cambridge.org/core/product/identifier/S0790966720000816/type/journal_article
• ¹³
  Morrissey FE. An evaluation of attitudinal change towards CRPD rights following delivery of the WHO QualityRights training programme. Ethics Med Public Health [Internet]. 2020 [cited 2021 Aug 5] Apr;13:100410. Available from: https://linkinghub.elsevier.com/retrieve/pii/S2352552519300660
  » https://linkinghub.elsevier.com/retrieve/pii/S2352552519300660
• ¹⁴
  Winkler P, Kondrátová L, Kagstrom A, Kucera M, Palánová T, Salomonová M, et al. Adherence to the Convention on the Rights of People with Disabilities in Czech Psychiatric Hospitals: A Nationwide Evaluation Study. Health Hum Rights [Internet]. 2020 [cited 2021 Aug 5] Jun;22(1):21-33. Available from: http://www.ncbi.nlm.nih.gov/pubmed/32669786
  » http://www.ncbi.nlm.nih.gov/pubmed/32669786
• ¹⁵
  Polit DF, Beck CT. Fundamentos da pesquisa em enfermagem: avaliação de evidências para a prática de enfermagem. 7th ed. Porto Alegre: Artmed; 2011. 670 p.
• ¹⁶
  Lobiondo-Wood G, Haber J. Pesquisa em enfermagem: métodos, avaliação crítica e utilização. 4 ed. Rio de Janeiro: Guanabara-Koogan; 2001.
• ¹⁷
  Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the Process of Cross-Cultural Adaptation of Self-Report Measures. Spine (Phila Pa 1976) [Internet]. 2020 [cited 2021 Aug 5] Dec;25(24):3186-91. Available from: http://journals.lww.com/00007632-200012150-00014
  » http://journals.lww.com/00007632-200012150-00014
• ¹⁸
  Pasquali L. Princípios de elaboração de escalas psicológicas. Rev Psiquiatr Clínica. 1998;25(5):206-13.
• ¹⁹
  Polit DF, Beck CT. The content validity index: Are you sure you know what's being reported? Critique and recommendations. Res Nurs Health [Internet]. 2020 [cited 2021 Aug 5] Oct;29(5):489-97. Available from: http://doi.wiley.com/10.1002/nur.20147
  » http://doi.wiley.com/10.1002/nur.20147
• ²⁰
  Doak CC, Doak GL, Root JH. Teaching patients with low literacy skill. 2nd ed. Philadelphia (PA): Lippincott; 1996.
• ²¹
  Sousa CS, Turrini RNT, Poveda VB. Tradução e adaptação do instrumento "Suitability Assessment of Materials" (SAM) para o português. Rev Enferm UFPE On Line. 2015;9(5):7854-61.
• ²²
  Paro BA. Escala Likert: coisas que todo pesquisador deveria saber [Homepage]. 2012 [cited 2021 Aug 5]. Available from: https://www.netquest.com/blog/br/blog/br/a-escala-likert-coisas-que-todo-pesquisador-deveria-saber
  » https://www.netquest.com/blog/br/blog/br/a-escala-likert-coisas-que-todo-pesquisador-deveria-saber
• ²³
  Aguiar B, Correia W, Campos F. Uso da Escala Likert na Análise de Jogos. In: Proceedings of SBGames [Internet]; 2011 Nov. 7-9; Salvador, BA. Porto Alegre: Sociedade Brasileira de Computação; 2011 [cited 2021 Aug 5]. Available from: http://www.sbgames.org/sbgames2011/proceedings/sbgames/papers/art/short/91952.pdf
  » http://www.sbgames.org/sbgames2011/proceedings/sbgames/papers/art/short/91952.pdf
• ²⁴
  Oliveira MS, Fernandes AFC, Sawada NO. Manual educativo para o autocuidado da mulher mastectomizada: um estudo de validação. Texto Contexto Enferm [Internet]. 2008 [cited 2021 Aug 5] Mar;17(1):115-23. Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0104-07072008000100013&lng=pt&tlng=pt
  » http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0104-07072008000100013&lng=pt&tlng=pt
• ²⁵
  Rubio DM, Berg-Weger M, Tebb SS, Lee ES, Rauch S. Objectifying content validity: Conducting a content validity study in social work research. Soc Work Res [Internet]. 2003 [cited 2021 Aug 5] Jun 1;27(2):94-104. Available from: https://academic.oup.com/swr/article-lookup/doi/10.1093/swr/27.2.94
  » https://academic.oup.com/swr/article-lookup/doi/10.1093/swr/27.2.94
• ²⁶
  Aragão JS, França ISX, Coura AS, Sousa FS, Batista JDL, Magalhães IMO. A content validity study of signs, symptoms and diseases/health problems expressed in LIBRAS. Rev. Latino-Am. Enfermagem [Internet]. 2015 [cited 2021 Aug 5] Dec;23(6):1014-23. Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0104-11692015000601014&lng=en&tlng=en
  » http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0104-11692015000601014&lng=en&tlng=en
• ²⁷
  Magacho EJC, Andrade LCF, Costa TJF, Paula EA, Araújo SS, Pinto MA, et al. Translation, cultural adaptation, and validation of the Screening For Occult Renal Disease (SCORED) questionnaire to Brazilian Portuguese. J Bras Nefrol [Internet]. 2012 [cited 2021 Aug 5];34(3):251-8. Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0101-28002012000300006
  » http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0101-28002012000300006
• ²⁸
  Ximenes MAM, Fontenele NAO, Bastos IB, Macêdo TS, Galindo NM Neto, Caetano JA, et al. Construção e validação de conteúdo de cartilha educativa para prevenção de quedas no hospital. Acta Paul Enferm [Internet]. 2019 [cited 2021 Aug 5] Aug;32(4):433-41. Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0103-21002019000400433&tlng=pt
  » http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0103-21002019000400433&tlng=pt
• ²⁹
  Rabeh SAN, Palfreyman S, Souza CBL, Bernardes RM, Caliri MHL. Cultural adaptation of the Pieper-Zulkowski Pressure Ulcer Knowledge Test for use in Brazil. Rev Bras Enferm [Internet]. 2018 [cited 2021 Aug 5] Aug;71(4):1977-84. Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0034-71672018000401977&lng=en&tlng=en
  » http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0034-71672018000401977&lng=en&tlng=en
• ³⁰
  Leite SS, Áfio ACE, Carvalho LV, Silva JM, Almeida PC, Pagliuca LMF. Construction and validation of an Educational Content Validation Instrument in Health. Rev Bras Enferm [Internet]. 2018 [2021 Aug 5];71(suppl 4):1635-41. Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0034-71672018001001635&lng=en&tlng=en
  » http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0034-71672018001001635&lng=en&tlng=en
• ³¹
  Oliveira SC, Oliveira Lopes MV, Carvalho Fernandes AF. Development and validation of an educational booklet for healthy eating during pregnancy. Rev. Latino-Am. Enfermagem [Internet]. 2014 Jul;22(4):611-20. doi: http://doi.org/10.0.6.54/0104-1169.3313.2459
  » https://doi.org/http://doi.org/10.0.6.54/0104-1169.3313.2459
• ³²
  Moura JRA, Silva KCB, Rocha AESH, Santos SD, Amorim TRS, Silva ARV. Construção e validação de cartilha para prevenção do excesso ponderal em adolescentes. Acta Paul Enferm [Internet]. 2019 [cited 2021 Aug 5] Aug;32(4):365-73. Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0103-21002019000400365&tlng=pt
  » http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0103-21002019000400365&tlng=pt
• ³³
  Figueiredo SV, Moreira TMM, Mota CS, Oliveira RS, Gomes ILV. Creation and validation of a health guidance booklet for family members of children with sickle cell disease. Esc Anna Nery [Internet]. 2019 [cited 2021 Aug 5] ;23(1). Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S1414-81452019000100216&tlng=en
  » http://www.scielo.br/scielo.php?script=sci_arttext&pid=S1414-81452019000100216&tlng=en
• ³⁴
  Cruz FOAM, Ferreira EB, Vasques CI, Mata LRF, Reis PED. Validation of an educative manual for patients with head and neck cancer submitted to radiation therapy. Rev. Latino-Am. Enfermagem [Internet]. 2016 [cited 2021 Aug 5];24. Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0104-11692016000100337&lng=en&tlng=en
  » http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0104-11692016000100337&lng=en&tlng=en
• ³⁵
  Fernandes ADBF, Lopes AM, Falcão LM, Silva GRF. Cultural adaptation of the Adaptation Scale to Elimination Ostomy for use in Brazil. Texto Contexto Enferm [Internet]. 2019 [cited 2021 Aug 5];28. Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0104-07072019000100336&tlng=en
  » http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0104-07072019000100336&tlng=en
• ³⁶
  Galindo-Neto NM, Alexandre ACS, Barros LM, Sá GGM, Carvalho KM, Caetano JA. Creation and validation of an educational video for deaf people about cardiopulmonary resuscitation. Rev. Latino-Am. Enfermagem [Internet]. 2019 [cited 2021 Aug 5];27. Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0104-11692019000100321&tlng=en
  » http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0104-11692019000100321&tlng=en
• ³⁷
  Bragagnollo GR, Camargo RAA, Guimarães MN, Santos TS, Monteiro ELM, Ferreira BR. Development and validation of an interactive educational technology on spotted fever. Rev. Latino-Am. Enfermagem [Internet]. 2020 [cited 2021 Aug 5];28. Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0104-11692020000100413&tlng=en
  » http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0104-11692020000100413&tlng=en
• ³⁸
  Moura IH, Silva AFR, Rocha AESH, Lima LHO, Moreira TMM, Silva ARV. Construction and validation of educational materials for the prevention of metabolic syndrome in adolescents. Rev. Latino-Am. Enfermagem [Internet]. 2017 [cited 2021 Aug 5] Oct 5;25. Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0104-11692017000100383&lng=en&tlng=en
  » http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0104-11692017000100383&lng=en&tlng=en
• ³⁹
  Ribeiro ZMT, Spadella MA. Validação de conteúdo de material educativo sobre alimentação saudável para crianças menores de dois anos. Rev Paul Pediatr [Internet]. 2018 [cited 2021 Aug 5] Jan 8;36(2):155-63. Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0103-05822018000200155&lng=pt&tlng=pt
  » http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0103-05822018000200155&lng=pt&tlng=pt
• ⁴⁰
  Hirsch CD, Barlem ELD, Barlem JGT, Dalmolin GL, Pereira LA, Ferreira AG. Cross-cultural adaptation and validation of the Nursing Student Satisfaction Scale for use with Brazilian nursing students. Rev. Latino-Am. Enfermagem [Internet]. 2016 [cited 2021 Aug 5];24. Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0104-11692016000100400&lng=en&tlng=en
  » http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0104-11692016000100400&lng=en&tlng=en
• ⁴¹
  Santos SB, Machado APDA, Sampaio LA, Abreu LC, Bezerra IMP. Sífilis adquirida: construção e validação de tecnologia educativa para adolescentes. J Hum Growth Dev [Internet]. 2019 [cited 2021 Aug 5] May 6;29(1):65-74. Available from: http://www.revistas.usp.br/jhgd/article/view/157752
  » http://www.revistas.usp.br/jhgd/article/view/157752
• ⁴²
  Chaves FF, Reis IA, Pagano AS, Torres HC. Translation, cross-cultural adaptation and validation of the Diabetes Empowerment Scale - Short Form. Rev Saude Publica [Internet]. 2017 [cited 2021 Aug 5];51. Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0034-89102017000100213&lng=en&tlng=en
  » http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0034-89102017000100213&lng=en&tlng=en
• ⁴³
  Cruz GCV, Vasconcelos MGF, Maniva SJCF, Carvalho REFL. Construction and validation of an educational technology on human papillomavirus vaccine for adolescents. Esc Anna Nery [Internet]. 2019 [2021 Aug 5];23(3). Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S1414-81452019000300209&tlng=en
  » http://www.scielo.br/scielo.php?script=sci_arttext&pid=S1414-81452019000300209&tlng=en

• *
  Paper extracted from doctoral dissertation “Validação do módulo ´Strategies to end seclusion restraint/Estratégias para acabar com o isolamento e a contenção do ToolKit QualityRights”, presented to Universidade de São Paulo, Escola de Enfermagem de Ribeirão Preto, PAHO/WHO Collaborating Centre for Nursing Research Development, Ribeirão Preto, SP, Brazil.

Edited by

Associate Editor

Maria Lúcia do Carmo Cruz Robazzi.

Publication Dates

• Publication in this collection
  20 Apr 2022
• Date of issue
  2022

History

• Received
  05 Aug 2021
• Accepted
  04 Jan 2022