Acessibilidade / Reportar erro

ELABORATION AND VALIDATION OF A QUESTIONNAIRE TO ASSESS INFORMAL CAREGIVERS’ COMPETENCE

ABSTRACT

Objectives

to elaborate and validate the content and constructs of a questionnaire to assess informal caregivers’ competences.

Method

a methodological study for the elaboration and validation of a questionnaire in the health area, conducted in a municipality from the Northwest region of Paraná - Brazil. The questionnaire was applied to two groups made up of 30 to 40 informal caregivers. The committee of judges consisted of nine specialists. Content validity, construct validity and verification of internal consistency were confirmed.

Results

the elaboration presented four versions, the last of which comprised two parts, the first with 13 questions for sociodemographic characterization, and the second with 14 specific items, anchored in three constructs: cognitive-emotional, psychomotor, and relational competences. The final version presented a good agreement level among the judges, as well as internal consistency (α=89).

Conclusion

the questionnaire serves as a strategy to assess informal caregivers regarding their level of competence to provide care.

DESCRIPTORS
Caregivers; Psychometry; Surveys and Questionnaires; Validation Studies; Reproducibility of Tests

RESUMO

Objetivos

construir e validar o conteúdo e constructos de um questionário para avaliação das competências do cuidador informal.

Método

estudo metodológico de construção e validação de questionário na área da saúde, realizado em um município da região noroeste do Paraná - Brasil. O questionário foi aplicado em dois grupos de 30 e 40 cuidadores informais. Participaram nove especialistas no comitê de juízes. Confirmou-se a validade de conteúdo, validade de constructo e verificação da consistência interna.

Resultados

a construção apresentou quatro versões, sendo a última composta por duas partes, a primeira com 13 questões de caracterização sociodemográfica e a segunda com 14 itens específicos, ancorada em três constructos: competências cognitivo-emocionais, psicomotoras e relacionais. A versão final apresentou bom nível de concordância entre os juízes e consistência interna de α=89.

Conclusão

o questionário serve como estratégia de avaliação dos cuidadores informais quanto ao nível de competência para executar o cuidado.

DESCRITORES
Cuidadores; Psicometria; Inquéritos e Questionários; Estudos de Validação; Reprodutibilidade dos Testes

RESUMEN

Objetivos

elaborar y validar el contenido y los constructos de un cuestionario para evaluar las competencias de cuidadores informales.

Método

estudio metodológico para la elaboración y validación de un cuestionario en el área de la salud, realizado en un municipio de la región noroeste de Paraná - Brasil. El cuestionario se aplicó a dos grupos de 30 y 40 cuidadores informales. En el comité de evaluadores participaron nueve especialistas. Se confirmaron tanto la validez de contenido y de constructos como la verificación de la consistencia interna.

Resultados

el proceso de elaboración presentó cuatro versiones; la última estuvo conformada por dos partes, la primera con 13 preguntas de caracterización sociodemográfica y la segunda con 14 ítems específicos, sustentada en tres constructos: competencias cognitivo-emocionales, psicomotoras y relacionales. La versión final presentó buen nivel de concordancia entre los evaluadores y consistencia interna con un valor α=89.

Conclusión

el cuestionario sirve como estrategia para evaluar a los cuidadores informales en relación con el nivel de competencia para ejecutar las tareas de atención.

DESCRIPTORES
Cuidadores; Psicometría; Encuestas y Cuestionarios; Estudios de Validación; Reproducibilidad de las Pruebas

INTRODUCTION

In the home care context, there are two configurations regarding caregivers: formal and informal. Informal caregivers are those people who assume the role of main caregiver of the dependent person, be them consanguineous or not(11 Jütten LH, Mark RE, Janssen BWJM, Rietsema J, Dröes R-M, Sitskoorn MM. Testing the effectivity of the mixed virtual reality training Into D’mentia for informal caregivers of people with dementia: protocol for a longitudinal, quasi experimental study. BMJ Open. 2017 [acesso em 28 jan 2018]; 7(8):e015702. Disponível em: http://dx.doi.org/10.1136/bmjopen-2016-015702.
https://doi.org/10.1136/bmjopen-2016-015...

2 Uribe FL, Graske J, Grill S, Heinrich S, Schafer-Walkmann S, Thyrian JR, Holle B. Regional dementia care networks in Germany: changes in caregiver burden at one-year follow-up and associated factors. Int Psychogeriatr. 2017 [acesso em 19 de jan 2018]; 29(6):991-1004. Disponível em: http://dx.doi.org/10.1017/S1041610217000126.
https://doi.org/10.1017/S104161021700012...

3 Xião LD, Bellis A de, Kyriazopoulos H, Draper B, Ullah S. The effect of a personalized dementia care intervention for caregivers from Australian minority groups. Am J Alzheimers Dis Other Demen. 2016 [acesso em 02 maio 2018]; 31(1):57-67. Disponível em: https://doi.org/10.1177/1533317515578256.
https://doi.org/10.1177/1533317515578256...

4 Lopes GVDO, Vilasbôas ALQ, Castellanos MEP. Atenção domiciliar na estratégia saúde da família: avaliação do grau de implantação em Camaçari (BA). Saúde e Debate. 2017 [acesso em 02 maio 2018]; 41 (n. espec 3): 241-54. Disponível em: http://dx.doi.org/10.1590/0103-11042017s318.
https://doi.org/10.1590/0103-11042017s31...
-55 Braga PP, Sena RR de, Seixas CT, Castro EAB de, Andrade AM, Silva YC. Oferta e demanda na atenção domiciliar em saúde. Ciênc Saúde Colet. 2016 [acesso em 02 maio 2019]; 21(3):903-12. Disponível em: http://dx.doi.org/10.1590/1413-81232015213.11382015.
https://doi.org/10.1590/1413-81232015213...
), without any formal contract. Formal caregivers are the workers, with or without higher education, who provide care with a previously established contract(66 Brasil. Ministério da Saúde. Secretaria de Atenção à Saúde. Departamento de Atenção Básica. Caderno de atenção domiciliar. Brasília, DF: Ministério da Saúde; 2013 [acesso em 22 dez 2017]. Disponível em: http://bvsms.saude.gov.br/bvs/publicacoes/caderno_atencao_domiciliar_melhor_casa.pdf.
http://bvsms.saude.gov.br/bvs/publicacoe...
).

When informal caregivers do not have specific knowledge, have no availability, are overloaded, or are not adapted to the role taken, the care to their loved one can be provided in an improper or insufficient manner, if there is no formal support(77 Pleasant ML, Molinari V, Hobday JV, Fazio S, Cullen N, Hyer K. An evaluation of the CARES® Dementia Basics Program among caregivers. Int Psychogeriatr. 2017 [acesso 19 jan 2018]; 29(1):45-6. Disponível em: http://dx.doi.org/10.1017/S1041610216001526.
https://doi.org/10.1017/S104161021600152...
-88 Grun D, Pieri V, Vaillant M, Diederich NJ. Contributory factors to caregiver burden in parkinson disease. J Am Med Dir Assoc. 2016 [acesso 19 jan 2018]; 17(7):626-32. Disponível em: http://dx.doi.org/10.1016/j.jamda.2016.03.004.
https://doi.org/10.1016/j.jamda.2016.03....
). Such competences must be stimulated and promoted in the family context of care, especially in the case of people who experience dependence for the first time(99 Misawa F, Sanches R de CN, Rego A da S, Radovanovic CAT. Care for the Family member after a stroke. Journal of Nursing UFPE on Line, Recife, 2019 [acesso 25 jan 2020]; 12(3): 599-606, 2019. Disponível em: http://dx.doi.org/10.5205/1981-8963-v12i3a24138p599-606-2018.
https://doi.org/10.5205/1981-8963-v12i3a...
). Competence is conceptualized as someone’s ability to do something with quality, knowing how to articulate and mobilize knowledge, skills and attitudes to solve problems and face unforeseen situations, making use of one’s own resources(99 Misawa F, Sanches R de CN, Rego A da S, Radovanovic CAT. Care for the Family member after a stroke. Journal of Nursing UFPE on Line, Recife, 2019 [acesso 25 jan 2020]; 12(3): 599-606, 2019. Disponível em: http://dx.doi.org/10.5205/1981-8963-v12i3a24138p599-606-2018.
https://doi.org/10.5205/1981-8963-v12i3a...

10 Holm M, Arestdt K, Carlander I, Wengstrom Y, Ohlen J, Alvariza A. Characteristics of the family caregivers who did not benefit from a successful psychoeducational group intervention during palliative cancer care. Carcer Nurs. [Internet]. 2017 jan/feb [acesso 2019 Mar 27];40(1):76-83. Disponível em: https://www.ncbi.nlm.nih.gov/pubmed/26925988.
https://www.ncbi.nlm.nih.gov/pubmed/2692...
-1111 Erickson SR, LeRoy B. Health literacy and medication administration performance by caregivers of adults with developmental disabilities. J Am Pharm Assoc. 2015 [acesso 19 jan 2018];55(2):169–77. Disponível em: http://dx.doi.org/10.1331/JAPhA.2015.14101.
https://doi.org/10.1331/JAPhA.2015.14101...
).

The most frequently addressed competences in intervention and qualification studies at the international level were the cognitive, emotional, psychomotor and relational competences(22 Uribe FL, Graske J, Grill S, Heinrich S, Schafer-Walkmann S, Thyrian JR, Holle B. Regional dementia care networks in Germany: changes in caregiver burden at one-year follow-up and associated factors. Int Psychogeriatr. 2017 [acesso em 19 de jan 2018]; 29(6):991-1004. Disponível em: http://dx.doi.org/10.1017/S1041610217000126.
https://doi.org/10.1017/S104161021700012...

3 Xião LD, Bellis A de, Kyriazopoulos H, Draper B, Ullah S. The effect of a personalized dementia care intervention for caregivers from Australian minority groups. Am J Alzheimers Dis Other Demen. 2016 [acesso em 02 maio 2018]; 31(1):57-67. Disponível em: https://doi.org/10.1177/1533317515578256.
https://doi.org/10.1177/1533317515578256...

4 Lopes GVDO, Vilasbôas ALQ, Castellanos MEP. Atenção domiciliar na estratégia saúde da família: avaliação do grau de implantação em Camaçari (BA). Saúde e Debate. 2017 [acesso em 02 maio 2018]; 41 (n. espec 3): 241-54. Disponível em: http://dx.doi.org/10.1590/0103-11042017s318.
https://doi.org/10.1590/0103-11042017s31...

5 Braga PP, Sena RR de, Seixas CT, Castro EAB de, Andrade AM, Silva YC. Oferta e demanda na atenção domiciliar em saúde. Ciênc Saúde Colet. 2016 [acesso em 02 maio 2019]; 21(3):903-12. Disponível em: http://dx.doi.org/10.1590/1413-81232015213.11382015.
https://doi.org/10.1590/1413-81232015213...

6 Brasil. Ministério da Saúde. Secretaria de Atenção à Saúde. Departamento de Atenção Básica. Caderno de atenção domiciliar. Brasília, DF: Ministério da Saúde; 2013 [acesso em 22 dez 2017]. Disponível em: http://bvsms.saude.gov.br/bvs/publicacoes/caderno_atencao_domiciliar_melhor_casa.pdf.
http://bvsms.saude.gov.br/bvs/publicacoe...

7 Pleasant ML, Molinari V, Hobday JV, Fazio S, Cullen N, Hyer K. An evaluation of the CARES® Dementia Basics Program among caregivers. Int Psychogeriatr. 2017 [acesso 19 jan 2018]; 29(1):45-6. Disponível em: http://dx.doi.org/10.1017/S1041610216001526.
https://doi.org/10.1017/S104161021600152...

8 Grun D, Pieri V, Vaillant M, Diederich NJ. Contributory factors to caregiver burden in parkinson disease. J Am Med Dir Assoc. 2016 [acesso 19 jan 2018]; 17(7):626-32. Disponível em: http://dx.doi.org/10.1016/j.jamda.2016.03.004.
https://doi.org/10.1016/j.jamda.2016.03....

9 Misawa F, Sanches R de CN, Rego A da S, Radovanovic CAT. Care for the Family member after a stroke. Journal of Nursing UFPE on Line, Recife, 2019 [acesso 25 jan 2020]; 12(3): 599-606, 2019. Disponível em: http://dx.doi.org/10.5205/1981-8963-v12i3a24138p599-606-2018.
https://doi.org/10.5205/1981-8963-v12i3a...

10 Holm M, Arestdt K, Carlander I, Wengstrom Y, Ohlen J, Alvariza A. Characteristics of the family caregivers who did not benefit from a successful psychoeducational group intervention during palliative cancer care. Carcer Nurs. [Internet]. 2017 jan/feb [acesso 2019 Mar 27];40(1):76-83. Disponível em: https://www.ncbi.nlm.nih.gov/pubmed/26925988.
https://www.ncbi.nlm.nih.gov/pubmed/2692...
-1111 Erickson SR, LeRoy B. Health literacy and medication administration performance by caregivers of adults with developmental disabilities. J Am Pharm Assoc. 2015 [acesso 19 jan 2018];55(2):169–77. Disponível em: http://dx.doi.org/10.1331/JAPhA.2015.14101.
https://doi.org/10.1331/JAPhA.2015.14101...
). Cognitive competence is the ability that the caregiver must have to know and learn the reason why certain care action should be performed. Psychomotor competence can be understood as the ability to know-how-to-do, the manual dexterity to provide care. The emotional competences are related to the burden and stress aspects. Finally, the relational competences refer to the ability to maintain an effective communication and to establish a bond with the person cared for(22 Uribe FL, Graske J, Grill S, Heinrich S, Schafer-Walkmann S, Thyrian JR, Holle B. Regional dementia care networks in Germany: changes in caregiver burden at one-year follow-up and associated factors. Int Psychogeriatr. 2017 [acesso em 19 de jan 2018]; 29(6):991-1004. Disponível em: http://dx.doi.org/10.1017/S1041610217000126.
https://doi.org/10.1017/S104161021700012...

3 Xião LD, Bellis A de, Kyriazopoulos H, Draper B, Ullah S. The effect of a personalized dementia care intervention for caregivers from Australian minority groups. Am J Alzheimers Dis Other Demen. 2016 [acesso em 02 maio 2018]; 31(1):57-67. Disponível em: https://doi.org/10.1177/1533317515578256.
https://doi.org/10.1177/1533317515578256...

4 Lopes GVDO, Vilasbôas ALQ, Castellanos MEP. Atenção domiciliar na estratégia saúde da família: avaliação do grau de implantação em Camaçari (BA). Saúde e Debate. 2017 [acesso em 02 maio 2018]; 41 (n. espec 3): 241-54. Disponível em: http://dx.doi.org/10.1590/0103-11042017s318.
https://doi.org/10.1590/0103-11042017s31...

5 Braga PP, Sena RR de, Seixas CT, Castro EAB de, Andrade AM, Silva YC. Oferta e demanda na atenção domiciliar em saúde. Ciênc Saúde Colet. 2016 [acesso em 02 maio 2019]; 21(3):903-12. Disponível em: http://dx.doi.org/10.1590/1413-81232015213.11382015.
https://doi.org/10.1590/1413-81232015213...

6 Brasil. Ministério da Saúde. Secretaria de Atenção à Saúde. Departamento de Atenção Básica. Caderno de atenção domiciliar. Brasília, DF: Ministério da Saúde; 2013 [acesso em 22 dez 2017]. Disponível em: http://bvsms.saude.gov.br/bvs/publicacoes/caderno_atencao_domiciliar_melhor_casa.pdf.
http://bvsms.saude.gov.br/bvs/publicacoe...

7 Pleasant ML, Molinari V, Hobday JV, Fazio S, Cullen N, Hyer K. An evaluation of the CARES® Dementia Basics Program among caregivers. Int Psychogeriatr. 2017 [acesso 19 jan 2018]; 29(1):45-6. Disponível em: http://dx.doi.org/10.1017/S1041610216001526.
https://doi.org/10.1017/S104161021600152...

8 Grun D, Pieri V, Vaillant M, Diederich NJ. Contributory factors to caregiver burden in parkinson disease. J Am Med Dir Assoc. 2016 [acesso 19 jan 2018]; 17(7):626-32. Disponível em: http://dx.doi.org/10.1016/j.jamda.2016.03.004.
https://doi.org/10.1016/j.jamda.2016.03....

9 Misawa F, Sanches R de CN, Rego A da S, Radovanovic CAT. Care for the Family member after a stroke. Journal of Nursing UFPE on Line, Recife, 2019 [acesso 25 jan 2020]; 12(3): 599-606, 2019. Disponível em: http://dx.doi.org/10.5205/1981-8963-v12i3a24138p599-606-2018.
https://doi.org/10.5205/1981-8963-v12i3a...

10 Holm M, Arestdt K, Carlander I, Wengstrom Y, Ohlen J, Alvariza A. Characteristics of the family caregivers who did not benefit from a successful psychoeducational group intervention during palliative cancer care. Carcer Nurs. [Internet]. 2017 jan/feb [acesso 2019 Mar 27];40(1):76-83. Disponível em: https://www.ncbi.nlm.nih.gov/pubmed/26925988.
https://www.ncbi.nlm.nih.gov/pubmed/2692...
-1111 Erickson SR, LeRoy B. Health literacy and medication administration performance by caregivers of adults with developmental disabilities. J Am Pharm Assoc. 2015 [acesso 19 jan 2018];55(2):169–77. Disponível em: http://dx.doi.org/10.1331/JAPhA.2015.14101.
https://doi.org/10.1331/JAPhA.2015.14101...
).

Evaluation of these competences in informal caregivers can help the health teams to elaborate qualification and training policies and programs for this population, in order to promote care quality in the home context. Consequently, the objective of this research was to elaborate and validate a questionnaire to assess the informal caregivers’ competences.

METHOD

This is a methodological research study for the elaboration and validation of a health questionnaire(1212 Alexandre NMC, Coluci MZO. Validade de conteúdo nos processos de construção e adaptação de questionários de medida. Cienc Saúde Colet. 2011 [acesso 06 jun 2017]; 16(7):3061-8. Disponível em: https://doi.org/10.1590/S1413-81232011000800006.
https://doi.org/10.1590/S1413-8123201100...
-1313 Pasquali L. Instrumentações psicológica: fundamentos e práticas. Porto Alegre: Artmed; 2010.), conducted from June 2018 to February 2019 using Pasquali’s methodological model(1313 Pasquali L. Instrumentações psicológica: fundamentos e práticas. Porto Alegre: Artmed; 2010.). Such model proposes the elaboration of three sets of procedures: theoretical, empirical (experimental) and analytical (statistical)(1313 Pasquali L. Instrumentações psicológica: fundamentos e práticas. Porto Alegre: Artmed; 2010.-1414 Souza AC de, Alexandre NMC, Guirardello E de B. Propriedades psicométricas na avaliação de questionários: avaliação da confiabilidade e da validade. Epidemiologia e Serviços de Saúde, Brasília, DF. 2017 [acesso 06 jun 2017]; 26 (3): 649-659. Disponível em: https://doi.org/10.5123/s1679-49742017000300022.
https://doi.org/10.5123/s1679-4974201700...
) (Figure 1).

Figure 1
Phases corresponding to the development and validation of the questionnaire to assess the informal caregivers’ competences. Maringá, PR, Brazil, 2019

The theoretical procedures were initiated with an integrative review to verify the competences required for informal care, which evidenced the cognitive, psychomotor, relational and emotional competences(22 Uribe FL, Graske J, Grill S, Heinrich S, Schafer-Walkmann S, Thyrian JR, Holle B. Regional dementia care networks in Germany: changes in caregiver burden at one-year follow-up and associated factors. Int Psychogeriatr. 2017 [acesso em 19 de jan 2018]; 29(6):991-1004. Disponível em: http://dx.doi.org/10.1017/S1041610217000126.
https://doi.org/10.1017/S104161021700012...

3 Xião LD, Bellis A de, Kyriazopoulos H, Draper B, Ullah S. The effect of a personalized dementia care intervention for caregivers from Australian minority groups. Am J Alzheimers Dis Other Demen. 2016 [acesso em 02 maio 2018]; 31(1):57-67. Disponível em: https://doi.org/10.1177/1533317515578256.
https://doi.org/10.1177/1533317515578256...

4 Lopes GVDO, Vilasbôas ALQ, Castellanos MEP. Atenção domiciliar na estratégia saúde da família: avaliação do grau de implantação em Camaçari (BA). Saúde e Debate. 2017 [acesso em 02 maio 2018]; 41 (n. espec 3): 241-54. Disponível em: http://dx.doi.org/10.1590/0103-11042017s318.
https://doi.org/10.1590/0103-11042017s31...

5 Braga PP, Sena RR de, Seixas CT, Castro EAB de, Andrade AM, Silva YC. Oferta e demanda na atenção domiciliar em saúde. Ciênc Saúde Colet. 2016 [acesso em 02 maio 2019]; 21(3):903-12. Disponível em: http://dx.doi.org/10.1590/1413-81232015213.11382015.
https://doi.org/10.1590/1413-81232015213...

6 Brasil. Ministério da Saúde. Secretaria de Atenção à Saúde. Departamento de Atenção Básica. Caderno de atenção domiciliar. Brasília, DF: Ministério da Saúde; 2013 [acesso em 22 dez 2017]. Disponível em: http://bvsms.saude.gov.br/bvs/publicacoes/caderno_atencao_domiciliar_melhor_casa.pdf.
http://bvsms.saude.gov.br/bvs/publicacoe...

7 Pleasant ML, Molinari V, Hobday JV, Fazio S, Cullen N, Hyer K. An evaluation of the CARES® Dementia Basics Program among caregivers. Int Psychogeriatr. 2017 [acesso 19 jan 2018]; 29(1):45-6. Disponível em: http://dx.doi.org/10.1017/S1041610216001526.
https://doi.org/10.1017/S104161021600152...

8 Grun D, Pieri V, Vaillant M, Diederich NJ. Contributory factors to caregiver burden in parkinson disease. J Am Med Dir Assoc. 2016 [acesso 19 jan 2018]; 17(7):626-32. Disponível em: http://dx.doi.org/10.1016/j.jamda.2016.03.004.
https://doi.org/10.1016/j.jamda.2016.03....

9 Misawa F, Sanches R de CN, Rego A da S, Radovanovic CAT. Care for the Family member after a stroke. Journal of Nursing UFPE on Line, Recife, 2019 [acesso 25 jan 2020]; 12(3): 599-606, 2019. Disponível em: http://dx.doi.org/10.5205/1981-8963-v12i3a24138p599-606-2018.
https://doi.org/10.5205/1981-8963-v12i3a...

10 Holm M, Arestdt K, Carlander I, Wengstrom Y, Ohlen J, Alvariza A. Characteristics of the family caregivers who did not benefit from a successful psychoeducational group intervention during palliative cancer care. Carcer Nurs. [Internet]. 2017 jan/feb [acesso 2019 Mar 27];40(1):76-83. Disponível em: https://www.ncbi.nlm.nih.gov/pubmed/26925988.
https://www.ncbi.nlm.nih.gov/pubmed/2692...
-1111 Erickson SR, LeRoy B. Health literacy and medication administration performance by caregivers of adults with developmental disabilities. J Am Pharm Assoc. 2015 [acesso 19 jan 2018];55(2):169–77. Disponível em: http://dx.doi.org/10.1331/JAPhA.2015.14101.
https://doi.org/10.1331/JAPhA.2015.14101...
).

Subsequently, the strategies of clinical observation and specialists’ opinion survey were applied to eight Family Health Strategy (FHS) teams from three Basic Health Units (BHUs) during a three-month period. Each dimension surveyed in the theoretical model, items and answer scale was presented to the teams, in order to provide quality to the clarity, objectivity and sensitivity criteria(1212 Alexandre NMC, Coluci MZO. Validade de conteúdo nos processos de construção e adaptação de questionários de medida. Cienc Saúde Colet. 2011 [acesso 06 jun 2017]; 16(7):3061-8. Disponível em: https://doi.org/10.1590/S1413-81232011000800006.
https://doi.org/10.1590/S1413-8123201100...

13 Pasquali L. Instrumentações psicológica: fundamentos e práticas. Porto Alegre: Artmed; 2010.

14 Souza AC de, Alexandre NMC, Guirardello E de B. Propriedades psicométricas na avaliação de questionários: avaliação da confiabilidade e da validade. Epidemiologia e Serviços de Saúde, Brasília, DF. 2017 [acesso 06 jun 2017]; 26 (3): 649-659. Disponível em: https://doi.org/10.5123/s1679-49742017000300022.
https://doi.org/10.5123/s1679-4974201700...

15 Coluci MZO, Alexandre NMC, Milani D. Construção de questionários de medida na área da saúde. Ciênc. Saúde Colet, Rio de Janeiro. 2015 [acesso 06 jun 2017]; 20 (3): 925-936. Disponível em: https://doi.org/10.1590/1413-81232015203.04332013.
https://doi.org/10.1590/1413-81232015203...

16 Valer DB, Aires M, Fengler FL, Paskulin LMG. Adaptação e validação do Inventário de Sobrecarga do Cuidador para uso em cuidadores de idosos. Rev. Latino-Americana de Enferm., Ribeirão Preto. 2015 [acesso 06 jun 2017]; 23 (1): 130-138. Disponível em: https://doi.org/10.1590/0104-1169.3357.2534.
https://doi.org/10.1590/0104-1169.3357.2...
-1717 Echevarría-Guanilo ME, Gonçalves N, Romanoski PJ. Propriedades psicométricas de questionários de medidas: bases conceituais e métodos de avaliação – parte I. Texto & Contexto – Enferm., Florianópolis. 2017 [acesso ago. 2018]; 26 (4): 1-11. Disponível em: https://doi.org/10.1590/0104-07072017001600017.
https://doi.org/10.1590/0104-07072017001...
).

The measurement modality adopted was multidimensional, as four dimensions of the care competences were pre-established(1111 Erickson SR, LeRoy B. Health literacy and medication administration performance by caregivers of adults with developmental disabilities. J Am Pharm Assoc. 2015 [acesso 19 jan 2018];55(2):169–77. Disponível em: http://dx.doi.org/10.1331/JAPhA.2015.14101.
https://doi.org/10.1331/JAPhA.2015.14101...

12 Alexandre NMC, Coluci MZO. Validade de conteúdo nos processos de construção e adaptação de questionários de medida. Cienc Saúde Colet. 2011 [acesso 06 jun 2017]; 16(7):3061-8. Disponível em: https://doi.org/10.1590/S1413-81232011000800006.
https://doi.org/10.1590/S1413-8123201100...

13 Pasquali L. Instrumentações psicológica: fundamentos e práticas. Porto Alegre: Artmed; 2010.

14 Souza AC de, Alexandre NMC, Guirardello E de B. Propriedades psicométricas na avaliação de questionários: avaliação da confiabilidade e da validade. Epidemiologia e Serviços de Saúde, Brasília, DF. 2017 [acesso 06 jun 2017]; 26 (3): 649-659. Disponível em: https://doi.org/10.5123/s1679-49742017000300022.
https://doi.org/10.5123/s1679-4974201700...

15 Coluci MZO, Alexandre NMC, Milani D. Construção de questionários de medida na área da saúde. Ciênc. Saúde Colet, Rio de Janeiro. 2015 [acesso 06 jun 2017]; 20 (3): 925-936. Disponível em: https://doi.org/10.1590/1413-81232015203.04332013.
https://doi.org/10.1590/1413-81232015203...
-1616 Valer DB, Aires M, Fengler FL, Paskulin LMG. Adaptação e validação do Inventário de Sobrecarga do Cuidador para uso em cuidadores de idosos. Rev. Latino-Americana de Enferm., Ribeirão Preto. 2015 [acesso 06 jun 2017]; 23 (1): 130-138. Disponível em: https://doi.org/10.1590/0104-1169.3357.2534.
https://doi.org/10.1590/0104-1169.3357.2...
). The questionnaire, elaborated from the hypothesization of the conceptual model, is shown in Figure 2.

Figure 2
Conceptual model with the hypothesized constructs of the questionnaire to assess informal caregivers. Maringá, PR, Brazil, 2019

Based on the constructs, a total of 22 items (First version - V1) were elaborated, with a five-point Likert-type answer scale. Content and construct validation, as well as the previously elaborated items (V1), were tested in a sample of 30 informal caregivers, called Pilot Test 1 (PT1). The inclusion criteria were as follows: being over 18 years old, being the informal caregiver of an adult or aged individual and user of the Unified Health System (Sistema Único de Saúde, SUS) from the municipality. The participants were approached by means of visits to 34 BHUs, with request of a list with the name of the caregiver and forwarding to the nurses of the teams.

With PT1 concluded, Version two (V2) of the questionnaire was created, made up by 18 items and a header for sociodemographic characterization. In order to verify content validity, the questionnaire (V2) was submitted to appraisal by the judges, who were considered people qualified to assess clarity, content, layout and understanding of a questionnaire(1616 Valer DB, Aires M, Fengler FL, Paskulin LMG. Adaptação e validação do Inventário de Sobrecarga do Cuidador para uso em cuidadores de idosos. Rev. Latino-Americana de Enferm., Ribeirão Preto. 2015 [acesso 06 jun 2017]; 23 (1): 130-138. Disponível em: https://doi.org/10.1590/0104-1169.3357.2534.
https://doi.org/10.1590/0104-1169.3357.2...
). Choice of the judges followed these inclusion criteria: being a health professional with a PhD concluded at least one year ago, and having authored publications related to caregivers. The evaluators excluded were those who did not return the assessment questionnaire within the time frame established.

An email message with an invitation letter was sent to 15 judges, and nine returned it within the time frame established (30 days). These judges received an explanatory letter and the questionnaire including 84 questions with a three-point Likert-type scale (from -1 to +1), which assessed the header, layout, scope of items, clarity, content and objectivity(1212 Alexandre NMC, Coluci MZO. Validade de conteúdo nos processos de construção e adaptação de questionários de medida. Cienc Saúde Colet. 2011 [acesso 06 jun 2017]; 16(7):3061-8. Disponível em: https://doi.org/10.1590/S1413-81232011000800006.
https://doi.org/10.1590/S1413-8123201100...
,1616 Valer DB, Aires M, Fengler FL, Paskulin LMG. Adaptação e validação do Inventário de Sobrecarga do Cuidador para uso em cuidadores de idosos. Rev. Latino-Americana de Enferm., Ribeirão Preto. 2015 [acesso 06 jun 2017]; 23 (1): 130-138. Disponível em: https://doi.org/10.1590/0104-1169.3357.2534.
https://doi.org/10.1590/0104-1169.3357.2...
). In the validation phase, the judges justified the items scored with -1 or zero, with inferences in a space devoted to comments and suggestions, justification being mandatory for the -1 scores. After the judge’s suggestions, Version three (V3), which consisted of two parts, the first for the caregiver’s characterization and the second with 20 specific items, was forwarded for the application of Pilot Test 2 (PT2).

In PT2, V3 was applied to 40 caregivers. The caregivers who participated in PT1 were excluded from the list, and the questionnaire was applied following the same path as in PT1. The analysis indicated the exclusion of six items, resulting in the final version (V4), consisting of questions regarding the caregiver’s characterization and of 14 specific items.

The data were imported into the Statistical Analysis Software (SAS, version 9.4) program. The Fleiss’ Kappa (FK) test(13-14,16) was applied to confirm content validity. Agreement among the judges was analyzed according to Landis and Kock(1717 Echevarría-Guanilo ME, Gonçalves N, Romanoski PJ. Propriedades psicométricas de questionários de medidas: bases conceituais e métodos de avaliação – parte I. Texto & Contexto – Enferm., Florianópolis. 2017 [acesso ago. 2018]; 26 (4): 1-11. Disponível em: https://doi.org/10.1590/0104-07072017001600017.
https://doi.org/10.1590/0104-07072017001...
), with FK values showing slight agreement (0≤FK≤0.20), weak agreement (0.21≤FK≤0.40), substantial agreement (0.61≤FK≤0.80), and almost perfect agreement (FK≤0.81)(1818 Landis JR, Koch GG. An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics. [Internet]. 1977 [acesso 27 mar 2019] 33 (2): 363-74. Disponível em: https://pubmed.ncbi.nlm.nih.gov/884196/.
https://pubmed.ncbi.nlm.nih.gov/884196/...
). The agreement percentage among the judges (ideal≥0.75%), Standard Deviation (SD), correlation between the items (r≥0.30) and Cronbach’s alpha (ideal≥70%) were also verified(1919 Cronbach LJ. Coefficient alfa and the internal structure of tests. Psychometrika, Colorado Spring. 2000 [acesso 06 jun 2017]; 16 (3): 297-334. Disponível em: https://doi.org/10.1007/BF02310555.
https://doi.org/10.1007/BF02310555...
).

Construct validation was conducted using Exploratory Factor Analysis (EFA), considering eigenvalues ≥ 1 and with verification of the commonalities to explain the variances(2020 Hair JF, Black WC, Babin BJ, Anderson RE, Tatham RL, Sant’Anna MAGAS. Análise multivariada de dados. 6. ed. Porto Alegre: Bookman, 2009.). The questions that presented lower values than the aforementioned were excluded. The study was approved by the Research Ethics Committee under opinion No. 2,584,897.

RESULTS

The questionnaire was called COPER 14 (final version) – (CO) Cognitive, (P) Psychomotor, (E) Emotional and (R) Relational Competences. Regarding the characteristics of the informal caregivers who participated in PT2 (n=40), 35 (87.5%) were female, 21 (52.5%) were aged from 18 to 59 years old, 24 (60%) were married, 21 (52.5%) had a family income from two to five minimum wages, 20 (50%) had completed high school, 10 (25%) had children, 10 (25%) had grandchildren, 20 (50%) worked as caregivers for more than 12 hours a day, 27 (67.5%) had been caregivers for more than a year, 22 (55%) had never taken care of anyone before, and 38 (95%) did not attend any training course.

In relation to the judges’ characteristics, two were Post-PhDs and seven were PhDs, one in the Linguistics area, two in the Education area and six in the Nursing area. All of them were university professors.

Based on the results of the systematic review, along with clinical observation and specialists’ opinion, the conceptual model, constructs, the items for each construct and the answer scales were established. V1 of the questionnaire consisted of 22 items with answers arranged in a Likert-type scale and two open questions (if the respondents had already attended a caregiver training course and/or if they had already taken care of somebody before – items considered in the analysis as items 23 and 24).

The results of PT1 indicated the need to exclude items six, 18, 20, 21, 23 and 24. After exclusion of the items indicated by the analysis, the set of competences presented an alpha value=0.79 and ideal correlation ≥0.30. With the alpha analysis concluded, V2 was forwarded to the committee of judges.

The items of V2 presented substantial or almost perfect agreement (Table 1) regarding clarity, content, objectivity and validity.

Table 1
Determination of the agreement among the judges regarding the assessment questionnaire of informal caregivers’ competences, according to the Fleiss’ Kappa (FK) statistics for the clarity, content, objectivity and validity domains. Maringá, PR, Brazil, 2019

According to the judges’ assessment, it was necessary to review the header. Items one, two, three, 10 and 11 presented weak agreement in relation to content; therefore, they were reviewed and reformulated. Fleiss’ Kappa(18) was conducted individually for the following domains: Clarity (FKc), Content (FKco), Objectivity (FKo) and Validity (FKv), shown in Table 2.

Table 2
Distribution of the items of the assessment questionnaire of the informal caregivers’ competences according to the committee of judges, Fleiss’ Kappa coefficient for the Clarity (FKc), Content (FKco), Objectivity (FKo) and Validity (FKv) domains, suggestions proposed by the participants and reformulated items, Maringá, Paraná, Brazil, 2019

Internal consistency of the questionnaire in its V3 version was verified by Cronbach’s alpha, the correlation between the items was α=0.89 and the correlations were above 0.44 (Table 3).

Table 3
Pilot Test II, item after judges’ validation, mean, standard deviation, Cronbach’s alpha, correlation between the items, final version, and Exploratory Factor Analysis loadings for validation of the constructs of the assessment questionnaire of the informal caregiver’s competences, Maringá, Paraná, Brazil, 2019 (n=40)

Based on the results of the EFA, three factors (F1, F2, and F3) were maintained, which explained 66.33% of the total data variance. The first factor (F1) explains 43.48% of the total data variance (43.48%). This factor was interpreted as the cognitive-emotional domain, and is the most important dimension to explain the informal caregivers’ competences (Table 2).

The second factor (F2) explains 12.86% of the total data variability, being interpreted as the psychomotor domain. The third factor (F3) explains 9.99% of the data variability, and was interpreted as the relational dimension. The commonalities varied from 0.44 (Q17) to 0.79 (Q8).

After all these stages, the final version (V4) comprised two parts, the first including 13 questions for the caregiver’s sociodemographic characterization, and the second with 14 specific items anchored in three dimensions: cognitive-emotional, psychomotor and relational competences.

To verify the sums of the final scores for V4, the value of all the sums of the maximum answers was divided into quartiles, with the lower scores indicating lower level of competence for care: low competence (1-17); little competence (18-35); moderate competence (36-52); and good competence (≥53).

DISCUSSION

The COPER 14 questionnaire was developed to facilitate the task of classifying and stratifying informal caregivers, with the objective of assessing their care competences. The result was its final version made up by 14 items distributed into three constructs, with good internal consistency (α=89). The sample size was adequate for factor analysis, and suitability of the model’s fit was acceptable (KMO=0.7419)(1818 Landis JR, Koch GG. An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics. [Internet]. 1977 [acesso 27 mar 2019] 33 (2): 363-74. Disponível em: https://pubmed.ncbi.nlm.nih.gov/884196/.
https://pubmed.ncbi.nlm.nih.gov/884196/...
).

In the construction of the conceptual model, using the integrative review and the previous clinical observation with the FHS teams were strategies that enhanced elaboration of the questionnaire. It is noted that the previous clinical observation is considered as one of the strategies that gathers the most information to elaborate the theoretical model(1414 Souza AC de, Alexandre NMC, Guirardello E de B. Propriedades psicométricas na avaliação de questionários: avaliação da confiabilidade e da validade. Epidemiologia e Serviços de Saúde, Brasília, DF. 2017 [acesso 06 jun 2017]; 26 (3): 649-659. Disponível em: https://doi.org/10.5123/s1679-49742017000300022.
https://doi.org/10.5123/s1679-4974201700...

15 Coluci MZO, Alexandre NMC, Milani D. Construção de questionários de medida na área da saúde. Ciênc. Saúde Colet, Rio de Janeiro. 2015 [acesso 06 jun 2017]; 20 (3): 925-936. Disponível em: https://doi.org/10.1590/1413-81232015203.04332013.
https://doi.org/10.1590/1413-81232015203...
-1616 Valer DB, Aires M, Fengler FL, Paskulin LMG. Adaptação e validação do Inventário de Sobrecarga do Cuidador para uso em cuidadores de idosos. Rev. Latino-Americana de Enferm., Ribeirão Preto. 2015 [acesso 06 jun 2017]; 23 (1): 130-138. Disponível em: https://doi.org/10.1590/0104-1169.3357.2534.
https://doi.org/10.1590/0104-1169.3357.2...
).

The questionnaire presented good agreement among the judges. The use of content validity relies on the participation of specialists in the committee of judges, who are individuals qualified to assess clarity, content, layout and understanding of the questionnaire. Such committee analyzed if the items of the questionnaire constitute a representative sample of what it is intended to assess(1414 Souza AC de, Alexandre NMC, Guirardello E de B. Propriedades psicométricas na avaliação de questionários: avaliação da confiabilidade e da validade. Epidemiologia e Serviços de Saúde, Brasília, DF. 2017 [acesso 06 jun 2017]; 26 (3): 649-659. Disponível em: https://doi.org/10.5123/s1679-49742017000300022.
https://doi.org/10.5123/s1679-4974201700...
).

Although it is not considered in the literature, the use of two Pilot Tests allowed for a final assessment of the items, verifying their reliability and if all the items were adequate, in addition to confirming construct validity, which allowed greater confidence to continue validating the instrument. Psychometric validity in a significant population (>200 participants), a process inherent to the elaboration of assessment questionnaires, was later applied in a specific study.

The analysis of the factors indicated that factor 3 (F3) pointed to the combination of one item of the psychomotor competences (item seven) and two items of the relational competences (items eight and nine). This can be related to the fact that, in order to distinguish physiological and subjective changes in the person cared for, the caregiver should know the normal standard first. The informal caregivers’ knowledge results from the time spent in caregiving and from the type of bond they have with the person cared for(77 Pleasant ML, Molinari V, Hobday JV, Fazio S, Cullen N, Hyer K. An evaluation of the CARES® Dementia Basics Program among caregivers. Int Psychogeriatr. 2017 [acesso 19 jan 2018]; 29(1):45-6. Disponível em: http://dx.doi.org/10.1017/S1041610216001526.
https://doi.org/10.1017/S104161021600152...
-88 Grun D, Pieri V, Vaillant M, Diederich NJ. Contributory factors to caregiver burden in parkinson disease. J Am Med Dir Assoc. 2016 [acesso 19 jan 2018]; 17(7):626-32. Disponível em: http://dx.doi.org/10.1016/j.jamda.2016.03.004.
https://doi.org/10.1016/j.jamda.2016.03....
). Such fact indicates the complexity of measuring capabilities and skills that permeate the subjectivity of human relationships(22 Uribe FL, Graske J, Grill S, Heinrich S, Schafer-Walkmann S, Thyrian JR, Holle B. Regional dementia care networks in Germany: changes in caregiver burden at one-year follow-up and associated factors. Int Psychogeriatr. 2017 [acesso em 19 de jan 2018]; 29(6):991-1004. Disponível em: http://dx.doi.org/10.1017/S1041610217000126.
https://doi.org/10.1017/S104161021700012...
,99 Misawa F, Sanches R de CN, Rego A da S, Radovanovic CAT. Care for the Family member after a stroke. Journal of Nursing UFPE on Line, Recife, 2019 [acesso 25 jan 2020]; 12(3): 599-606, 2019. Disponível em: http://dx.doi.org/10.5205/1981-8963-v12i3a24138p599-606-2018.
https://doi.org/10.5205/1981-8963-v12i3a...
).

The estimates of commonalities presented satisfactory values in COPER 14. These measures are interpreted as estimators of the proportion of variability attributed to each variable and can vary from zero to one: values close to zero indicate that the factors do not explain the variance, whereas values close to one indicate that all variances are explained by the common factors(1313 Pasquali L. Instrumentações psicológica: fundamentos e práticas. Porto Alegre: Artmed; 2010.).

The results showed that the COPER 14 questionnaire enables a broad assessment, encompassing more than one dimension comprising the complex task of care. The cognitive-emotional, psychomotor and relational competences are evidenced as fundamental for the informal caregiver to provide care, safely, in the home context(44 Lopes GVDO, Vilasbôas ALQ, Castellanos MEP. Atenção domiciliar na estratégia saúde da família: avaliação do grau de implantação em Camaçari (BA). Saúde e Debate. 2017 [acesso em 02 maio 2018]; 41 (n. espec 3): 241-54. Disponível em: http://dx.doi.org/10.1590/0103-11042017s318.
https://doi.org/10.1590/0103-11042017s31...
-55 Braga PP, Sena RR de, Seixas CT, Castro EAB de, Andrade AM, Silva YC. Oferta e demanda na atenção domiciliar em saúde. Ciênc Saúde Colet. 2016 [acesso em 02 maio 2019]; 21(3):903-12. Disponível em: http://dx.doi.org/10.1590/1413-81232015213.11382015.
https://doi.org/10.1590/1413-81232015213...
). Knowledge on the informal caregivers’ characteristics, as well assessment of their level of competence and limitations, are fundamental for the elaboration of therapeutic projects specific for families in situations of vulnerability.

The study limitations are related to the competences herein surveyed and tested, which can be influenced by age, the patient’s health status and level of dependence, financial and environmental conditions and level of support, among other factors. It is suggested that such limitations be considered for reproducibility of COPER 14.

CONCLUSION

The COPER 14 questionnaire presented internal consistency (α=89) and equivalence among the judges with good agreement level. Its content was validated by the committee of judges’ approach and its structural validity, by analyzing the factor load. Factor analysis retained three factors, and the estimates of commonalities explained all the variances.

The COPER 14 questionnaire identified the informal caregivers’ difficulties in a preventive and anticipatory manner; thus, it may be used as a strategy to expand projects for caregivers’ education and preparation to provide quality home care. It is a novel questionnaire capable of assessing cognition, relationships, emotions and psychomotor skills together in the same instrument, which can be applied to informal caregivers in different contexts, either in the home environment or in transitional care at the time of hospital discharge.

  • *
    Article extracted from the PhD thesis entitled “Elaboration and validation of a questionnaire to assess informal caregivers’ competences – COPER-14”. Universidade Estadual de Maringá, 2019.

HOW TO REFERENCE THIS ARTICLE

  • Sanches R de CN, Santos FTG dos, Radovanovic CAT. Elaboration and validation of a questionnaire to assess informal caregivers’ competence. Cogit. Enferm. [Internet]. 2021 [accessed “insert day, monh and year”]; 26. Available from: http://dx.doi.org/10.5380/ce.v26i0.73966.

REFERÊNCIAS

  • 1
    Jütten LH, Mark RE, Janssen BWJM, Rietsema J, Dröes R-M, Sitskoorn MM. Testing the effectivity of the mixed virtual reality training Into D’mentia for informal caregivers of people with dementia: protocol for a longitudinal, quasi experimental study. BMJ Open. 2017 [acesso em 28 jan 2018]; 7(8):e015702. Disponível em: http://dx.doi.org/10.1136/bmjopen-2016-015702.
    » https://doi.org/10.1136/bmjopen-2016-015702
  • 2
    Uribe FL, Graske J, Grill S, Heinrich S, Schafer-Walkmann S, Thyrian JR, Holle B. Regional dementia care networks in Germany: changes in caregiver burden at one-year follow-up and associated factors. Int Psychogeriatr. 2017 [acesso em 19 de jan 2018]; 29(6):991-1004. Disponível em: http://dx.doi.org/10.1017/S1041610217000126.
    » https://doi.org/10.1017/S1041610217000126
  • 3
    Xião LD, Bellis A de, Kyriazopoulos H, Draper B, Ullah S. The effect of a personalized dementia care intervention for caregivers from Australian minority groups. Am J Alzheimers Dis Other Demen. 2016 [acesso em 02 maio 2018]; 31(1):57-67. Disponível em: https://doi.org/10.1177/1533317515578256.
    » https://doi.org/10.1177/1533317515578256
  • 4
    Lopes GVDO, Vilasbôas ALQ, Castellanos MEP. Atenção domiciliar na estratégia saúde da família: avaliação do grau de implantação em Camaçari (BA). Saúde e Debate. 2017 [acesso em 02 maio 2018]; 41 (n. espec 3): 241-54. Disponível em: http://dx.doi.org/10.1590/0103-11042017s318.
    » https://doi.org/10.1590/0103-11042017s318
  • 5
    Braga PP, Sena RR de, Seixas CT, Castro EAB de, Andrade AM, Silva YC. Oferta e demanda na atenção domiciliar em saúde. Ciênc Saúde Colet. 2016 [acesso em 02 maio 2019]; 21(3):903-12. Disponível em: http://dx.doi.org/10.1590/1413-81232015213.11382015.
    » https://doi.org/10.1590/1413-81232015213.11382015
  • 6
    Brasil. Ministério da Saúde. Secretaria de Atenção à Saúde. Departamento de Atenção Básica. Caderno de atenção domiciliar. Brasília, DF: Ministério da Saúde; 2013 [acesso em 22 dez 2017]. Disponível em: http://bvsms.saude.gov.br/bvs/publicacoes/caderno_atencao_domiciliar_melhor_casa.pdf
    » http://bvsms.saude.gov.br/bvs/publicacoes/caderno_atencao_domiciliar_melhor_casa.pdf
  • 7
    Pleasant ML, Molinari V, Hobday JV, Fazio S, Cullen N, Hyer K. An evaluation of the CARES® Dementia Basics Program among caregivers. Int Psychogeriatr. 2017 [acesso 19 jan 2018]; 29(1):45-6. Disponível em: http://dx.doi.org/10.1017/S1041610216001526.
    » https://doi.org/10.1017/S1041610216001526
  • 8
    Grun D, Pieri V, Vaillant M, Diederich NJ. Contributory factors to caregiver burden in parkinson disease. J Am Med Dir Assoc. 2016 [acesso 19 jan 2018]; 17(7):626-32. Disponível em: http://dx.doi.org/10.1016/j.jamda.2016.03.004.
    » https://doi.org/10.1016/j.jamda.2016.03.004
  • 9
    Misawa F, Sanches R de CN, Rego A da S, Radovanovic CAT. Care for the Family member after a stroke. Journal of Nursing UFPE on Line, Recife, 2019 [acesso 25 jan 2020]; 12(3): 599-606, 2019. Disponível em: http://dx.doi.org/10.5205/1981-8963-v12i3a24138p599-606-2018.
    » https://doi.org/10.5205/1981-8963-v12i3a24138p599-606-2018
  • 10
    Holm M, Arestdt K, Carlander I, Wengstrom Y, Ohlen J, Alvariza A. Characteristics of the family caregivers who did not benefit from a successful psychoeducational group intervention during palliative cancer care. Carcer Nurs. [Internet]. 2017 jan/feb [acesso 2019 Mar 27];40(1):76-83. Disponível em: https://www.ncbi.nlm.nih.gov/pubmed/26925988
    » https://www.ncbi.nlm.nih.gov/pubmed/26925988
  • 11
    Erickson SR, LeRoy B. Health literacy and medication administration performance by caregivers of adults with developmental disabilities. J Am Pharm Assoc. 2015 [acesso 19 jan 2018];55(2):169–77. Disponível em: http://dx.doi.org/10.1331/JAPhA.2015.14101.
    » https://doi.org/10.1331/JAPhA.2015.14101
  • 12
    Alexandre NMC, Coluci MZO. Validade de conteúdo nos processos de construção e adaptação de questionários de medida. Cienc Saúde Colet. 2011 [acesso 06 jun 2017]; 16(7):3061-8. Disponível em: https://doi.org/10.1590/S1413-81232011000800006.
    » https://doi.org/10.1590/S1413-81232011000800006
  • 13
    Pasquali L. Instrumentações psicológica: fundamentos e práticas. Porto Alegre: Artmed; 2010.
  • 14
    Souza AC de, Alexandre NMC, Guirardello E de B. Propriedades psicométricas na avaliação de questionários: avaliação da confiabilidade e da validade. Epidemiologia e Serviços de Saúde, Brasília, DF. 2017 [acesso 06 jun 2017]; 26 (3): 649-659. Disponível em: https://doi.org/10.5123/s1679-49742017000300022.
    » https://doi.org/10.5123/s1679-49742017000300022
  • 15
    Coluci MZO, Alexandre NMC, Milani D. Construção de questionários de medida na área da saúde. Ciênc. Saúde Colet, Rio de Janeiro. 2015 [acesso 06 jun 2017]; 20 (3): 925-936. Disponível em: https://doi.org/10.1590/1413-81232015203.04332013.
    » https://doi.org/10.1590/1413-81232015203.04332013
  • 16
    Valer DB, Aires M, Fengler FL, Paskulin LMG. Adaptação e validação do Inventário de Sobrecarga do Cuidador para uso em cuidadores de idosos. Rev. Latino-Americana de Enferm., Ribeirão Preto. 2015 [acesso 06 jun 2017]; 23 (1): 130-138. Disponível em: https://doi.org/10.1590/0104-1169.3357.2534.
    » https://doi.org/10.1590/0104-1169.3357.2534
  • 17
    Echevarría-Guanilo ME, Gonçalves N, Romanoski PJ. Propriedades psicométricas de questionários de medidas: bases conceituais e métodos de avaliação – parte I. Texto & Contexto – Enferm., Florianópolis. 2017 [acesso ago. 2018]; 26 (4): 1-11. Disponível em: https://doi.org/10.1590/0104-07072017001600017.
    » https://doi.org/10.1590/0104-07072017001600017
  • 18
    Landis JR, Koch GG. An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics. [Internet]. 1977 [acesso 27 mar 2019] 33 (2): 363-74. Disponível em: https://pubmed.ncbi.nlm.nih.gov/884196/
    » https://pubmed.ncbi.nlm.nih.gov/884196/
  • 19
    Cronbach LJ. Coefficient alfa and the internal structure of tests. Psychometrika, Colorado Spring. 2000 [acesso 06 jun 2017]; 16 (3): 297-334. Disponível em: https://doi.org/10.1007/BF02310555.
    » https://doi.org/10.1007/BF02310555
  • 20
    Hair JF, Black WC, Babin BJ, Anderson RE, Tatham RL, Sant’Anna MAGAS. Análise multivariada de dados. 6. ed. Porto Alegre: Bookman, 2009.

Edited by

Associate editor: Susanne Elero Betiolli

Publication Dates

  • Publication in this collection
    22 Nov 2021
  • Date of issue
    2021

History

  • Received
    22 May 2020
  • Accepted
    29 July 2021
Universidade Federal do Paraná Av. Prefeito Lothário Meissner, 632, Cep: 80210-170, Brasil - Paraná / Curitiba, Tel: +55 (41) 3361-3755 - Curitiba - PR - Brazil
E-mail: cogitare@ufpr.br