Reliability and validity of the Pain Assessment Tool in Confused Older Adults - IADIC

Abstracts

Trata-se de um estudo metodológico, cujo objetivo foi realizar o pré-teste e validar as propriedades psicométricas do Instrumento de Avaliação de Dor em Idosos Confusos (IADIC) no pós-operatório imediato. A amostra constituiu-se de 104 pacientes com idade igual ou superior a 60 anos em pós-operatório imediato, internados na sala de recuperação pós-operatória de um hospital geral do Rio Grande do Sul, Brasil. Os dados foram coletados de abril a agosto de 2012. Os pacientes incluídos no estudo foram diagnosticados como confusos após aplicação do Confusion Assessment Method - CAM e possuíam idade de 71,51±8,81 anos. No pré-teste, não houve necessidade de modificações do instrumento. Ao se validar as propriedades psicométricas, a consistência interna dos itens apresentou alfa de Cronbach de 0,88 e a reprodutibilidade avaliada pelo coeficiente intraclasse foi de 0,838. A consistência interna e a reprodutibilidade conferiram validade e fidedignidade ao IADIC para o uso no Brasil.

Idoso; Confusão; Dor; Cuidados pós-operatórios; Estudos de validação; Enfermagem

ORIGINAL ARTICLE

Reliability and validity of the Pain Assessment Tool in Confused Older Adults - IADIC¹

Pretest, la fiabilidad y Validez Instrumento para la Evaluación del Dolor en Ancianos - IADIC

Gislaine Saurin^I; Maria da Graça Oliveira Crossetti^II

^INurse from the Conception Hospital Group. Master's in Nursing. Member of the Nursing Care Studies Center. Porto Alegre, Rio Grande do Sul, Brazil

^IINurse. PhD in Nursing. Professor at the Federal University of Rio Grande do Sul. Editor of the Current Nursing periodical (Rio de Janeiro). Member of the editorial body of the Rio Grande do Sul Nursing Magazine. Editor of the Rio Grande do Sul Nursing Magazine and the Conception Hospital Group. Porto Alegre, Rio Grande do Sul, Brazil

Correspondence

ABSTRACT

This is a methodological study, the objective was to conduct the pre-test and validate the psychometric properties of the Pain Assessment Tool in Confused Elderly (IADIC) in the immediate postoperative period. The sample consisted of 104 patients aged 60 years and over in the immediate postoperative period, admitted to the recovery room after surgery in a general hospital of Rio Grande do Sul, Brasil. Data were collected from April to August 2012. Patients included in the study were diagnosed as confused after application of the Confusion Assessment Method-CAM and possessed age of 71.51 ± 8.81 years. In the pre-test did not require modifications of the instrument. Upon validation the psychometric properties and internal consistency showed a Cronbach's alpha of 0.88 and reproducibility assessed by the intraclass coefficient was 0.838. Internal consistency and reproducibility gave IADIC the validity and reliability for use in Brazil.

Descriptors: Aged. Confusion. Pain. Postoperative care. Validation studies. Nursing.

RESUMEN

Se trata de un estudio metodológico, cuyo objetivo era llevar a cabo el pretest y validación de las propiedades psicométricas de la Herramienta de Evaluación del dolor en ancianos Confused (IADIC) en el postoperatorio inmediato. La muestra consistió en 104 pacientes mayores de 60 años en el período postoperatorio inmediato, ingresados en la sala de recuperación después de la cirugía en un hospital general de Rio Grande do Sul, Brasil. Los datos fueron recogidos entre abril y agosto de 2012. Los pacientes incluidos en el estudio fueron diagnosticados como confundido después de la aplicación del Método de Evaluación de la confusión-CAM y tenían edad de 71,51 ± 8,81 años. En el pretest no requirieron modificaciones del instrumento. Al validar las propiedades psicométricas y la consistencia interna alfa de 0,88 y reproducibilidad evaluada por el coeficiente intraclase de Cronbach fue de 0,838. La consistencia interna y reproducibilidad le dieron a IADIC la validez y fiabilidad para su uso en Brasil.

Descriptores: Anciano. Confusión. Dolor. Cuidados postoperatorios. Estudios de validación. Enfermería.

INTRODUCTION

Pain is a phenomenon that is present in different clinical scenarios, characterized by signs and symptoms according to its etiology. It is common in the postoperative period, may be the result of the incision and manipulation of tissues and organs and may be more common with major surgeries.^(1,2)

When a patient complains of pain, it is important to identify the causes that contribute to the pain phenomena. Accordingly, evaluation of pain can become challenging, requiring sensitivity, standardized instruments and careful clinical judgment. ⁽¹⁾ The presence of pain may be observed, through self-reporting, physiological measures and by observing the behavior of individuals. ⁽²⁾Self-reporting is considered the "gold standard" of assessment, the simplest and most reliable indicator of the existence, location and intensity of pain. However, it requires cognitive abilities and verbalization. ⁽²⁾In situations where these abilities are not preserved, pain assessment can be a difficult task.

In this sense, the use of tools to guide and ensure the evaluation of painful phenomena accurately in the elderly, especially those who are confused, is a necessity felt in the practice of nursing, mainly because of the characteristics resulting from the aging process.

In search of tools to measure pain in confused older adults, we point to the Pain Assessment Tool in Confused Older Adults (PATCOA), ⁽³⁾ which is considered a tool for easy understanding and interpretation, since it is applied through observation of the patient and behavioral indicators.⁽³⁾

When translated and culturally adapted to Brazilian Portuguese, it was called "Instrumento para Avaliação da Dor em Idosos Confusos (IADIC)."⁽⁴⁾ The process of translation and cultural adaptation is critical to the use of instruments developed in different countries, and this process does not include cultural biases and ensures that the results are not misinterpreted. ⁽⁵⁾ In the process of cross-cultural adaptation and validation, the pre-test and evaluation of the psychometric properties of the instrument is of paramount importance as it allows for the application of IADIC in clinical practice. The pre-test is to assess the equivalence of the original and final versions achieved at the stage of semantic equivalence. Evaluation of the psychometric properties can be achieved through reliability, which assesses whether the grouped items in a instrument measure the same factor in the study,⁽⁶⁾ assessing internal consistency and stability. ⁽⁶⁾ Internal consistency is evaluated by Cronbach's alpha coefficient, determined by a single application of the instrument, thus verifying the homogeneity of its items. ⁽⁶⁾ Stability is related to sensitivity, but has the ability of an instrument that can detect the change of the phenomena being studied. ⁽⁷⁾ Validity is generally defined as the degree that an instrument measures that which it intends to measure. There are different ways to assess validity and the choice depends on the purpose of the instrument or level of abstraction of the subject to be measured.⁽⁷⁾

This fact, coupled with the lack of instruments in Brazilian literature, with behavioral indicators, to assess pain in confused older people in the postoperative period, due to the effects of drugs and surgical procedures, justifies the choice of the IADIC for this study, which will contribute to nurses' clinical decision making in the development of more accurate nursing diagnoses and specific interventions for results that meet the real needs of older people in this condition. Therefore, from the validation of the psychometric properties of the IADIC, we believe that it can be a reliable and easy tool to use for assessing pain in confused older patients in the Brazilian population. Thus, the aim of this study was to conduct a pre-test and validate the psychometric properties of the IADIC in the immediate postoperative period, the period in the first 24 hours after the surgical procedure.

METHOD

This is a methodological study, which is characterized by the development of data collection tools. ⁽⁷⁾ This study was conducted in the post-anesthesia recovery room of a general hospital in Rio Grande do Sul, in the period from April to August 2012, with a sample of 104 patients. We included patients 60 years old and older, in the immediate postoperative period, undergoing elective and emergency procedures under general anesthesia and nerve block / sedation, diagnosed as confused, after applying the CAM scale, ⁽⁸⁾ and excluded patients with previous medical diagnoses of Alzheimer's Disease, Stroke, and Depression.

The selection of patients who participated in the study was performed, using a convenience sample, which allowed for the identification of participants available for study who met the inclusion criteria and were easily accessible to the researcher, ⁽⁹⁾ this selection was made during the pre-operative period, the day before the procedure, through access to the surgical schedule. After agreeing to participate, the participants were asked to sign the Informed Consent Form. All patients who agreed to participate were evaluated in the immediate postoperative period in the recovery room after surgery.

To collect data we used the following instruments: assessment of confusion according to the CAM,⁽⁸⁾ the IADIC for the assessment of pain ^(4), and a tool for characterizing the profile of the sample such as sex, age, duration of surgery, type of anesthesia and comorbidities.

The Confusion Assessment Method - CAM⁽⁸⁾ is a and easily applicable tool, which is specific (90-95%) and sensitive (94-100%) to confusion, and its application takes about five minutes.⁽⁸⁾ The diagnosis of confusion consists of meeting only four of the nine criteria: 1 - Acute onset and fluctuation of symptoms: evidence of acute change in basic mental status of the patient; 2 - attention deficit: absent at all times, present at some moments; 3 - disorganization of thought: disorganized thinking, incoherent, irrelevant or distracting conversations, and unpredictably changing the subject; 4 - altered level of consciousness: alert, vigilant, lethargic, stupor, coma. For a diagnosis, it is necessary that the first two are associated with the third or the fourth criteria. In the original study it was found that the five remaining items increase neither the sensitivity nor specificity of the method.^(8,10)

The IADIC ⁽³⁾ is an instrument consisting of nine items and aims to assess pain in confused older patients, classified as being easy to apply, since it is a questionnaire with yes / no answers, where yes is the presence of a certain pain indicator and no indicates the absence thereof. The sum of the items answered with "yes" shows the intensity of the pain, where zero represents no pain and nine is the most intense amount of pain. ⁽³⁾ The items are based on behavioral indicators of pain, published by the American Geriatrics Society,⁽¹¹⁾ namely: facial expression, verbalizations and vocalizations, body movements, changes in interpersonal interactions, changes in activities and routines.

Data collection was done as follows: The data for the 30 patients needed to conduct the pre-test, was collected in April 2012 by the researcher in charge, who, through access to the surgical schedule, identified possible patients to be included in the study, according to the inclusion and exclusion criteria, after they agreed, the data collection tools were applied during the postoperative period.

Thereafter, until the month of August, 2012, what followed was the collection of data necessary to perform an analysis of the psychometric properties of the IADIC. The total sample was made up of 104 patients, including 30 patients from the pre-test and 20 patients from the inter observer evaluation. The 20 patients who participated in the inter observer evaluation were collected simultaneously and independently by the head researcher and a research assistant, these corresponded to the last 20 patients included in the study.

The data was processed using the Excel Program for Windows. Statistical analyses were performed using the Statistical Package for Social Sciences (SPSS) version 18.0. The evaluation of psychometric properties, in relation to reliability, was done using Cronbach's alpha, to assess the stability we used the intraclass correlation coefficient and factor analysis was performed using VARIAMAX rotation, to verify the discriminant validity a t-student test was used. Categorical variables were expressed as a percentage or an absolute value; the continuous as mean ± standard deviation or median and interquartile range of 25 to 75. The significance level used was p <0.05.

This study was approved by the Ethics Committee of the field of study institution under number 11-260 and the Research Committee of the School of Nursing No. 20/2011.

RESULTS

The instrument was applied to a sample of 104 patients with an average age of 71.51 ± 8.81 years. There was no difference between the number of female subjects and male subjects, with 52 (50%) patients, respectively. Other characteristics of the sample are presented in Table 1.

When conducting the pre-test, there was no need for changes in the items of the IADIC, therefore, the version adapted to Portuguese was maintained.

In the analysis of the psychometric properties, the reproducibility of the IADIC, verified using Cronbach's alpha coefficient, ranged from 0.84 to 0.88. Below, Table 2 presents the coefficients for the total sample, item / total correlation and, after, the exclusion of each item.

Stability was assessed using the inter observer relationship and the intraclass correlation coefficient was 0.838, indicating that there was good agreement between evaluators.

As for the factor analysis, the values obtained by evaluating the factor loadings of the IADIC constructs are shown in Table 3, where it is possible to observe that, in 7 of the 9 items, the highest factor loadings were on a single factor: Factor 1 - groaning, trembling voice and sighing; Factor 2 - staying on guard at the prospect of pain, pointing to the location of pain and reluctance to moving and factor 3 - clenched jaw. Regarding the frowning and grimacing items, both had factor loadings on two factors, both on factor 1 and factor 3, however, it was decided to keep it in factor 3, because the similarity between the items, since frowning, grimacing and clenched jaw are considered non-behavioral facial expression indicators.

Below, in Table 4, we observe the results for discriminant validity, with the goal of identifying if the IADIC is able to differentiate the level of pain in the gender, age and surgical complexity variables. The IADIC, when applied to men and women presents a significant difference for females. When analyzing age, there is a statistical difference in the elderly aged 60 <70. When analyzing the level of complexity of the procedure to which the older person was submitted, it has also been noted that there is significant difference between the levels of low / medium and high complexity, presenting a statistical difference for the high level of complexity.

DISCUSSION

The results found in the pre-test showed that the IADIC retained its original form and required no changes to be used in the validation of its psychometric properties.

Regarding the accuracy of the adapted version of the IADIC, in the sample of 104 patients, the value of Cronbach's Alpha was 0.88. Authors ^(12,13) suggest that the internal consistency of the items should be classified as follows: values ≥ 0.9 are considered excellent, ≥ 0.8 are considered good, ≥ 0.7 are acceptable, ≥ 0.6 are questionable, ≥ 0.5 are poor, and < 0.5 are unacceptable. However, there is no lower limit for the coefficient. The values of Cronbach's alpha in this study were similar to those postulated in the literature, showing that the instrument has maintained its homogeneity, ⁽¹⁴⁾ indicating that the instrument has good internal consistency.

In inter observer agreement it was possible to observe the stability of the instrument to the responses of the two observers, where the total score shows that the difference between them was not significant (p = 0.392). The intraclass correlation coefficient (ICC) was 0.838, indicating that there was good agreement between evaluators, and this may also be considered an appropriate value in the case of an instrument with few items.⁽¹⁵⁾

Comparing the values of the factor loadings of the IADIC items obtained in this study with the values of the original study,⁽³⁾ we observed that the components were grouped into three factors instead of four, which led to the migration of some items to another component. Accordingly, when analyzing the migrations of items between the components, it is possible to observe that they were grouped by similarity, forming the following components with the respective items: Vocalizations: "groaning," "trembling voice" and "sighing"; Motor Activity/Behavior, "staying on guard at the prospect of pain", "pointing to the location of pain" and "reluctant to move." And the Facial Expressions component, "frowning", "grimacing" and "clenched jaw," which is in line with a recent revision of the literature,^(11,16) where different instruments proposed to measure pain in people did not include at least three behavioral indicators, and facial expressions, verbalizations and vocalizations and body movements were common to all of them, showing the good acceptance of these indicators for pain assessment.^(11,16)

It was found that female subjects have a lower pain threshold when compared to males (p = 0.003), which is consistent with the literature.^(17,18) However, there could also be no significant difference between genders regarding the presence of pain.⁽³⁾

For the analysis of pain in different age groups, the results indicate that older subjects aged 60 <70 years had a higher prevalence of pain compared to the older people aged ≥ 70 years (p = 0.004), similar findings ⁽¹⁸⁾ also identified a higher prevalence of pain in younger patients. However, the age variable may not be significant in the manifestation of painful phenomena.⁽¹⁾

The IADIC was able to show pain in the association between the presence of pain and levels of complexity of the surgical procedures (p = 0.020), showing that the patients in this study that underwent high-complexity procedures had more pain than those who underwent low / medium complexity procedures, this result has also been found in other studies.^(1,18,19) A survey conducted in inpatient units of a general hospital, where pain and satisfaction with analgesia was evaluated in 110 adult patients, found that 97.6% of patients who underwent major surgery reported pain, where 38.7% described the pain as severe, between 8 and 10 when evaluated by the numerical pain scale.⁽¹⁹⁾

CONCLUSIONS

The results for the IADIC validation showed reliability and stability, since the translated and adapted instrument proved to be true to the original, when applied to a sample of confused older people in the immediate postoperative period.

Because it is an instrument for pain assessment using behavioral aspects, with subjective indicators, being subject to interpretation bias on the part of the evaluator, it is necessary that the evaluator has technical and scientific knowledge and clinical experience as well as knowledge about the older patient, subject to care, which will accurately subsidize diagnose pain and consequent interventions.

It appears that in clinical practices nurses have used different behavioral pain assessment indicators in confused older patients. In this context, it is believed that the IADIC, having these characteristics and having been validated and adapted to Brazilian reality, could be applied by the nurse to accurately evaluate the pain in this population.

In Brazil, studies on pain assessment in the elderly, especially in those with a special need, such as cognitive impairment, like Alzheimer's Disease, Stroke, and Depression or in specific situations, such as postoperative situations, are still scarce. Therefore, from the development of this study we suggest that further studies be conducted with the IADIC in different contexts of clinical practice so that nurses can appropriately intervene in the care of these patients, and therefore seek results regarding the specific needs of the older patients in order to qualify and individualize care.

REFERENCES

• 1 Couceiro TCM, Valença MM, Lima LC, Menezes TC, Raposo MCF. Prevalência e Influência do sexo, idade e tipo de operação na dor pós-operatória. Rev Bras Anestesiol. 2009;59(3):314-20.
• 2 Landgraf CS, Marques RC, Pires OC, Constantino E, Leite VR, Posso MBS, Posso, Irimar de Paula., et al. Avaliação da analgesia pós-operatória em um hospital universitário. Rev Dor. 2010;11(4):319-22.
• 3 Decker SA, Perry AG. The development and testing of the PATCOA to asses pain in confused older adults. Pain Manag Nurs. 2003;4(2):77-86.
• 4 Rosa, TP. Tradução e adaptação transcultural da escala ÂPain Assesssment Tool in confused Older Adults - PATCOA [dissertação]. Porto Alegre (RS): Escola de Enfermagem, Universidade Federal do Rio Grande do Sul; 2009.
• 5 Díaz CR. The importance of using a cross-cultural adaptation in nursing questionnairesand tool. Int J Nurs Terminol Classif. 2011;22(1):1-3.
• 6 Field A. Descobrindo a estatística usando o SPSS. 2ª ed. Porto Alegre: Artmed; 2009.
• 7 Cunha JA. Psicodiagnóstico - V. 5ª ed. Porto Alegre: Artmed; 2000.
• 8 Fabbri RMA, Moreira MA, Garrido R, Almeida OP. Validity and reliability of the Portuguese version of the confusion assessment method (CAM) for the detection of delirium in the elderly. Arq Neuropsiquiatr. 2001;59(2):175 - 79.
• 9 Hulley SB, Cummings SR, Brownwe WS, Grady DG, Newman TB. Delineando a pesquisa clínica: uma abordagem epidemiológica. 3ª ed. Porto Alegre: Artmed; 2008
• 10 Barbosa FT, Cunha RM, Pinto ALCLT. Postoperative delirium in the elderly. Rev. Bras Anestesiol. 2008;58(6):665-70.
• 11 American Geriatrics Society (AGS). Panel on persistent pain in older persons. the management of persistent pain in older persons. J Am Geriat Soc. 2002;6(Suppl):s205-24.
• ¹²
  Institute for Works & Health. Recommendations for the cross-cultural adaptation of the DASH & Quick DASH outcome measures. Toronto: IWH; 2007.
• 13 Feijó, MK, Ávila CW, Souza EN, Jaarsma T, Rabelo ER. Adaptação transcultural e validação da European Heart Failure Self-care Behavior Scale para o português do Brasil. Rev Latinoam Enferm. 2012;20(5):988-996.
• 14 Klein C, Linch GFC, Souza EN, Mantovani VM, Goldmeier S, Rabelo ER. Adaptação transcultural e validação de um questionário de conhecimento sobre insuficiência cardíaca para enfermeiros. Rev Gaúcha Enferm. 2012;33(1):19-25.
• 15 Carvalho ARS, Dantas RAS, Pelegrino FM, Corbi ISA. Adaptação e validação de uma medida de adesão à terapia de anticoagulação oral. Rev Latinoam Enferm. 2010;18(3)301-308.
• 16 Araujo RS, Souza LAF, Pedroso CF, Pereira LV. Instrumentos para mensuração da dor em pessoas com demência em fase severamente avançada: revisão integrativa de literatura. Rev Dor. 2010; 11(Supl):35.
• 17 Thomas E, Peat G, Harris L, Wilkie R, Croft PR. The prevalence of pain and pain interference in a general population of older adults: cross-sectional findings from the North Staffordshire Osteoarthritis Project (NorStOP). Pain. 2004;110(1-2):361-68.
• 18 Sauaia A, Min SJ, Lebec C, Erbacher K, Abrams F, Fink R. Postoperative pain management in elderly patients: correlation between adherence to treatment guidelines and patient satisfaction. J Am Geriat Soc. 2005;53( 2):274-82.
• 19 Lima LB, Busin L. O cuidado humanizado sob a perspectiva de enfermeiras em unidade de recuperação pós-anestésica. Rev Gaúcha de Enferm. 2008;29(1):90-7.
• 20 Saurin G. Pré- teste, fidedignidade e qualidade do instrumento de avaliação da dor em idosos confusos - IADIC [dissertação]. Porto Alegre (RS): Escola de Enfermagem, Universidade Federal do Rio Grande do Sul; 2012.

Publication Dates

• Publication in this collection
  17 Mar 2014
• Date of issue
  Dec 2013

History

• Received
  08 July 2013
• Accepted
  14 Oct 2013