Luciano Isolan; et al
5 de maio de 2013
Reliability and convergent validity of the Childhood Anxiety Sensitivity Index in children and adolescents
Confiabilidade em validade convergente da Childhood Anxiety Sensitivity Index em crianças e adolescentes
Luciano IsolanI, II; Giovanni SalumI, II, III; Suzielle Menezes FloresI; Hudson W. de CarvalhoIV; Gisele Gus ManfroI, II, III
IHospital de Clínicas de Porto Alegre, Anxiety Disorders Program for Child and Adolescent, RS, Brazil
IIUniversidade Federal do Rio Grande do Sul (UFRGS), Graduate Program, Psychiatry, Brazil
IIINational Institute of Developmental Psychiatry for Children and Adolescents (INPD/Brazil)
IVUniversidade Federal de São Paulo (Unifesp), Graduate Program, Psychiatry, Sao Paulo, Brazil
ABSTRACT
OBJECTIVE: The purpose of this study was to examine the reliability and the convergent validity of the Children Anxiety Sensitivity Index (CASI) with DSM-IV anxiety disorder symptoms, by comparison with the Screen for Child Anxiety Related Emotional Disorders (SCARED), in a community sample of Brazilian children and adolescents.
METHODS: Children and adolescents from five schools were selected from a larger study that aimed to assess different aspects of childhood anxiety disorders. All participants completed the CASI and the SCARED.
RESULTS: This study supported the reliability of the CASI total score. Girls reported higher total anxiety sensitivity scores than boys and there were no differences in total anxiety sensitivity scores between children and adolescents. This study showed moderate to high correlations between the CASI scores with SCARED scores, all correlations coefficients being positive and significant.
CONCLUSIONS: Our findings demonstrate an appropriate reliability and evidence of convergent validity in the CASI in a sample of Brazilian children and adolescents.
Keywords: Anxiety, anxiety sensitivity, children, adolescents.
RESUMO
OBJETIVO: O objetivo deste estudo foi examinar a confiabilidade e a validade convergente da Children Anxiety Sensitivity Index (CASI) com sintomas de transtornos de ansiedade de acordo com o DSM-IV, por meio da comparação com a Screen for Child Anxiety Related Emotional Disorders (SCARED).
MÉTODOS: Crianças e adolescentes provenientes de cinco escolas foram selecionados de uma amostra de um estudo maior que avaliava diferentes aspectos dos transtornos de ansiedade. Todos os participantes completaram a CASI e a SCARED.
RESULTADOS: Esse estudo demonstrou a confiabilidade do escore total da CASI. Meninas apresentaram escores de sensibilidade à ansiedade mais altos do que meninos e não houve diferença nos escores totais de sensibilidade de ansiedade entre crianças e adolescentes. Esse estudo encontrou correlações de moderada a alta entre os escores da CASI e os escores da SCARED, sendo todas as correlações positivas e significativas.
CONCLUSÕES: Nossos achados demonstraram uma confiabilidade apropriada e evidência de validade convergente da CASI em uma amostra de crianças e adolescentes brasileiros.
Palavras-chave: Ansiedade, sensibilidade à ansiedade, crianças, adolescentes.
INTRODUCTION
Anxiety sensitivity (AS) refers to the tendency to fear anxiety-related sensations and is thought to arise from beliefs about their harmful physical, cognitive, or social consequences1. Individuals with elevated AS might, for example, fear palpitations because of concerns about a heart attack or fear sweating in public based on concerns about negative social evaluation, whereas those with low AS perceive such sensations as harmless and transient. According to AS theory, individuals with elevated AS experience amplified fear in response to stimuli that elicit anxiety and find their own anxiety symptoms to be particularly aversive2. Evidence suggests that AS emerge from genetic-environment interactions, resulting in the development of maladaptive beliefs about potential harmful effects of autonomic arousal3. AS is not a clinical disorder, but AS appears to play an important role in the development and maintenance of anxiety related disorders particularly panic disorder and posttraumatic stress disorder3.
The Anxiety Sensitivity Index (ASI) is the main instrument used to assess AS in adults4. The Childhood Anxiety Sensitivity Index (CASI) is a widely version of the ASI for children with the addition of two items5. This modification was made to facilitate understanding of the questionnaire by children and adolescents. Previous studies have consistently demonstrated that the CASI is a reliable and valid instrument for measuring anxiety sensitivity in both clinical and nonclinical samples of children and adolescents5,6. Furthermore, studies have shown that AS in children and adolescents correlates in a theoretically meaningful way with other anxiety measures, mainly those measuring panic symptoms, and that AS may be a risk factor for the development of anxious symptomatology and anxiety disorders in youth7-10.
It is very important to examine the applicability and the psychometric properties of the CASI in different cultures and countries. The prevalence rates of anxiety disorders in Brazilian youth are significant11-13. A study in the Southeast region, comprising 1251 school children aged 7-14 years old described a total prevalence rate of 12.7% for any psychiatric disorder and 5.2% for any anxiety disorder using DSM-IV criteria12. However, there is a lack of instruments to assess anxiety symptoms and related constructs in Brazilian children and adolescents14. In relation to the CASI, no psychometrical investigation has so far been conducted in Brazil to evaluate its use and measurement properties.
Therefore, the main purpose of the present study is to assess the psychometric properties of the Brazilian-Portuguese version of the CASI in a sample of Brazilian children and adolescents. Specifically, the aims of this study are: (1) to evaluate the reliability of the CASI; (2) to examine sex (boys and girls) and age groups (children and adolescents) effects on the CASI scores; and (3) to calculate and examine correlations between the CASI and the Screen for Child Anxiety Related Emotional Disorders (SCARED).
METHOD
Participants
Participants in this study were Brazilian children and adolescents enrolled in grades 3 to 9 from five schools located in the catchment area of the Primary Care Unit of the Hospital de Clínicas de Porto Alegre, in the city of Porto Alegre, located in the South of Brazil. The 140 participants had a mean age of 12.76 years (SD = 1.94; range = 9-18) including 78 girls (55% of total sample) with a mean age of 12.78 (SD = 1.97) organized into 22 children with a mean age of 10.36 years (SD = .79; range = 9-11) and 52 adolescents with a mean age of 13.75 years (SD = 1.37; range = 12-18). There were 62 boys with a mean age of 11.5 (SD = 2.12), organized into 15 children with a mean age of 10.33 years (SD = .72) and 47 adolescents with a mean age of 13.57 (SD = 1.45; range = 12-18).
Procedures
Participants were selected from a sample of children and adolescents from a larger study that aimed to assess different aspects of childhood anxiety disorders15. The CASI was completed as part of a larger set of self-report assessments, examining symptoms of anxiety, depression, bullying and related constructs. Children and adolescents completed the questionnaires during school hours. Students who were absent on the day of testing were assessed one week later. In order to ensure that the same procedure was used throughout the study, the research assistants were asked to read and follow the research guideline manual, which contained research objectives, instruction and collection procedures, and contact information. Instructions were as follow: (1) this study does not count for or against grades; (2) you should not imitate or consult with friends because there are no right or wrong answers to this questionnaire, and (3) your teachers, parents, friends, or anyone else who knows you will never see your questionnaire, so please answer honestly. The same procedure was used in each school.
After obtaining initial consent from the principal of each participating school, both students and their parents received written information and the parents were required to provide written informed dissent. Parents who did not give permission for their child to participate were asked to return a signed dissent form. The study protocol was reviewed and approved by the Ethics Committee of the Hospital de Clínicas de Porto Alegre.
Instruments
The Childhood Anxiety Sensitivity Index5 is an 18-item self-report tool designed to measure the fear of different sym-ptoms of anxiety in children and adolescents. Anxiety sensitivity has a hierarchical structure, consisting of multiple lower order factors, loading on a single high order factor10. Models with two factors, three factors, and four factors have been proposed for the factor structure of the CASI10. A reassessment of the factor structure of the CASI has revealed a significantly better fit of the model with four factors16. These factors describe: Disease Concerns (e.g., "When my stomach hurts, I worry I might be really sick") that measures the fear of autonomic arousal symptoms and worry that symptoms are indicative of a serious health problem; Unsteady Concerns (e.g., "It scares me when I feel like I am going to faint") that measures the fear associated with the anticipation of fainting, vomiting, and having difficulty breathing; Mental Concerns (e.g., "It scares me when I cannot keep my mind on my schoolwork") that measures fears of loss of cognitive control; and Social Concerns (e.g., "I don't want other people to know when I feel afraid") that measures the subjective importance of staying in control and hiding one's fears and feelings from others. The best fitting model was obtaining using 13 items and addition of the remaining 5 items resulted in some decrease of the model fit, although the four factors were still reliably discriminable16. Accordingly, data for CASI total scores included all 18 items whereas data for the CASI factors include 13 items. Respondents rate each question using a 3-point scale (1 = none; 2 = some, and 3 = a lot). Total scores ranges from 18 to 54 and higher scores reflect higher levels of AS. The CASI has demonstrated high internal consistency in both clinical and nonclinical samples, good test-retest reliability and good construct validity5.
The English version of the CASI was translated and adapted for Brazilian-Portuguese, with the permission of the original author of the scale, according to guidelines for the successful translation of instruments in cross-cultural research17. One bilingual translator who was a native speaker blindly translated the questionnaire from the original language to Brazilian-Portuguese, and another bilingual individual independently translated it back to English. To ensure that items in both versions had achieved grammatical and colloquial appropriateness, differences in the original and the back-translated versions were discussed and resolved by agreement of both translators (see Appendix 1).
The SCARED18,19 is a 41-item self-report measure of child and adolescent anxiety based on DSM-IV constructs. The SCARED includes five subscales: panic/somatic (e.g., "When I feel frightened, it is hard to breathe"); generalized anxiety (e.g., "I worry about things working out for me"); separation anxiety (e.g., "I get scared if I sleep away from home"); social phobia (e.g. "I feel nervous with people I don't know well"), and school phobia (e.g. "I get stomach aches at school"). For each item, respondents should choose the response that best describes how they have been feeling during the past 3 months. Items are scored using a 3-point scale (0 = not true or hardly ever true; 1 = sometimes true, and 2 = true or often true). Scores ranges from 0 to 82 and higher scores reflect higher levels of anxiety. The SCARED has appropriate psychometric properties and is a useful and reliable instrument to assess anxiety symptoms in Brazilian children and adolescents20.
Data analysis
Internal consistency was calculated by Cronbach's alpha coefficient estimation for CASI total score and for each specific factor score. Sex and age group differences for CASI and its subscales were calculated by Student t-tests for independent samples and effect sizes (d) were estimated. Parametric correlations were used to estimate the degree of association between the CASI total and its factor scores with age and SCARED scale scores. Skewness and kurtosis were used as normality tests. All tests were two-tailed, and the level of significance was set at p < .05. Numerical values are presented as means and standard deviations (SD). All statistical procedures were performed using the Statistical Package for Social Sciences (SPSS) version 17.0 for Windows.
RESULTS
Internal consistency analysis
Cronbach's alpha was .89 for the CASI total score. Cronbach's alpha coefficients for the four CASI factors scores ranged from .57 to .72 (Disease Concerns: .72; Unsteady Concerns: .64; Mental Illness Concerns: .57; Social Concerns: .57). Cronbach's alpha coefficients for the CASI total and CASI factors were generally comparable for boys and girls and for children and adolescents.
Age and sex effects
The mean score on the CASI total was 25.56 (S.D. = 6.57). The mean score for the CASI factors were 5.73 (S.D. = 1.87) for Disease Concerns, 4.25 (S.D. = 1.46) for Unsteady Concerns, 3.95 (S.D. = 1.16) for Mental Illness Concerns, and 5.01 (S.D. = 1.67) for Social Concerns. Girls displayed significantly higher mean scores than boys on the CASI total (t = 2.17, p = .031, d = .37); Disease Concerns factor (t = 1.99, p = .048, d = .35); Unsteady Concerns factor (t = 2.19., p = .037, d = .36), and Social Concern factor (t = 2.1, p = .038, d = .36). Correlations between age and CASI score failed to produce significant coefficients at the p value of .05. Correlations magnitude ranged from -.01 to -.13. Consistently, no significant mean difference was encountered between children and adolescent subsamples. Table 1 shows CASI descriptive statistics according to age group and sex.
Concurrent validity
In an effort to determine convergent validity, Pearson correlations between the CASI total and its factors and SCARED total and its subscales were examined. As shown in table 2, correlations analyses showed moderate to high correlations (ranging from 0.261 to 0.705) between the CASI scores and SCARED scores, with all correlations coefficients being positive and significant (p < .01). The SCARED total score and the panic/somatic subscale had especially strong correlations with CASI total score and Disease Concern factor. -Correlations were also examined by sex (boys and girls) and age groups (children and adolescents) and were all positive and significant.
DISCUSSION
The current study examined the reliability and the convergent validity of the CASI with DSM-IV anxiety disorder symptoms in a school sample of Brazilian children and adolescents. Our results indicate that, similarly to other clinical and community studies across the worldwide21, the CASI has appropriate psychometric properties and could be a useful instrument to assess anxiety sensitivity in Brazilian youth.
This study supported the reliability of the CASI total score, although estimates of internal consistency for its four factors ranged from low to good. Our study found a high Cronbach's alpha for the CASI total score that is highly similar to those obtained in previous studies5,21,22. Factors such as Mental Illness Concerns and Social Concerns performed more poorly than the other factors. These coefficients are similar to those found in previous research21,23. As in these studies, the low alpha values for these factors in our study may be partly due to the fact that these factors contained an insufficient number of items each. Although the number of items may have contributed to the low alpha values, adding more items to a subscale possibly results in redundancy and may compromise the respondents attitude toward the whole instrument21.
Results of this study, which indicate that girls report hi-gher total anxiety sensitivity scores than boys, are consistent with both the adult3 and the child literature5,10,16,22. On examining the factor scores as a function of sex, significant sex differences emerged. Girls displayed significantly higher scores than boys on Disease Concern factor, Unsteady Concerns factor, and Social Concern factor. These differences may be accounted by different culturally based learning experiences24, gender role orientation25, and genetic factors26. It has been suggested that girls may have experienced greater rewards in their learning histories for expressing more somatic complaints than boys22. Similarly, boys may be more likely to underreport fears and concerns that may threaten their masculinity image, due to greater social sanctions against the reporting of fear among boys24. A behavioral-genetic study with twin pairs showed that the factors of AS arise from a mix of dimension-specific and non-specific etiologic factors, which vary as a function of sex and as a function of the severity of AS26. For girls, AS factors have been influenced by a combination of genetic and environmental factors. Furthermore heritability in women significantly increased with AS scores. For men, factors were influenced by environmental but not genetic factors26.
In our study, although children displayed higher scores in CASI total and in all CASI factors, we found no significant differences in the mean CASI and factor scores between children and adolescents. This finding is in contrast with other studies demonstrating higher levels of AS in children compared to adolescents16. It should be mentioned, however, that in our sample the age range of child group was slightly older than the age range in child group of other studies. Possibly the inclusion of younger children in our study could increase these differences to a significant level.
This study provided evidence that the CASI has a good convergent validity when compared to the SCARED, a DSM-IV measure of anxiety disorder symptoms, in Brazilian children and adolescents. The SCARED total score and the panic/somatic subscale had especially strong correlations with CASI, indicating that anxiety sensitivity may be a significant correlate of these symptoms. It is in agreement with previous studies in children and in adults reporting that AS is related to a broad range of DSM-IV anxiety disorder and anxiety symptomatology but most specifically to symptoms of panic disorder3,10,16. Similarly, studies have shown that children with panic disorder have displayed higher levels of AS than those diagnosed with other anxiety disorders27. For example, a recent meta-analytic review found a significant small effect size suggesting that youth diagnosed with panic disorder have higher levels of AS when compared to children with other anxiety disorders10. AS scores are also associated with total number of panic symptoms, number of panic attacks in the past year and month, amount of distress caused by the attacks and perceived seriousness of the attacks9, and predict panic symptoms after controlling for trait anxiety and depression7. Moreover, as in adults28,29, a study30 showed that children with good heart-beat perception had significantly more panic/somatic symptoms and AS scores than those with poorer heart-beat perception, and there were no significant differences between those with good and poor heart-beat perception for general anxiety, social phobia or school phobia symptoms, suggesting a specific association between anxiety related to physiological cues and heart-beat perception as compared to anxiety related to others focus.
The results of this study must be considered in the light of some limitations. First, all children and adolescents in this study are derived from a nonclinical sample and this study eva-luated only students who were recruited from urban schools. The generalizability of our results needs to be de-monstrated through replication in more representative samples among children and adolescents in other settings and from the general population. Second, the findings were exclusively based on the children and adolescents' self-reports. Although anxiety is an internal and subjective experience, behavioral observations and a multi-informant approach using parents, teachers, and peers as sources of information can be useful in the evaluation of AS in youth. Third, temporal associations among variables cannot be made because of the correlational and cross-sectional nature of our study. Although some studies support the causal role of AS in the development of anxiety in youth8,13,14, we are unable to conclude that AS predict particular sets of anxiety symptoms in our sample. Future longitudinal studies are needed to determine the nature and direction of these relations. Although the measures used are well established in several studies and most exhibited good psychometric properties, the Mental Illness Concerns factor and the Social Concerns factor of the CASI showed low internal consistency and the results concerning these factors should be interpreted with caution. Finally, further studies expanding the psychometrics properties of the CASI are warranted to improve the usefulness of the CASI in Brazilian youth.
CONCLUSIONS
Our findings demonstrate an appropriate reliability and evidence of convergent validity in the CASI with a sample of Brazilian school-age children and adolescents suggesting that the CASI could be a suitable tool for evaluating AS in this population. Moreover it could be of great value to figure out different endophenotypes evaluated by rating scales that could be specific to a certain anxiety disorder like the described association between AS and Panic/Somatic symptomatology. Since AS is theoretically related to the development of anxiety disorders and given the limited mental health resources, and the paucity of clinical attention to childhood anxiety disorders in Brazil, the CASI may be a valuable tool for evaluating this important construct in Brazilian children and adolescents who may warrant further assessment and treatment. In addition, it will help understand the commonalities and differences in the nature and presentation of the AS across different cultures.
ACKNOWLEDGMENTS
Funding for this study was provided in part by CNPq, Capes, and FIPE-HCPA. CNPq, Capes, and FIPE-HCPA had no further role in study design; in the collection; analysis and interpretation of data; in the writing of the report; and in the decision to submit the manuscript for publication.
CONFLICTS OF INTEREST
All authors declare they have no conflicts of interest to disclose.
REFERENCES
1. Reiss S, McNally R. Expectancy model of fear. In: Reiss S, Bootzin R, editors. Theoretical issues in behavior therapy. San Diego: Academic Press; 1985. p. 107-21.
2. Reiss S. Expectancy model of fear, anxiety, and panic. Clin Psychol Rev. 1991;11:141-53.
3. Olatunji BO, Wolitzky-Taylor KB. Anxiety sensitivity and the anxiety disorders: a meta-analytic review and synthesis. Psychol Bull. 2009;135:974-99.
4. Reiss S, Peterson RA, Gursky DM, McNally RJ. Anxiety sensitivity, anxiety frequency and the prediction of fearfulness. Behav Res Ther. 1986;24:1-8.
5. Silverman WK, Fleisig W, Rabian B, Peterson RA. Childhood anxiety sensitivity index. J Clin Child Psychol. 1991;20:162-8.
6. Rabian B, Embry L, MacIntyre D. Behavioral validation of the Childhood Anxiety Sensitivity Index in children. J Clin Child Psychol. 1999;28:105-12.
7. Calamari JE, Hale LR, Heffelfinger SK, Janeck AS, Lau JJ, Weerts MA, et al. Relations between anxiety sensitivity and panic symptoms in nonreferred children and adolescents. J Behav Ther Exp Psychiatry. 2001;32:117-36.
8. Deacon BJ, Valentiner DP, Gutierrez PM, Blacker D. The Anxiety Sensitivity Index for Children: factor structure and relation to panic symptoms in an adolescent sample. Behav Res Ther. 2002;40:839-52.
9. Lau JJ, Calamari JE, Waraczynski M. Panic attack symptomatology and anxiety sensitivity in adolescents. J Anxiety Disord. 1996;10:355-64.
10. Noel VA, Francis SE. A meta-analytic review of the role of child anxiety sensitivity in child anxiety. J Abnorm Child Psychol. 2011;39:721-33.
11. Anselmi L, Fleitlich-Bilyk B, Menezes AM, Araujo CL, Rohde LA. Prevalence of psychiatric disorders in a Brazilian birth cohort of 11-year-olds. Soc Psychiatry Psychiatr Epidemiol. 2010;45:135-42.
12. Fleitlich-Bilyk B, Goodman R. Prevalence of child and adolescent psychiatric disorders in southeast Brazil. J Am Acad Child Adolesc Psychiatry. 2004;43:727-34.
13. Goodman R, Neves dos Santos D, Robatto Nunes AP, Pereira de Miranda D, Fleitlich-Bilyk B, Almeida Filho N. The Ilha de Mare study: a survey of child mental health problems in a predominantly African-Brazilian rural community. Soc Psychiatry Psychiatr Epidemiol. 2005;40:11-7.
14. Da Silva WV, De Figueiredo VL. Childhood anxiety and assessment instruments: a systematic review. Rev Bras Psiquiatr. 2005;27:329-35.
15. Salum GA, Isolan LR, Bosa VL, Tocchetto AG, Teche SP, Schuch I, et al. The multidimensional evaluation and treatment of anxiety in children and adolescents: rationale, design, me-thods and preliminary findings. Rev Bras Psiquiatr. 2011;33:181-95.
16. Silverman WK, Goedhart AW, Barrett P, Turner C. The facets of anxiety sensitivity represented in the childhood anxiety sensitivity index: confirmatory analyses of factor models from past studies. J Abnorm Psychol. 2003;112:364-74.
17. Brislin RW. Back-Translation for Cross-Cultural Research. J Cross Cult Psychol. 1970;1: 185-216.
18. Birmaher B, Khetarpal S, Brent D, Cully M, Balach L, Kaufman J, et al. The Screen for Child Anxiety Related Emotional Disorders (SCARED): scale construction and psychometric characteristics. J Am Acad Child Adolesc Psychiatry. 1997;36:545-53.
19. Birmaher B, Brent DA, Chiappetta L, Bridge J, Monga S, Baugher M. Psychometric properties of the Screen for Child Anxiety Related Emotional Disorders (SCARED): a replication study. J Am Acad Child Adolesc Psychiatry. 1999;38:1230-6.
20. Isolan L, Salum GA, Osowski AT, Amaro E, Manfro GG. Psychometric properties of the Screen for Child Anxiety Related Emotional Disorders (SCARED) in Brazilian children and adolescents. J Anxiety Disord. 2011;25:741-8.
21. Essau CA, Sasagawa S, Ollendick TH. The facets of anxiety sensitivity in adolescents. J Anxiety Disord. 2010;24:23-9.
22. Walsh TM, Stewart SH, McLaughlin E, Comeau N. Gender differences in Childhood Anxiety Sensitivity Index (CASI) dimensions. J Anxiety Disord. 2004;18:695-706.
23. Varela RE, Weems CF, Berman SL, Hensley L, De Bernal MCR. Internalizing symptoms in latinos: the role of anxiety sensitivity. J Youth Adolesc. 2007;36:429-40.
24. Stewart SH, Taylor S, Baker JM. Gender differences in dimensions of anxiety sensitivity. J Anxiety Disord. 1997;11:179-200.
25. Ginsburg GS, Silverman WK. Gender role orientation and fearfulness in children with anxiety disorders. J Anxiety Disord. 2000;14:57-67.
26. Taylor S, Jang KL, Stewart SH, Stein MB. Etiology of the dimensions of anxiety sensitivity: a behavioral-genetic analysis. J Anxiety Disord. 2008;22:899-914.
27. Kearney CA, Albano AM, Eisen AR, Allan WD, Barlow DH. The phenomenology of panic disorder in youngsters: an empirical study of a clinical sample. J Anxiety Disord. 1997;11:49-62.
28. Sturges LV, Goetsch VL. Psychophysiological reactivity and heartbeat awareness in anxiety sensitivity. J Anxiety Disord. 1996;10:283-94.
29. Willem Van der Does AJ, Antony MM, Ehlers A, Barsky AJ. Heartbeat perception in panic disorder: a reanalysis. Behav Res Ther. 2000;38:47-62.
30. Eley TC, Stirling L, Ehlers A, Gregory AM, Clark DM. Heart-beat perception, panic/somatic symptoms and anxiety sensitivity in children. Behav Res Ther. 2004;42:439-48.
Correspondence to:
Luciano Isolan
Hospital de Clínicas de Porto Alegre
Rua Ramiro Barcelos, 2350, sala 2202
90035-003 - Porto Alegre, RS, Brazil
Phone/Fax: +55 51 3359 8983
E-mail: isolan@cpovo.net
Artigo original: