|Year : 2020 | Volume
| Issue : 4 | Page : 166-172
Translation, validity, and reliability of disability rating scale in Iranian patients with traumatic brain injury
Kamran Ezzati1, Shahrokh Yousefzadeh-Chabok1, Sajjad Rezaei2, Zoheir Reihanian3
1 Guilan Road Trauma Research Center, PourSina Hospital, School of Medicine, Guilan University of Medical Sciences, Rasht, Iran
2 Department of Psychology, University of Guilan, Rasht, Iran
3 Guilan Road Trauma Research Center, PourSina Hospital; Department of Neurosurgery, School of Medicine, Guilan University of Medical Sciences, Rasht, Iran
|Date of Submission||13-Mar-2020|
|Date of Decision||28-Jun-2020|
|Date of Acceptance||03-Aug-2020|
|Date of Web Publication||26-Dec-2020|
Dr. Sajjad Rezaei
Department of Psychology, University of Guilan, Rasht
Source of Support: None, Conflict of Interest: None
Background: The Disability Rating Scale (DRS) is a short, efficient, and rapid instrument for assessing levels of functional disability, but little information is available on the translation and psychometric properties of its Persian version, especially for traumatic brain injury (TBI) patients. The aim of this study was to translate and adapt the Persian version of DRS and to determine the psychometric properties of the Persian version of this scale in patients with TBI. Materials and Methods: In this analytical cross-sectional study, 191 TBI patients (age range, 16–86 years) referred to the physiotherapy Center of PourSina Hospital in Rasht, Iran, were selected through census sampling. First, the DRS was translated into Persian, and then, the validity, reliability, and repeatability of DRS scores were evaluated. All patients were evaluated on admission and at discharge through the Glasgow Coma Scale (GCS) and Functional Independence Measure (FIM). Results: According to the reports of the translators, translation of the DRS into Persian language was easy. The quality of translation (including translation clarity, common language usage, conceptual equivalence, and overall quality of translation) was generally favorable. Inter-raters' reliability on admission and at discharge stages was excellent (intraclass correlation coefficient = 0.93–0.94). Cronbach's alpha values for the internal consistency of DRS on admission and at discharge stages were 0.96 and 0.97, respectively. The results showed a strong inverse relationship of DRS scores on admission and at discharge with GCS and FIM scores (in all cases more than 0.70, P < 0.0001). Conclusion: The validity, reliability, and repeatability of the DRS scores for the Persian version were confirmed. These results reflect that DRS can be used to determine the effects of therapeutic/rehabilitation interventions on levels of functional disability in Iranian patients with TBI.
Keywords: Disability assessment, psychometric, traumatic brain injury
|How to cite this article:|
Ezzati K, Yousefzadeh-Chabok S, Rezaei S, Reihanian Z. Translation, validity, and reliability of disability rating scale in Iranian patients with traumatic brain injury. Arch Trauma Res 2020;9:166-72
|How to cite this URL:|
Ezzati K, Yousefzadeh-Chabok S, Rezaei S, Reihanian Z. Translation, validity, and reliability of disability rating scale in Iranian patients with traumatic brain injury. Arch Trauma Res [serial online] 2020 [cited 2021 May 7];9:166-72. Available from: https://www.archtrauma.com/text.asp?2020/9/4/166/305068
| Introduction|| |
The lifelong costs of caring for traumatic brain injury (TBI) patients are high, and the impact of an effective treatment for this devastating disorder is economically significant not only for the patient's family but also for the community and health system., Therefore, the main goal of the new treatments and interventions is to reduce the physical disability of TBI patients, and it is clear that health-care professionals, researchers, and planners need valid, reliable, and repeatable tools which are simple to operate and sensitive to a variety of defects that generally cause functional disability in patients with TBI to assess the effectiveness of care interventions in patients. The Disability Rating Scale (DRS) is one of the most commonly used tools for outcome measurement in TBI.
The DRS was developed and tested in patients with moderate-to-severe TBI admitted to rehabilitation centers. One advantage of DRS is the ability to record a person's changes from the coma stage to the community. This scale can also cover a wide range of recovery stages for patients with brain injury because of the variety of items included in it. This scale covers all the three measurement categories of the WHO including impairment, disability, and participation. The first three items of DRS include eye opening, ability to communicate, and motor response; it is based on a model with little modifications to the Glasgow Coma Scale (GCS) and reflects the rate of impairment. Furthermore, the three items of feeding, toileting, and grooming show the level of disability. The level of functioning is a modified item from a scale used by Scranton in 1970; this item together with the employability item shows the level of handicap.
The highest score a patient can obtain from the DRS is 29 (severe vegetative state). A patient without a disability can score 0. DRS scoring should be reliable, and the patient should not be under the influence of anesthesia or other drugs altering brain activity. The purpose of designing this scale is to accurately measure overall functional changes during patient recovery.
The validity and reliability of DRS have been confirmed in various studies.,,,, DRS can be completed by the patient or by interviewing his or her family. The main reasons for the generality of this scale are its ease of scoring and shortness. The DRS scoring time ranges from 30 s (for anyone who is familiar with the scale) for up to 15 min, assuming that the examiner has to interview the individual and his/her family and ask for extra information from available personnel.
The original DRS version is English and has been translated into five other languages. The tools used to evaluate outcomes in rehabilitation should have acceptable repeatability and validity. One of the problems in cross-cultural research today is that most tools are developed in English-speaking countries, and there are relatively few tools that have been adequately translated and adapted in non-English-speaking cultures.
On the other hand, the accepted validity and repeatability of a tool in one language does not guarantee that these features remain unchanged following translation of the tool to another. Therefore, it is necessary to examine the psychometric properties of the tool in the new language before using it in scientific works.
Considering that when a tool is used in an environment different from the environment where it is developed, culture, language, and geographical location must be taken into account; when a tool is used cross-culturally, there is a standardized approach to translate, adapt, and review its psychometric properties. In other words, in order to use this tool in non-English-speaking communities, it must be adapted and the psychometric properties of the new version were examined.
According to what was stated, translation of the DRS into Persian language is necessary in order to create a common language among rehabilitation professionals in Iran as well as to record data and conduct outcome-based studies in TBI patients. So far, no research has been performed on evaluating the psychometric properties of DRS in Iran. The aim of this study was to translate and adapt the Persian version of the DRS and to determine the psychometric properties of the Persian version of this scale in patients with TBI.
| Materials and Methods|| |
This analytical cross-sectional study was performed on 191 patients (age range, 16–86 years), diagnosed with mild-to-severe TBI. These patients were admitted to the Trauma and Internal Neurosurgery and Intensive Care Units of PourSina Hospital in Rasht (North of Iran) during 2019–2020 and were referred to the same hospital for rehabilitation. Eligible patients were selected through census sampling.
The inclusion criterion for all patients with mild-to-severe TBI in both stages was 16 years of age and older. The exclusion criteria were patients with clinical or radiologic findings indicating spinal cord injury, any pre-TBI neurological disease, or non-TBI lesions (such as brain tumors, arterial aneurysms, stroke, and other cerebrovascular accidents), patients with vegetative status or severe lack of consciousness who were unable to respond to tests; presence of motor or balance disorders, arthritis, knee or joint fractures prior to TBI, and patients who were not willing to participate in the study for any reason.
It should be noted that patients who had been hospitalized for more than 7 days were evaluated. Demographic data were collected after obtaining informed consent from the patients or their families. The next step was to extract clinical information (such as the exact length of hospital stay), the results of neurosurgery examinations, and the findings of neurosurgical imaging (CT scans) until the same day of their hospital information records. DRS and Functional Independence Measure (FIM) were completed simultaneously by two physiotherapists on admission and at discharge. The research proposal was accepted by the Ethics Committee of Guilan University of Medical Sciences under a code of IR.GUMS.REC.1397.184.
Functional Independence Measure
The FIM is a multidimensional measure that assesses self-care, sphincter control, moving objects, motor displacement, communication, and social cognition along with cognitive (5 items) and motor (13 items) subscales. Each FIM dimension has a score ranging from a minimum of 1 (complete help needed to complete the task) to a maximum of 7 (complete independence). Then, the scores for each dimension are summed, yielding a probable total score ranging from 18 (complete dependency) to 126 (complete independence). FIM has shown desirable construct validity, repeatability (intraclass correlation coefficient [ICC] = 0.779–0.895), and internal consistency (α ≥ 0.97) in TBI patients.
Glasgow Coma Scale
It was introduced in 1974 as a tool for assessing the depth and duration of impaired consciousness and coma. GCS has also been developed to measure the severity or improvement of early stages of injury or brain lesion and to predict the final outcome. The GCS is a 15-point scale that measures the depth of coma and the duration of posttraumatic amnesia. In addition, GCS has been able to predict the motor and cognitive abilities of TBI patients at the time of admission and discharge.
Data were analyzed using ICC and Spearman's correlation coefficient by the SPSS software version 24 (SPSS 24, IBM, Armonk, NY, United States of America). The level of significance was set at P < 0.05.
In order to determine the inter-rater reliability of the DRS or to determine the correlation between the scores given by two examiners in the admission and discharge stages, the ICC with two-way random effects model (absolute agreement type) was used. ICC was used to evaluate the repeatability of the scores obtained from the total score of the Persian version of the DRS by two physiotherapists at twice measurement with at least 2-week interval. The classification of repeatability is as follows: excellent (0.99–0.90), good (0.89–0.80), moderate (0.790–0.70), and poor (≤0.69).
The internal consistency of the DRS was evaluated by examining the intercorrelation among the DRS items. The common technique for this purpose is the Cronbach's alpha coefficient. A Cronbach's alpha of 0.70 and above is acceptable, 0.80 and above is good, and 0.90 and above is excellent.
Spearman's correlation coefficient was run to evaluate the construct validity of the DRS (determining its relationship with FIM and GCS). Correlations between total scale scores on the admission and discharge stages were examined. Nonparametric Spearman's coefficient values were interpreted as excellent relationship ≥0.91, good 0.90–0.71, fair 0.70–0.51, weak 0.5–0.31, and little or none ≤0.3.
| Results|| |
Translation and adaptation
After preparing the preliminary Persian version of DRS by the first and second translators, this initial version was evaluated and scored by two other translators (the third and fourth translators) for the quality and difficulty of translation [Table 1]. It should be noted that the concept of translation quality is based on four more detailed concepts: clarity or transparency (using simple and understandable terms), common language (nonuse of technical and specialized terms and expressions), conceptual equivalence (according to the concepts in the original version), and general quality (suitability and overall quality of translation). For each of these dimensions, each of the third and fourth translators performed scoring on a 100-point scale, and the mean scores of these two translators are listed in [Table 1].,
|Table 1: Descriptive findings from the evaluation of the quality and difficulty of translating the adapted Persian version of the Disability Rating Scale|
Click here to view
The translators also scored the difficulty of translation and their meanings using the same method, the results of which are listed in [Table 1]. For the columns of agreement for each of these concepts, if the scores of the two translators exceeded 15 points, the negative sign was marked (meaning no agreement), and if the maximum difference was 15 points or less, a positive sign given (meaning agreement). In addition, in difficulty and quality of translation detail columns, it was determined as easy translation if the average difficulty score was maximum 25, and if the mean quality score was at least 90, desirable translation quality was specified. Finally, the words “relatively desirable” and “relatively easy” were used to indicate the quality and difficulty close to the cutoff points (for the mean quality between 80 and 90 and the mean difficulty between 25 and 30).
It should be noted that the results in [Table 1] were calculated using the final version obtained from DRS, and during the translation and adaptation processes, preliminary versions were obtained, especially with regard to the quality of translation for some items, responses or recommendations had lower-than-desirable scores, and a percentage of undesirable translations were observed. These items had poor translation quality and were re-reviewed by the researchers and modified using the words and phrases and substitution sentences suggested by the first and second translators and provided to the third and fourth translators for evaluation. The above process was repeated until the quality of the translation of the Persian version obtained at this stage improved to a satisfactory and acceptable level and the mean scores reached over the desirable level.
As noted in the translation difficulty column, most of these items are identified by translators as having easy translation. Consequently, a satisfactory quality of translation was prepared, and the same version was used in the later stages of the translation and adaption process to perform the “back translation” step, which consisted of translating the scale back to English by two translators whose mother tongue was English and had sufficient experience in translating texts from Farsi to English. This English version was originally from the Persian version, which should be conceptually identical to the English version. To this end, joint meetings were held with the participation of the third, fourth, fifth, sixth translators and researchers of the present study, and finally, the initial Persian version was prepared, finalized, and approved after resolving a few minor inconsistencies in translation quality. The final version of the “translation and adaptation” phase was completed with the completion of this Persian version, and the research entered the following stages.
Of the 234 patients evaluated, 32 died and 11 could not be evaluated at discharge and were excluded. Therefore, the following information was obtained by administering the Persian version of DRS among 191 patients [Table 2]. In this study, 32 women (16.8%) and 159 men (89.3%) participated. The mean age of the patients was 46.30 ± 13 years, with the age range of 16–86 years. The average length of hospital stays (n = 191) was 13 ± 7 days, with a minimum of 7 and a maximum of 56 days. Furthermore, 26 patients (13.6%) had subdural hemorrhage, 71 (37.2%) had epidural hemorrhage, and 94 (49.2%) had intracerebral hemorrhage. Finally, 54 patients (28.3%) had multiple brain injuries.
|Table 2: Descriptive statistics indices and Shapiro-Wilk test results of Disability Rating Scale, Glasgow Coma Scale, and Functional Independence Measure instruments on admission and at discharge (n=191)|
Click here to view
Validation and correlation of tests
Due to the lack of a gold standard on the performance of patients with TBI, the purpose of this study was to evaluate the validity of the Persian version of DRS and to determine the correlation of GCS and FIM scores with DRS total score. The results of Spearman's correlation analyses are presented in [Table 3].
|Table 3: Spearman's correlation of Disability Rating Scale with Glasgow Coma Scale and Functional Independence Measure scores in traumatic brain injury patients (n=191)|
Click here to view
As shown in [Table 3], the DRS scores on admission and at the time of discharge were strongly correlated with the GCS and FIM scores (P < 0.0001).
Repeatability in test times
In the present study, the calculated ICCs are well above the acceptable level of 0.70; therefore, a reliability/repeatability for the Persian version of DRS is deduced. The results of ICCs are shown in [Table 4].
|Table 4: Intraclass correlation coefficient values and Cronbach's alpha coefficients for the Persian version of Disability Rating Scale on admission and at discharge|
Click here to view
DRS internal consistency was calculated by Cronbach's alpha coefficients on admission and at the time of discharge, the results of which are shown in [Table 4].
| Discussion|| |
Scale developers and translators try to avoid using ambiguous and unusual terms with multiple meanings and thus facilitate the process of translating the text of the tool into another language as much as possible. In the present study, such an advantage is clearly observed. In other words, four contributors to the project, who had a good experience of translating texts from English to Persian, affirmed the ease and quality of the translation process quantitatively.
The existing literature on secondary versions of the DRS also confirms this issue., Therefore, the easy and high-quality translation of this scale into Persian, as well as the relatively numerous translations of this scale internationally, could be another evidence of one of the advantages of DRS.
There was a strong inverse correlation between total DRS score and GCS and FIM scores (more than 0.70 in all cases). These findings confirm the construct validity of the DRS. Consistent with the present study, Deepika et al. examined the predictive validity of the DRS in determining the functional outcome of severe TBI patients and found that DRS can predict patients' 1-year performance on admission and at discharge.
The results showed that DRS repeatability was excellent by ICC calculation of the Persian version in the two measurements during admission and discharge. The Persian version of DRS also had a satisfactory internal consistency. These results suggest that the Persian version of DRS provides researchers and therapists with a reliable assessment of disability/function in Iranian TBI patients., Consistent with the present study, Hall et al. found that DRS had excellent internal consistency (Cronbach's alpha between 0.83 and 0.84). There was also an excellent inter-rater (0.97–0.98) and intra-rater reliability (0.95) for DRS. In patients with mild TBI (i.e., GCS above 12), the results of internal consistency and repeatability of DRS results were consistent with the present study. Considering the proximity of the calculated coefficients of the present study with previous studies,, it can be concluded that there is a clear agreement in achieving high levels of score repeatability.
One of the study limitations was that the results of this study are only generalizable to those of TBI patients referred by neurosurgery specialists for rehabilitation and physiotherapy. Therefore, caution should be exercised when generalizing these results to evaluate the performance and disability of other TBI patients. Moreover, although DRS has been translated into Persian with an acceptable agreement, the findings from the DRS psychometric characteristics are only limited to the admitted TBI patients in northern Iran. For future research, it is recommended that the validity of known groups or the differential validity of TBI clinical subgroups be examined.
| Conclusion|| |
The quality of translation (including translation clarity, common language usage, conceptual consistency, and overall quality of translation) of the DRS items in Persian was generally desirable. The inter-rater reliability between the evaluators and the reliability of the internal consistency for DRS were obtained excellent on admission and at discharge. There were strong correlations between total DRS scores on admission and at discharge with GCS and FIM scores, indicating the desired construct validity. These results reflect that DRS can be used to determine the effects of therapeutic/rehabilitation interventions on levels of functional disability in Iranian patients with TBI.
The authors gratefully acknowledged the staff of the physiotherapy, emergency, and neurosurgery wards at the PourSina Educational Hospital in Guilan University of Medical Sciences.
Financial support and sponsorship
This study was supported by Guilan University of Medical Sciences, Rasht, Iran.
Conflicts of interest
There are no conflicts of interest.
| References|| |
van Deynse H, Van Belleghem G, Lauwaert D, Moens M, Pien K, Devos S, et al
. The incremental cost of traumatic brain injury during the first year after a road traffic accident. Brain Inj 2019;33:1234-44.
Myburgh JA, Cooper DJ, Finfer SR, Venkatesh B, Jones D, Higgins A, et al
. Epidemiology and 12-month outcomes from traumatic brain injury in australia and new zealand. J Trauma 2008;64:854-62.
Williams MW, Smith EL. Clinical utility and psychometric properties of the Disability Rating Scale with individuals with traumatic brain injury. Rehabil Psychol 2017;62:407-8.
Lee YH, Chang KH, Escorpizo R, Chi WC, Yen CF, Liao HF, et al
. Accuracy of the World Health Organization Disability Assessment Schedule 2.0 (WHODAS 2.0) score as an objective assessment tool for predicting return-to-work status after head and neck cancer in male survivors. Support Care Cancer 2019;27:433-41.
Hall KM, Hamilton BB, Gordon WA, Zasler ND. Characteristics and comparisons of functional assessment indices: Disability rating scale, functional independence measure, and functional assessment measure. J Head Trauma Rehabilit 1993;8:60-74.
Deepika A, Devi BI, Shukla D. Predictive validity of disability rating scale in determining functional outcome in patients with severe traumatic brain injury. Neurol India 2017;65:83-6.
] [Full text]
Malec JF, Hammond FM, Giacino JT, Whyte J, Wright J. Structured interview to improve the reliability and psychometric integrity of the Disability Rating Scale. Arch Phys Med Rehabil 2012;93:1603-8.
Pretz CR, Malec JF, Hammond FM. Longitudinal description of the disability rating scale for individuals in the National Institute on Disability and Rehabilitation Research traumatic brain injury model systems national database. Arch Phys Med Rehabil 2013;94:2478-85.
van Baalen B, Odding E, van Woensel MP, Roebroeck ME. Reliability and sensitivity to change of measurement instruments used in a traumatic brain injury population. Clin Rehabil 2006;20:686-700.
Finch E, Brooks D, Stratford PW, Mayo NE. Physical rehabilitation outcome measures: A Guide to Enhanced Clinical Decision Making. 2nd
ed. Toronto: Lippincott, Williams & Wilkins; 2002. p. 3-5, 15-33.
Cole B, Finch E, Gowland C, Mayo N. Back and/or pain measures. In: Basmajian J, editor. Physical Rehabilitation Outcome Measures. Toronto (ON): Williams & Wilkins, Health and Welfare Canada and Canadian Physiotherapy Association; 1995. p. 1-23.
Wade DT. Measurement in Neurological Rehabilitation. Oxford, NewYork, Tokyo: Oxford University Press; 1992. p. 15-7, 35-43.
Perneger TV, Leplège A, Etter JF. Cross-cultural adaptation of a psychometric instrument: Two methods compared. J Clin Epidemiol 1999;52:1037-46.
Rezaei S, Dehnadi Moghadam A, Khodadadi N, Rahmatpour P. Functional independence measure in Iran: A confirmatory factor analysis and evaluation of ceiling and floor effects in traumatic brain injury patients. Arch Trauma Res 2015;4:e25363.
Dehnadi-Moghadam A, Rezaei S, Khodadadi N, Rahmatpour P. Psychometric properties of the functional independence measure (FIM) in Iranian patients with traumatic brain injury. Trauma Monthly 2017;22.
McNett M. A review of the predictive ability of Glasgow Coma Scale scores in head-injured patients. J Neurosci Nurs 2007;39:68-75.
Rezaei S, Dehnadi Moghadam A, Khodadadi N, Rahmatpour P, Salehpour GH. Prediction of motor and cognitive outcome in acute traumatic brain injury based on length of hospital stay, Glasgow coma scale score (GCS), mental status and substance abuse: A case study of emergency and neurosurgery section in Rasht Poursina hospital. J Iran Soc Anaesthesiol Intensive Care 2013;82:24-35.
Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 2016;15:155-63.
Tavakol M, Dennick R. Making sense of Cronbach's alpha. Int J Med Educ 2011;2:53-5.
Fermanian J. Measuring agreement between 2 observers: A quantitative case. Rev Epidemiol Sante Publique 1984;32:408-13.
Bullinger M, Alonso J, Apolone G, Leplège A, Sullivan M, Wood-Dauphinee S, et al
. Translating health status questionnaires and evaluating their quality: The IQOLA Project approach. International Quality of Life Assessment. J Clin Epidemiol 1998;51:913-23.
Drukker M, Kaplan C, Feron F, van Os J. Children's health-related quality of life, neighbourhood socio-economic deprivation and social capital. A contextual analysis. Soc Sci Med 2003;57:825-41.
Iglesias CP, Birks Y, Nelson EA, Scanlon E, Cullum NA. Quality of life of people with venous leg ulcers: A comparison of the discriminative and responsive characteristics of two generic and a disease specific instruments. Qual Life Res 2005;14:1705-18.
Montazeri A, Goshtasebi A, Vahdaninia M, Gandek B. The short form health survey (SF-36): Translation and validation study of the Iranian version. Qual Life Res 2005;14:875-82.
Moin P, Khalighinejad N, Yusefi A, Farajzadegan Z, Barekatain M. Converting three general-cognitive function scales into persian and assessment of their validity and reliability. Int J Prev Med 2011;2:82-7.
[Table 1], [Table 2], [Table 3], [Table 4]