Adaptation and Psychometric Properties of the Spanish Version of the Supports Intensity Scale (SIS)

Size: px
Start display at page:

Download "Adaptation and Psychometric Properties of the Spanish Version of the Supports Intensity Scale (SIS)"

Transcription

1 Adaptation and Psychometric Properties of the Spanish Version of the Supports Intensity Scale (SIS) Miguel-Angel Verdugo University of Salamanca, Institute on Community Inclusion (Salamanca, Spain) Benito Arias University of Valladolid (Valladolid, Spain) and Institute on Community Inclusion Alba Ibáñez University of Cantabria (Santander, Spain) and Institute on Community Inclusion Robert L. Schalock Hastings College Abstract The Supports Intensity Scale (SIS) is used to determine the profile and intensity of the supports needed by a person to participate successfully in major life activities. With its publication into 13 languages, a need has arisen to document its reliability and validity across language and cultural groups. Here we explain the adaptation and the validation process of the SIS on a Spanish sample of 885 people with intellectual disability. Results of the study are discussed in terms of the reliability and validity of the SIS on the Spanish sample and its efficacy for multiple uses in Spain. DOI: / Considerable research has been conducted internationally on the psychometric properties and use of the Supports Intensity Scale SIS (Thompson et al., 2004). The emergence internationally of an ecological model of disability and the related supports paradigm (Luckasson et al., 1992, 2002) has resulted in the translation of the SIS into 13 languages. This extensive interest and use have raised questions regarding its etic (universal) and emic (culture-bound) properties as well as the need to demonstrate its utility and psychometric properties across cultural and linguistic groups. Confirmation of the reliability and validity of the SIS has been published for the English version (Thompson et al., 2004; Thompson, Tassé, & McLaughlin, 2008; Wehmeyer et al., 2009), the French version (Lamoureux-Hebert & Morin, 2009), and the Dutch version (Buntinx, 2008; Claes, van Hoove, van Loon, Vandervelde, & Schalock, 2009). Our purpose in the present study was to evaluate the reliability and validity of a Spanish version of the SIS on a Spanish sample. Method Participants We administered the Spanish version of the SIS to 885 people (538 males [61.5%] and 337 females [38.5%]). They ranged in age from 15 to 76 years (M , SD ). All participants had a primary diagnosis of intellectual disability (with 91% having an assessed IQ of 51 or below), with 15% also having speech and language impairment. In regard to the assessed level of adaptive behavior, 43% of the sample showed a mild level; 40%, a moderate level; and the other 496 E American Association on Intellectual and Developmental Disabilities

2 16%, a severe or profound level according to the scores obtained on the Inventory for Client and Agency Planning ICAP (Bruininks et al., 1986; Montero, 1996, 1999). Ten percent of the sample also had one or more of the following disabilities: mobility limitations, psychiatric impairment, visual impairment, and neurological damage. More than two thirds of the participants (68%) lived in an urban zone, with 32% living in a rural zone. Materials Supports Intensity Scale. The version of the SIS evaluated in this study was the Spanish version developed by Verdugo, Arias, and Ibáñez (2007). The SIS represents a multidimensional measure designed to determine the profile and the intensity of the support needs of an adult with intellectual disability (Thompson et al., 2004). The scale is divided into three sections. Section 1, Needs Support Scale, consists of 49 activities divided into six subscales: Home Living, Community Living, Lifelong Learning, Employment, Health and Safety, and Social Activities. Section 2, Protection and Advocacy Supplementary Scale, is not used to determine the Support Needs Index, but includes critical support needs related to health and safety, self-advocacy, and personal protection. In both sections each activity is ranked according to frequency, daily support time, and type of support. Section 3, Exceptional Medical and Behavioral Support Needs, lists 15 medical conditions and 13 behavioral problems that are assessed on a 3-point Likert scale regarding the need to either monitor or maintain the medical condition (Section 3A) or prevent the occurrence of the listed behavioral challenge (Section 3B). Likert-type scale of support needs. To provide data for criterion-related validity, we developed an informal evaluation tool to measure support needs (as was done by the original authors of the SIS). The present scale had a Likert format, and the required task was to classify the support needs of each participant in reference to each area measured by the SIS. Ratings ranged from 1 (lowest support needs) to5(highest support needs). Adaptive behavior level. Scores on the ICAP (Montero, 1996, 1999) were used as a basis for determining criterion-related validity. The ICAP includes two normed measurement instruments, one for adaptive behavior and the other for maladaptive behavior. It also provides a Service Score index, which uses the measurements of adaptive and maladaptive behavior to indicate the overall level of care, supervision, or training a person requires. Several psychometric studies have shown that the ICAP has adequate reliability and good content and construct validity (Montero, 1996). Procedure Translation and Adaptation of the SIS Step 1. Initial translation. The first stage in the cross-cultural adaptation process was the forward translation. Two English Spanish translations were made by two professional psychologists with a good command of English and whose first language was Spanish. We used guidelines proposed by the International Tests Commission (Hambleton, 1996; Tanzer & Sim, 1999) and other guidelines to the cross-cultural adaptation of tests (Beaton, Bombardier, Guillemin, & Ferraz, 2000). Any disagreements between the two translators were reconciled and synthesized through a face-to-face work session. Step 2. Back translation. A native English translator converted the initial translated version back into the original language. The scope of this process was to ensure that the translated version reflected the same item content as the original version. Results indicated that it did. Step 3. Expert committee. A group of nine experts with considerable experience internationally in assessment consolidated a field test version of the Spanish SIS that was based on the initial translation (Step 1). The adequacy of the Spanish translation was determined by an agreement analysis among the assessments carried out by the nine expert judges. Step 4. Test of the field test version. This field test of the Spanish version was applied to 30 people with intellectual disability, which ensured that the adapted version was still retaining its equivalence in an applied situation. Step 5. Development of the final version of the Spanish SIS. The final version of the Spanish SIS was developed by four academic researchers from the expert committee mentioned in Step 3 (Verdugo, Arias, Ibáñez, & Gómez, 2006; Verdugo, Ibáñez, & Arias, 2007). This new group became the coordinating committee for appraisal of the adaptation process and has been in charge of this assessment tool since Administration of the Spanish Version of the SIS The adaptation of an assessment tool can affect both its reliability and validity. Once the E American Association on Intellectual and Developmental Disabilities 497

3 adaptation process was finished as described above, we recruited individuals from the voluntary collaboration of several developmental disability centers located in 20 provinces of Spain. The SIS interviewers at each center were qualified professionals who had already been trained to reliably administer the SIS. As part of the administration process, we also asked the interviewers to complete the subjective evaluation form of the level of the needed supports and collect the most recent ICAP evaluation results for each participant. This information was useful for analyzing construct and criterion-related validity. In some cases, we also asked for two applications of the SIS 3 weeks apart and two completed SIS protocols obtained on the same person with intellectual disability done by two different professionals. Statistical Analyses The statistics packages we used to analyze the data were SAS, version (The SAS Institute, 2005); SPSS, version 14.0 (SPSS, 2006), and STATISTICA, version 7.0 (StatSoft, 2005). Results Reliability Internal consistency reliability. We calculated Cronbach s alpha coefficients in the different ranges of age (16 to 19, 20 to 29, 30 to 39, 40 to 49, 50 to 59, 60 or more). In all the cases, the internal consistency coefficients were very high, exceeding the absolute value of.90. The coefficients ranged from.903 to.995, which indicate that the internal consistency is excellent according to guidelines provided by Landis and Koch (1977):.00 is no agreement;.01 to.20, insignificant;.21 to.40, a fair level of agreement;.41 to.60, moderate,.61 to.80, good;.81 to 1.00, very good. Split-half reliability: After randomly dividing the items into another set of split-halves and recomputing them, we calculated different indexes of reliability: the Cronbach s alpha coefficient for each half, the Pearson product-moment correlation coefficient between the first and the second half, the corrected correlation coefficient for reducing the attenuation, the global coefficients reliability (split-half and Guttman), and the average correlation among the items. As shown in Table 1, in all cases the global coefficients of reliability were above the threshold of.90. Table 1. Percentage of Agreement/Holsti and Scott s p Judge (J) J1 J2 J3 J4 J5 J6 J7 J8 J J J J J J J J Note. Percentages of agreement/holsti under the diagonal; Scott s p coefficients above the diagonal. Test retest reliability. The same interviewer applied the SIS to a sample of 143 participants at two different times with an interval of 3 weeks. We calculated the Pearson s product-moment correlation coefficients between the test and retest scores and obtained values between.84 and.93 (between.901 and.981 in the corrected correlation). These coefficients are excellent according to the guidelines provided by Cicchetti and Sparrow (1981). Specifically, the test retest coefficients for each of the 49 items ranged from.63 (Item 4 of Health and Safety Activities, ambulating and moving about) to.90 (Item 3 of Home Living Activities, preparing food). Using the guidelines provided by Cicchetti and Sparrow for evaluating the reliability coefficients, we found that 46 coefficients (93.9%) fell within the excellent range, and only 3 (6.12%) in the good range, which guaranteed the test retest reliability of the SIS. Interrater reliability. The interrater reliability was evaluated by two professionals who applied each scale twice, with an interval of 2 weeks. Pearson product-moment correlation (and corrected) coefficients were computed. Results of the different subscales ranged from.60 and.84 (.62 and.86 in the corrected correlations). These data are consistent with those reported by Thompson et al. (2004). Validity Content Validity Agreement among judges. The adequacy of the Spanish translation was determined by an agreement analysis among the assessments carried out by expert judges. Although we calculated the level of agreement among judges with different types of 498 E American Association on Intellectual and Developmental Disabilities

4 Table 2. Cohen s k and Krippendorff s a Coefficients Judge (J) J1 J2 J3 J4 J5 J6 J7 J8 J J J J J J J J Note. Cohen s k coefficients under the diagonal; Krippendorff s a coefficients above the diagonal. indexes (see Tables 2 and 3), the observer agreement chart (Bangdiwala, 1987; Friendly, 2001) provides a simple graphic representation of the strength of agreement in a contingency table and a measure of strength of agreement with an intuitive interpretation (see Figure 1). The Bangdiwala s agreement chart shows the information about two aspects of the data: (a) the level of agreement (the global magnitude of agreement in the contingency table); and (b) the level of partial agreement (distance among observers or judges in the categorization of events). The agreement chart is constructed as an n 3 n square, where n is the total sample size (i.e., the nine domains or support areas). Black squares, each of size n ii 3 n ii, show the observed agreement. These are positioned within larger rectangles, each of size n i+ 3 n +i. The large rectangle shows the maximum possible agreement given the marginal totals. Thus, a visual impression of the strength of agreement (Friendly, 2001) is determined by: B N ~ X k n 2 i ii X k i n iz n zi To determine the degree of judgments reliability, we used the guidelines provided by Landis and Koch (1977). As shown in Tables 2 through 4, the degree of agreement between judges fell in all the cases (with the exception of the Bangdiwala s raw coefficient) in the good category. The Bangdiwala s agreement coefficient for each domain of the SIS is presented with the Bangdiwala s agreement statistics shown in Figure 1 (Bangdiwala, 1987; Friendly, 2001). These results support the content validity of the Spanish version of the SIS. Discriminative power of items. After dividing the participants into three groups (delimited by Quartiles 1 and 3 in the Support Needs Index of the SIS), we verified the differences between the average ranks of each item according to which group (high, medium, low) each participant had been classified in. In view of the ordinal nature of the data, we used a Kruskal-Wallis one-way analysis of variance (ANOVA) by ranks. The results of the contrast (chi-square) were highly significant, p,.0001, for all items, providing evidence of the discriminating power of items. Subscales corrected homogeneity. We calculated the corrected homogeneity index and the averages of the abovementioned coefficient by subscale considering each one of the segments of age. The results exceeded the value of.75 in all cases. The rank of the coefficients ranged from.78 to.97 (the median one was situated between.83 and.93). As a consequence, the subscales demonstrated a high consistency through the different segments of age (according to the ranges of clinical significance recommended by Cicchetti, 1994). Criterion-related validity. We use data from the subjective evaluation of the level of needed supports to establish criterion-related validity. We computed the polychoric correlations matrix of items. All of these coefficients ranged from.64 to.93; therefore, we concluded that they were significant because they exceeded the threshold of.35, usually considered as representative of the criterion-related validity. Construct validity Age differentiation. The variance analysis and the post hoc comparisons by pairs in the different Table 3. Judges Agreement Coefficients Bangdiwala Agreement % Bennett s Perreault s Index Scott s Cohens Krippendorff s B N B W N Holsti S PI LO_PI p k a Average E American Association on Intellectual and Developmental Disabilities 499

5 Figure 1. Bangdiwala s Agreement Chart. D1 5 Home Living Activities; D2 5 Community Living Activities; D3 5 Lifelong Learning Activities; D4 5 Employment Activities; D5 5 Health and Safety Activities; D6 5 Social Activities; D7 5 Protection and Advocacy Activities; D8 5 Exceptional Medical Support Needs; D9 5 Exceptional Behavioral Support Needs. subscales according to the six age groupings revealed no significant differences among the different age-related scores, p..01. Intercorrelation of SIS scores. Because both the SIS subscales and the composite scorings measure aspects related to the support needs, they are supposed to correlate significantly among them. After calculating the correlation matrix of the normed scores of the subscales and the composite scores, we found that the obtained coefficients among subscales ranged from.78 to.88, with subscale total scores ranging from.90 to.95. Relationship of the SIS to the level of intellectual functioning. We obtained a significant correlation between SIS subscales scores and the levels of intellectual functioning. The results show r coefficients between and 2.524, p 5.000, which reveals an inverse relationship. We completed this analysis with a unifactorial variance analysis, with the factor being the intellectual disability of the participants and the dependent variables, the typified subscales scores. All the resulting contrasts were significant, p,.01. The post-hoc intergroup comparison test showed the existence of significant differences regarding the disability level, p,.01, whereas the intragroup differences among the diverse subscales were minimal. These results support the instrument s construct validity. Relationship of the SIS to measures of adaptive behavior. The correlation coefficients obtained between SIS and ICAP scores ranged from and 2.589, p 5.000, n These significant negative correlation coefficients are consistent with the previously referenced psychometric studies. In addition, we developed a unifactorial variance analysis. The dependent variables were the typified subscales scores and the SIS total and the factor was group membership (grouped on mild, moderate, or severe adaptive behavior). This unifactorial ANOVA revealed the existence of significant differences among the three groups in all SIS subscales and the lack of influence of the intragroup differences. Group differentiation. Our predictor variable was the raw scores of the SIS interviewees and grouping variable was the categories (mild, moderate or severe), according to the individual s adaptive behavior score. We conducted the analysis on a sample of 147 participants by group. The intragroup correlations of each variable with Table 4. Reliability Coefficients (Split-Half) SIS scorings 1st half a 2nd half a 1st 2nd correl. Corrected correl. for attenuat. Reliability S-H Reliability Guttman Average items correlation HL CL LL EMP H&S SOC Total Note. Correl. 5 correlation, Attenuat. 5 attenuation, S-H 5 split-half. HL 5 Home Living, CL 5 Community Living, LL 5 Lifelong Learning, EMP 5 Employment, H&S 5 Health and Safety, SOC 5 Social, Total 5 SIS Composite. 500 E American Association on Intellectual and Developmental Disabilities

6 the canonic function were, in a decreasing order,.901 (Home Living Activities),.871 (Lifelong Learning Activities),.801 (Employment Activities),.800 (Health and Safety Activities),.793 (Social Activities), and.788 (Community Living Activities). In total, the function correctly classified 61.9% of cases, and it was more effective in classifying the participants with a severe level of adaptive behavior (72%) than those with a mild (64.5%) or moderate deficit (55%). Discussion Reliability analyses reported in this article demonstrate the excellent internal consistency and test retest reliability of the SIS, consistent with the results on the English, French, Italian, Catalan, and Dutch versions (Claes et al., 2009; Lamoureux-Hébert & Morin, 2009; Schalock, Thompson, & Tassé, 2008a, 2008b; Thompson et al., 2004, 2008). Similarly, the three types of validity reported supported the validity of the instrument. Content validity was based on the agreement of expert judges about the adequate correspondence between items and their respective subscales. The degree of agreement was good in all the cases, and the discriminative power of items was confirmed. Finally, the indexes of the subscales corrected homogeneity were high in all cases. Criterion validity was based on the correlation between SIS subscales and rater estimates of support needs, according to the procedure followed by the original authors of the SIS. The results were positive and representative of this type of validity. Construct validity indicated that (a) there was no age differentiation in the SIS scores, (b) there was a significant intercorrelation among SIS scores, (c) there were significant correlations between SIS subscales scores and both the intellectual functioning level and adaptive behavior assessed, and (d) there were significant differences in SIS scores among those individuals rated on the ICAP as mild, moderate or severe. These results are consistent with those published articles regarding the SIS referenced above. In the future, we anticipate that SIS-related information will be used at three levels within Spain: the individual, the agency, and the wider system. At the individual level, the Spanish version of the SIS will contribute to the development of individualized plans and strategies centered on each person s assessed support needs rather than on planning from the global perspective of services being received by the person. Both the supports paradigm and the quality of life provide the necessary elements to develop person-centered planning strategies that address the reduction of support needs and the improvement of quality of life (Schalock & Verdugo, 2002; Schalock, Keith, Verdugo, & Gómez, 2009). At the wider system level, it would be good to rethink how to guide resource allocation and how to implement the new paradigm of supports. Finally, the process of developing a measurement tool is always an unfinished task. In that regard, we would like to contribute to enhancing the use of this tool in Spain. Two suggestions apply here: First, we think that the good results regarding the reliability of the Supplemental Protection and Advocacy Scale (Section 2) found in this study suggest the need to rethink the place of this scale in the SIS. We consider that the information given in Section 2 is essential for promoting full and lifelong inclusion. Thus, this section should be returned to the Support Needs Scale (Section 1) and considered in the computation of the SIS Support Needs Index. Second, according to our experience in this study and findings in studies about interviewing people with intellectual disabilities (e.g., Finlay & Lyons, 2001), there are a number of difficulties that arise when questions concern quantitative judgments, abstract concepts, inferences, and generalizations (Claes et al., 2009). Therefore, if SIS involves the consumer as a vital source of information, we suggest that the contents and form should be adapted to the different levels of understanding of people with intellectual disability. Finally, we recognize that this study has some limitations. The first is the sampling method. We used a nonprobabilistic sample, based on the volunteer centers, instead of a random sample of centers. Although the sample was very large (875 valid participants), it does not guarantee the generalization of the data. A second limitation is that interviewers only interviewed one respondent when completing the SIS instead of the suggestion made in the SIS Users Manual that at least two respondents be interviewed to obtain accurate and complete information (Thompson et al., 2004, p. 23). Consequently, the multiple respondents could change our reliability findings. This should be addressed in future research. E American Association on Intellectual and Developmental Disabilities 501

7 References Bangdiwala, K. (1987). Using SAS software graphical procedures for the observer agreement chart. Proceedings of the SAS Users Group International Conference, 12, Beaton, D., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self report measures. Spine, 25, Buntinx, W. H. E. (2008). The Dutch version of the Supports Intensity Scale. In R. L. Schalock, J. R. Thompson, & M. J. Tassé (Eds.), Psychometric properties of the Supports Intensity Scale (pp. 6 10). Washington, DC: American Association on Intellectual and Developmental Disabilities. Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6, Cicchetti, D. V., & Sparrow, S. A. (1981). Developing criteria for establishing interrater reliability of specific items: Applications to assessment of adaptive behavior. American Journal of Mental Deficiency, 86, Claes, C., van Hoove, G., van Loon, J., Vandervelde, S., & Schalock, R. L. (2009). Evaluating the inter-respondent (consumer vs. staff ) reliability and construct validity (SIS vs. Vineland) of the Supports Intensity Scale on a Dutch sample. Journal of Intellectual Disability Research, 53, Finlay, W. M. L., & Lyons, E. (2001). Methodological issues in interviewing and using selfreport questionnaires with people with mental retardation. Psychological Assessment, 13, Friendly, M. (2001). Visualizing categorical data. Cary, NC: SAS Institute. Hambleton, R. K. (1996). Adaptación de tests para su uso en diferentes idiomas y culturas: Fuentes de error, posibles soluciones and directrices practicas. En J. Muñiz (Coord.), Psicometrıá (pp ). [Adapting tests for use in multiple languages and cultures: Error sources, possible solutions and practical guidelines.] Madrid: Universitas. Lamoureux-Hebert, M., & Morin, D. (2009). Translation and cultural adaptation of the Supports Intensity Scale in French. American Journal on Intellectual and Developmental Disabilities, 114, Luckasson, R., Borthwick-Duffy, S., Buntinx, W., Coulter, D., Craig, E., Reeve, A., et al. (2002). Mental Retardation: Definition, classification, and systems of supports. Washington, DC: American Association on Mental Retardation. Luckasson, R., Coulter, D. L., Polloway, E. A., Reiss, S., Schalock, R. L., Snell, M. E., et al. (1992). Mental retardation: Definition, classification, and systems of supports. Washington, DC: American Association on Mental Retardation. Montero, D. (1996). Evaluacio n de la conducta adaptativa en personas con discapacidades. Adaptacio n and validacio n del ICAP. [Assessment of the adaptive behavior in people with disabilities. Adaptation and validation of the ICAP.] Bilbao, Spain: Mensajero. Montero, D. (1999). El sistema valoración-enseñanza-evaluación de destrezas adaptativas: ICAP, CALS y ALSC. [The Adaptive Skills Integrated Assessment-Instruction-Evaluation System: ICAP, CALS and ALSC.] En M. A. Verdugo & F. B. Jordán de Urríes (Eds.), Hacia una nueva concepcio n de la discapacidad [Toward a new conception of disability] (pp ). Salamanca, Spain: Amarú. Schalock, R. L., Keith, K. D., Verdugo, M. A., & Gómez, L. E. (2009). Quality of life model development and use in the field of intellectual disabilities. In R. Kober (Ed.), Enhancing the quality of life of people with intellectual disabilities: From theory to practice. London: Springer. Schalock, R. L., Thompson, J. R., & Tassé,M.J. (Eds.). (2008a). Psychometric properties of the Supports Intensity Scale TM. AAIDD SIS White Paper Series. Retrieved from: galleries/default-file/siswppsychometric.pdf Schalock, R. L., Thompson, J. R., & Tassé,M.J. (Eds.). (2008b). International implementation of the Supports Intensity Scale. AAIDD SIS White Paper Series. Retrieved from: org/galleries/default-file/siswpinternational. pdf Schalock, R. L., & Verdugo, M. A. (2002). Quality of life for human service practitioners. Washington, DC: American Association on Mental Retardation. Tanzer, N. K., & Sim, C. Q. E. (1999). Adapting instruments for use in multiple languages and cultures: A review of the ITC guidelines for test adaptations. European Journal of Psychological Assessment, 15, Thompson, J. R., Bryant, B., Campbell, E. M., Craig, E. M., Hughes, C., Rotholz, D. A., et 502 E American Association on Intellectual and Developmental Disabilities

8 al. (2004). Supports Intensity Scale. Users manual. Washington, DC: American Association on Mental Retardation. Thompson, J. R., Tassé, M. J., & McLaughlin, C. A. (2008). Interrater reliability of the Supports Intensity Scale (SIS). American Journal of Mental Retardation, 113, Verdugo, M. A. (1994). El cambio de paradigma en la concepción del retraso mental: La nueva definición de la AAMR. [The change of paradigm in the conception of mental retardation: The new definition of the AAMR.] Siglo Cero, 25(5), Verdugo, M. A. (2003). Análisis de la definición de discapacidad intelectual de la Asociación Americana sobre Retraso Mental de [Analysis of the 2002 intellectual disability definition of the American Association on Mental Retardation.]. Siglo Cero, 34, Verdugo, M. A., Arias, B., & Ibáñez, A. (2007). SIS. Escala de Intensidad de Apoyos. Manual. Adaptacio n espan ola. [SIS. Supports Intensity Scale. Manual. Spanish Adaptation.] Madrid: TEA. Verdugo, M. A., Arias, B., Ibáñez, A., & Gómez, L. (2006). Validation of the Spanish version of the Supports Intensity Scale. Journal of Applied Research in Intellectual Disabilities, 19, 274. Verdugo, M. A., Ibáñez, A., & Arias, B. (2007). La Escala de Intensidad de Apoyos (SIS): Adaptación inicial al contexto español y análisis de sus propiedades psicométricas. [Supports Intensity Scale (SIS): The first adaptation to the Spanish context and the analysis of their psychometric properties.] Siglo Cero, 38(2), Wehmeyer, M., Chapman, T. E., Little, T. D., Thompson, J. R., Schalock, R. L., & Tassé, M. J. (2009). Efficacy of the Supports Intensity Scale (SIS) to predict extraordinary support needs. American Journal on Intellectual and Developmental Disabilities, 114, Received 5/24/09, accepted 4/12/10. Editor-in-charge: Marc J. Tassé We thank the FEAPS professionals who helped in the application of this assessment tool. Correspondence concerning this article should be sent to Miguel Verdugo, University of Salamanca, Institute on Community Integration, PETRA, Salamanca, 37184, Spain. verdugo@usal.es E American Association on Intellectual and Developmental Disabilities 503

SIS. Supports Intensity Scale. International Psychometric properties

SIS. Supports Intensity Scale. International Psychometric properties SIS Supports Intensity Scale International Psychometric properties Similarities and differences between original US version and Dutch, Italian, French and Spanish translations Wil Buntinx, PhD / FAAIDD

More information

Evaluating the Reliability and Validity of the. Questionnaire for Situational Information: Item Analyses. Final Report

Evaluating the Reliability and Validity of the. Questionnaire for Situational Information: Item Analyses. Final Report Evaluating the Reliability and Validity of the Questionnaire for Situational Information: Item Analyses Final Report Submitted By: Susan M. Havercamp, PhD Florida Center for Inclusive Communities, UCEDD

More information

Factor structure of the Schalock and Keith Quality of Life Questionnaire (QOL-Q): validation on Mexican and Spanish samples

Factor structure of the Schalock and Keith Quality of Life Questionnaire (QOL-Q): validation on Mexican and Spanish samples 773 Journal of Intellectual Disability Research volume 49 part 10 pp 773 776 october 2005 Blackwell Science, LtdOxford, UKJIRJournal of Intellectual Disability Research0964-2633Blackwell Publishing Ltd,

More information

International Adaptation and Use of the Supports Intensity Scales

International Adaptation and Use of the Supports Intensity Scales International Adaptation and Use of the Supports Intensity Scales James R. Thompson, PhD. Reykjavik, Iceland June 30, 2016 Support Intensity Scales Original Supports Intensity Scale published in 2004 Supports

More information

3d IASSID Europe conference, Rome October 20-23, 2010 session

3d IASSID Europe conference, Rome October 20-23, 2010 session 3d IASSID Europe conference, Rome October 20-23, 2010 session 8.8 21.10 Psychometric properties of the Supports Intensity Scale (SIS): an international review W. Buntinx (w.buntinx@beoz.unimaas.nl), B.

More information

Cross-cultural study of person-centred quality of life domains and indicators: a replication

Cross-cultural study of person-centred quality of life domains and indicators: a replication 734 Journal of Intellectual Disability Research volume 49 part 10 pp 734 739 october 2005 Blackwell Science, LtdOxford, UKJIRJournal of Intellectual Disability Research0964-2633Blackwell Publishing Ltd,

More information

alternate-form reliability The degree to which two or more versions of the same test correlate with one another. In clinical studies in which a given function is going to be tested more than once over

More information

Running head: CPPS REVIEW 1

Running head: CPPS REVIEW 1 Running head: CPPS REVIEW 1 Please use the following citation when referencing this work: McGill, R. J. (2013). Test review: Children s Psychological Processing Scale (CPPS). Journal of Psychoeducational

More information

Error in the estimation of intellectual ability in the low range using the WISC-IV and WAIS- III By. Simon Whitaker

Error in the estimation of intellectual ability in the low range using the WISC-IV and WAIS- III By. Simon Whitaker Error in the estimation of intellectual ability in the low range using the WISC-IV and WAIS- III By Simon Whitaker In press Personality and Individual Differences Abstract The error, both chance and systematic,

More information

Chapter 3. Psychometric Properties

Chapter 3. Psychometric Properties Chapter 3 Psychometric Properties Reliability The reliability of an assessment tool like the DECA-C is defined as, the consistency of scores obtained by the same person when reexamined with the same test

More information

CHAPTER VI RESEARCH METHODOLOGY

CHAPTER VI RESEARCH METHODOLOGY CHAPTER VI RESEARCH METHODOLOGY 6.1 Research Design Research is an organized, systematic, data based, critical, objective, scientific inquiry or investigation into a specific problem, undertaken with the

More information

Reliability Study of ACTFL OPIc in Spanish, English, and Arabic for the ACE Review

Reliability Study of ACTFL OPIc in Spanish, English, and Arabic for the ACE Review Reliability Study of ACTFL OPIc in Spanish, English, and Arabic for the ACE Review Prepared for: American Council on the Teaching of Foreign Languages (ACTFL) White Plains, NY Prepared by SWA Consulting

More information

A review of statistical methods in the analysis of data arising from observer reliability studies (Part 11) *

A review of statistical methods in the analysis of data arising from observer reliability studies (Part 11) * A review of statistical methods in the analysis of data arising from observer reliability studies (Part 11) * by J. RICHARD LANDIS** and GARY G. KOCH** 4 Methods proposed for nominal and ordinal data Many

More information

Reliability. Internal Reliability

Reliability. Internal Reliability 32 Reliability T he reliability of assessments like the DECA-I/T is defined as, the consistency of scores obtained by the same person when reexamined with the same test on different occasions, or with

More information

DESIGN TYPE AND LEVEL OF EVIDENCE: Randomized controlled trial, Level I

DESIGN TYPE AND LEVEL OF EVIDENCE: Randomized controlled trial, Level I CRITICALLY APPRAISED PAPER (CAP) Hasan, A. A., Callaghan, P., & Lymn, J. S. (2015). Evaluation of the impact of a psychoeducational intervention for people diagnosed with schizophrenia and their primary

More information

11-3. Learning Objectives

11-3. Learning Objectives 11-1 Measurement Learning Objectives 11-3 Understand... The distinction between measuring objects, properties, and indicants of properties. The similarities and differences between the four scale types

More information

ADMS Sampling Technique and Survey Studies

ADMS Sampling Technique and Survey Studies Principles of Measurement Measurement As a way of understanding, evaluating, and differentiating characteristics Provides a mechanism to achieve precision in this understanding, the extent or quality As

More information

Georgina Salas. Topics EDCI Intro to Research Dr. A.J. Herrera

Georgina Salas. Topics EDCI Intro to Research Dr. A.J. Herrera Homework assignment topics 51-63 Georgina Salas Topics 51-63 EDCI Intro to Research 6300.62 Dr. A.J. Herrera Topic 51 1. Which average is usually reported when the standard deviation is reported? The mean

More information

Psychometric Qualities

Psychometric Qualities 137 th AAIDD Annual Meeting Pittsburgh, PA, June 3-6, 2013 Concurrent Session: Finally...an Adaptive Behavior Scale Focused on Providing Precision at the Diagnostic Cut-Off Psychometric Qualities of the

More information

Book review. Conners Adult ADHD Rating Scales (CAARS). By C.K. Conners, D. Erhardt, M.A. Sparrow. New York: Multihealth Systems, Inc.

Book review. Conners Adult ADHD Rating Scales (CAARS). By C.K. Conners, D. Erhardt, M.A. Sparrow. New York: Multihealth Systems, Inc. Archives of Clinical Neuropsychology 18 (2003) 431 437 Book review Conners Adult ADHD Rating Scales (CAARS). By C.K. Conners, D. Erhardt, M.A. Sparrow. New York: Multihealth Systems, Inc., 1999 1. Test

More information

Identification of the support needs of individuals with severe mental illness using the Supports Intensity Scale 1

Identification of the support needs of individuals with severe mental illness using the Supports Intensity Scale 1 Rev. Latino-Am. Enfermagem 2013 Sept.-Oct.;21(5):1137-43 Original Article Identification of the support needs of individuals with severe mental illness using the Supports Intensity Scale 1 Maribel Cruz

More information

Brief Report: Interrater Reliability of Clinical Diagnosis and DSM-IV Criteria for Autistic Disorder: Results of the DSM-IV Autism Field Trial

Brief Report: Interrater Reliability of Clinical Diagnosis and DSM-IV Criteria for Autistic Disorder: Results of the DSM-IV Autism Field Trial Journal of Autism and Developmental Disorders, Vol. 30, No. 2, 2000 Brief Report: Interrater Reliability of Clinical Diagnosis and DSM-IV Criteria for Autistic Disorder: Results of the DSM-IV Autism Field

More information

Importance of Good Measurement

Importance of Good Measurement Importance of Good Measurement Technical Adequacy of Assessments: Validity and Reliability Dr. K. A. Korb University of Jos The conclusions in a study are only as good as the data that is collected. The

More information

English 10 Writing Assessment Results and Analysis

English 10 Writing Assessment Results and Analysis Academic Assessment English 10 Writing Assessment Results and Analysis OVERVIEW This study is part of a multi-year effort undertaken by the Department of English to develop sustainable outcomes assessment

More information

The Scoliosis Research Society-22 questionnaire adapted for adolescent idiopathic scoliosis patients in China: reliability and validity analysis

The Scoliosis Research Society-22 questionnaire adapted for adolescent idiopathic scoliosis patients in China: reliability and validity analysis J Child Orthop (2007) 1:351 355 DOI 10.1007/s11832-007-0061-1 ORIGINAL CLINICAL ARTICLE The Scoliosis Research Society-22 questionnaire adapted for adolescent idiopathic scoliosis patients in China: reliability

More information

Testing the Multiple Intelligences Theory in Oman

Testing the Multiple Intelligences Theory in Oman Available online at www.sciencedirect.com ScienceDirect Procedia - Social and Behavioral Sciences 190 ( 2015 ) 106 112 2nd GLOBAL CONFERENCE on PSYCHOLOGY RESEARCHES, 28-29, November 2014 Testing the Multiple

More information

CHAPTER-III METHODOLOGY

CHAPTER-III METHODOLOGY CHAPTER-III METHODOLOGY 3.1 INTRODUCTION This chapter deals with the methodology employed in order to achieve the set objectives of the study. Details regarding sample, description of the tools employed,

More information

TRANSLATION AND VALIDATION OF THE GENOS EMOTIONAL INTELLIGENCE INVENTORY (CONCISE VERSION) FOR USE IN SRI LANKA

TRANSLATION AND VALIDATION OF THE GENOS EMOTIONAL INTELLIGENCE INVENTORY (CONCISE VERSION) FOR USE IN SRI LANKA http://doi.org/0.4038/sljm.v26i.27 RESEARCH PAPER - MEDICAL EDUCATION TRANSLATION AND VALIDATION OF THE GENOS EMOTIONAL INTELLIGENCE INVENTORY (CONCISE VERSION) FOR USE IN SRI LANKA 2 3 D. Edussuriya,

More information

Each copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission.

Each copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission. Reliability of an Arabic Version of the RAND-36 Health Survey and Its Equivalence to the US- English Version Author(s): Stephen Joel Coons, Saud Abdulaziz Alabdulmohsin, JoLaine R. Draugalis, Ron D. Hays

More information

Early Childhood Measurement and Evaluation Tool Review

Early Childhood Measurement and Evaluation Tool Review Early Childhood Measurement and Evaluation Tool Review Early Childhood Measurement and Evaluation (ECME), a portfolio within CUP, produces Early Childhood Measurement Tool Reviews as a resource for those

More information

Review of Various Instruments Used with an Adolescent Population. Michael J. Lambert

Review of Various Instruments Used with an Adolescent Population. Michael J. Lambert Review of Various Instruments Used with an Adolescent Population Michael J. Lambert Population. This analysis will focus on a population of adolescent youth between the ages of 11 and 20 years old. This

More information

Developmental Assessment of Young Children Second Edition (DAYC-2) Summary Report

Developmental Assessment of Young Children Second Edition (DAYC-2) Summary Report Developmental Assessment of Young Children Second Edition (DAYC-2) Summary Report Section 1. Identifying Information Name: Marcos Sanders Gender: M Date of Testing: 05-10-2011 Date of Birth: 09-15-2009

More information

VARIABLES AND MEASUREMENT

VARIABLES AND MEASUREMENT ARTHUR SYC 204 (EXERIMENTAL SYCHOLOGY) 16A LECTURE NOTES [01/29/16] VARIABLES AND MEASUREMENT AGE 1 Topic #3 VARIABLES AND MEASUREMENT VARIABLES Some definitions of variables include the following: 1.

More information

DATA GATHERING. Define : Is a process of collecting data from sample, so as for testing & analyzing before reporting research findings.

DATA GATHERING. Define : Is a process of collecting data from sample, so as for testing & analyzing before reporting research findings. DATA GATHERING Define : Is a process of collecting data from sample, so as for testing & analyzing before reporting research findings. 2012 John Wiley & Sons Ltd. Measurement Measurement: the assignment

More information

26:010:557 / 26:620:557 Social Science Research Methods

26:010:557 / 26:620:557 Social Science Research Methods 26:010:557 / 26:620:557 Social Science Research Methods Dr. Peter R. Gillett Associate Professor Department of Accounting & Information Systems Rutgers Business School Newark & New Brunswick 1 Overview

More information

Empowered by Psychometrics The Fundamentals of Psychometrics. Jim Wollack University of Wisconsin Madison

Empowered by Psychometrics The Fundamentals of Psychometrics. Jim Wollack University of Wisconsin Madison Empowered by Psychometrics The Fundamentals of Psychometrics Jim Wollack University of Wisconsin Madison Psycho-what? Psychometrics is the field of study concerned with the measurement of mental and psychological

More information

Establishing Interrater Agreement for Scoring Criterion-based Assessments: Application for the MEES

Establishing Interrater Agreement for Scoring Criterion-based Assessments: Application for the MEES Establishing Interrater Agreement for Scoring Criterion-based Assessments: Application for the MEES Mark C. Hogrebe Washington University in St. Louis MACTE Fall 2018 Conference October 23, 2018 Camden

More information

Quality of Life Assessment of Growth Hormone Deficiency in Adults (QoL-AGHDA)

Quality of Life Assessment of Growth Hormone Deficiency in Adults (QoL-AGHDA) Quality of Life Assessment of Growth Hormone Deficiency in Adults (QoL-AGHDA) Guidelines for Users May 2016 B1 Chorlton Mill, 3 Cambridge Street, Manchester, M1 5BY, UK Tel: +44 (0)161 226 4446 Fax: +44

More information

PTHP 7101 Research 1 Chapter Assignments

PTHP 7101 Research 1 Chapter Assignments PTHP 7101 Research 1 Chapter Assignments INSTRUCTIONS: Go over the questions/pointers pertaining to the chapters and turn in a hard copy of your answers at the beginning of class (on the day that it is

More information

Creation and Use of the Pervasive Developmental Disorder Behavior Inventory (PDDBI) Parent Form

Creation and Use of the Pervasive Developmental Disorder Behavior Inventory (PDDBI) Parent Form Spanish Translation Creation and Use of the Pervasive Developmental Disorder Behavior Inventory (PDDBI) Parent Form Spanish Translation Amy Kovacs Giella, BA Executive Summary Approximately 13% of the

More information

HOW IS PACE TO BE USED

HOW IS PACE TO BE USED Introduction and overview of the pace monitor what is THE PACE MONITOR The PACE Monitor is a comprehensive program for the screening, in-depth assessment and the evaluation of the progress and change of

More information

Before we get started:

Before we get started: Before we get started: http://arievaluation.org/projects-3/ AEA 2018 R-Commander 1 Antonio Olmos Kai Schramm Priyalathta Govindasamy Antonio.Olmos@du.edu AntonioOlmos@aumhc.org AEA 2018 R-Commander 2 Plan

More information

DATA is derived either through. Self-Report Observation Measurement

DATA is derived either through. Self-Report Observation Measurement Data Management DATA is derived either through Self-Report Observation Measurement QUESTION ANSWER DATA DATA may be from Structured or Unstructured questions? Quantitative or Qualitative? Numerical or

More information

Extraversion. The Extraversion factor reliability is 0.90 and the trait scale reliabilities range from 0.70 to 0.81.

Extraversion. The Extraversion factor reliability is 0.90 and the trait scale reliabilities range from 0.70 to 0.81. MSP RESEARCH NOTE B5PQ Reliability and Validity This research note describes the reliability and validity of the B5PQ. Evidence for the reliability and validity of is presented against some of the key

More information

On the purpose of testing:

On the purpose of testing: Why Evaluation & Assessment is Important Feedback to students Feedback to teachers Information to parents Information for selection and certification Information for accountability Incentives to increase

More information

Cover Page. The handle holds various files of this Leiden University dissertation.

Cover Page. The handle   holds various files of this Leiden University dissertation. Cover Page The handle http://hdl.handle.net/1887/19149 holds various files of this Leiden University dissertation. Author: Maljaars, Janne Pieternella Wilhelmina Title: Communication problems in children

More information

1. Evaluate the methodological quality of a study with the COSMIN checklist

1. Evaluate the methodological quality of a study with the COSMIN checklist Answers 1. Evaluate the methodological quality of a study with the COSMIN checklist We follow the four steps as presented in Table 9.2. Step 1: The following measurement properties are evaluated in the

More information

10/18/2016. Vineland Adaptive Behavior Scales, Third Edition 1. Meet Dr. Saulnier. Bio. Celine A. Saulnier, PhD Vineland-3 Author

10/18/2016. Vineland Adaptive Behavior Scales, Third Edition 1. Meet Dr. Saulnier. Bio. Celine A. Saulnier, PhD Vineland-3 Author Vineland Adaptive Behavior Scales, Third Edition Celine A. Saulnier, PhD Vineland-3 Author Director of Research Operations at the Marcus Autism Center & Associate Professor in the Department of Pediatrics

More information

Cognitive-Behavioral Assessment of Depression: Clinical Validation of the Automatic Thoughts Questionnaire

Cognitive-Behavioral Assessment of Depression: Clinical Validation of the Automatic Thoughts Questionnaire Journal of Consulting and Clinical Psychology 1983, Vol. 51, No. 5, 721-725 Copyright 1983 by the American Psychological Association, Inc. Cognitive-Behavioral Assessment of Depression: Clinical Validation

More information

Collecting & Making Sense of

Collecting & Making Sense of Collecting & Making Sense of Quantitative Data Deborah Eldredge, PhD, RN Director, Quality, Research & Magnet Recognition i Oregon Health & Science University Margo A. Halm, RN, PhD, ACNS-BC, FAHA Director,

More information

Understanding CELF-5 Reliability & Validity to Improve Diagnostic Decisions

Understanding CELF-5 Reliability & Validity to Improve Diagnostic Decisions Understanding CELF-5 Reliability & Validity to Improve Diagnostic Decisions Senior Educational Consultant Pearson Disclosures Dr. Scheller is an employee of Pearson, publisher of the CELF-5. No other language

More information

Psychometric qualities of the Dutch Risk Assessment Scales (RISc)

Psychometric qualities of the Dutch Risk Assessment Scales (RISc) Summary Psychometric qualities of the Dutch Risk Assessment Scales (RISc) Inter-rater reliability, internal consistency and concurrent validity 1 Cause, objective and research questions The Recidive InschattingsSchalen

More information

Statistical analysis DIANA SAPLACAN 2017 * SLIDES ADAPTED BASED ON LECTURE NOTES BY ALMA LEORA CULEN

Statistical analysis DIANA SAPLACAN 2017 * SLIDES ADAPTED BASED ON LECTURE NOTES BY ALMA LEORA CULEN Statistical analysis DIANA SAPLACAN 2017 * SLIDES ADAPTED BASED ON LECTURE NOTES BY ALMA LEORA CULEN Vs. 2 Background 3 There are different types of research methods to study behaviour: Descriptive: observations,

More information

POST GRADUATE DIPLOMA IN BIOETHICS (PGDBE) Term-End Examination June, 2016 MHS-014 : RESEARCH METHODOLOGY

POST GRADUATE DIPLOMA IN BIOETHICS (PGDBE) Term-End Examination June, 2016 MHS-014 : RESEARCH METHODOLOGY No. of Printed Pages : 12 MHS-014 POST GRADUATE DIPLOMA IN BIOETHICS (PGDBE) Term-End Examination June, 2016 MHS-014 : RESEARCH METHODOLOGY Time : 2 hours Maximum Marks : 70 PART A Attempt all questions.

More information

02a: Test-Retest and Parallel Forms Reliability

02a: Test-Retest and Parallel Forms Reliability 1 02a: Test-Retest and Parallel Forms Reliability Quantitative Variables 1. Classic Test Theory (CTT) 2. Correlation for Test-retest (or Parallel Forms): Stability and Equivalence for Quantitative Measures

More information

Assessing the Validity and Reliability of the Teacher Keys Effectiveness. System (TKES) and the Leader Keys Effectiveness System (LKES)

Assessing the Validity and Reliability of the Teacher Keys Effectiveness. System (TKES) and the Leader Keys Effectiveness System (LKES) Assessing the Validity and Reliability of the Teacher Keys Effectiveness System (TKES) and the Leader Keys Effectiveness System (LKES) of the Georgia Department of Education Submitted by The Georgia Center

More information

All Graduate Theses and Dissertations

All Graduate Theses and Dissertations Utah State University DigitalCommons@USU All Graduate Theses and Dissertations Graduate Studies 1-1-1994 The Predictive Validity of the Battelle Developmental Inventory as a Measure of Adaptive Behavior:

More information

DISCPP (DISC Personality Profile) Psychometric Report

DISCPP (DISC Personality Profile) Psychometric Report Psychometric Report Table of Contents Test Description... 5 Reference... 5 Vitals... 5 Question Type... 5 Test Development Procedures... 5 Test History... 8 Operational Definitions... 9 Test Research and

More information

PÄIVI KARHU THE THEORY OF MEASUREMENT

PÄIVI KARHU THE THEORY OF MEASUREMENT PÄIVI KARHU THE THEORY OF MEASUREMENT AGENDA 1. Quality of Measurement a) Validity Definition and Types of validity Assessment of validity Threats of Validity b) Reliability True Score Theory Definition

More information

Examining Factors Affecting Language Performance: A Comparison of Three Measurement Approaches

Examining Factors Affecting Language Performance: A Comparison of Three Measurement Approaches Pertanika J. Soc. Sci. & Hum. 21 (3): 1149-1162 (2013) SOCIAL SCIENCES & HUMANITIES Journal homepage: http://www.pertanika.upm.edu.my/ Examining Factors Affecting Language Performance: A Comparison of

More information

Table 3.1: Canadian Stroke Best Practice Recommendations Screening and Assessment Tools for Acute Stroke Severity

Table 3.1: Canadian Stroke Best Practice Recommendations Screening and Assessment Tools for Acute Stroke Severity Table 3.1: Assessment Tool Number and description of Items Neurological Status/Stroke Severity Canadian Neurological Scale (CNS)(1) Items assess mentation (level of consciousness, orientation and speech)

More information

Canadian Stroke Best Practices Table 3.3A Screening and Assessment Tools for Acute Stroke

Canadian Stroke Best Practices Table 3.3A Screening and Assessment Tools for Acute Stroke Canadian Stroke Best Practices Table 3.3A Screening and s for Acute Stroke Neurological Status/Stroke Severity assess mentation (level of consciousness, orientation and speech) and motor function (face,

More information

What Works Clearinghouse

What Works Clearinghouse What Works Clearinghouse U.S. DEPARTMENT OF EDUCATION July 2012 WWC Review of the Report Randomized, Controlled Trial of the LEAP Model of Early Intervention for Young Children With Autism Spectrum Disorders

More information

Objective and Subjective Quality of Life in Adults with. Autism Spectrum Disorders in Southern Spain. David Saldaña. University of Seville

Objective and Subjective Quality of Life in Adults with. Autism Spectrum Disorders in Southern Spain. David Saldaña. University of Seville In Autism, 13(3), 303-316. Objective and Subjective Quality of Life in Adults with Autism Spectrum Disorders in Southern Spain David Saldaña University of Seville Rosa M. Álvarez Silvia Lobatón Autismo

More information

Marc J. Tassé, PhD Nisonger Center UCEDD

Marc J. Tassé, PhD Nisonger Center UCEDD FINALLY... AN ADAPTIVE BEHAVIOR SCALE FOCUSED ON PROVIDING PRECISION AT THE DIAGNOSTIC CUT-OFF. How Item Response Theory Contributed to the Development of the DABS Marc J. Tassé, PhD UCEDD The Ohio State

More information

Associate Prof. Dr Anne Yee. Dr Mahmoud Danaee

Associate Prof. Dr Anne Yee. Dr Mahmoud Danaee Associate Prof. Dr Anne Yee Dr Mahmoud Danaee 1 2 What does this resemble? Rorschach test At the end of the test, the tester says you need therapy or you can't work for this company 3 Psychological Testing

More information

On the usefulness of the CEFR in the investigation of test versions content equivalence HULEŠOVÁ, MARTINA

On the usefulness of the CEFR in the investigation of test versions content equivalence HULEŠOVÁ, MARTINA On the usefulness of the CEFR in the investigation of test versions content equivalence HULEŠOVÁ, MARTINA MASARY K UNIVERSITY, CZECH REPUBLIC Overview Background and research aims Focus on RQ2 Introduction

More information

Summary & Conclusion. Lecture 10 Survey Research & Design in Psychology James Neill, 2016 Creative Commons Attribution 4.0

Summary & Conclusion. Lecture 10 Survey Research & Design in Psychology James Neill, 2016 Creative Commons Attribution 4.0 Summary & Conclusion Lecture 10 Survey Research & Design in Psychology James Neill, 2016 Creative Commons Attribution 4.0 Overview 1. Survey research and design 1. Survey research 2. Survey design 2. Univariate

More information

PSYCHOMETRIC PROPERTIES OF CLINICAL PERFORMANCE RATINGS

PSYCHOMETRIC PROPERTIES OF CLINICAL PERFORMANCE RATINGS PSYCHOMETRIC PROPERTIES OF CLINICAL PERFORMANCE RATINGS A total of 7931 ratings of 482 third- and fourth-year medical students were gathered over twelve four-week periods. Ratings were made by multiple

More information

Validity and Reliability. PDF Created with deskpdf PDF Writer - Trial ::

Validity and Reliability. PDF Created with deskpdf PDF Writer - Trial :: Validity and Reliability PDF Created with deskpdf PDF Writer - Trial :: http://www.docudesk.com Validity Is the translation from concept to operationalization accurately representing the underlying concept.

More information

UNIVERSITY OF THE FREE STATE DEPARTMENT OF COMPUTER SCIENCE AND INFORMATICS CSIS6813 MODULE TEST 2

UNIVERSITY OF THE FREE STATE DEPARTMENT OF COMPUTER SCIENCE AND INFORMATICS CSIS6813 MODULE TEST 2 UNIVERSITY OF THE FREE STATE DEPARTMENT OF COMPUTER SCIENCE AND INFORMATICS CSIS6813 MODULE TEST 2 DATE: 3 May 2017 MARKS: 75 ASSESSOR: Prof PJ Blignaut MODERATOR: Prof C de Villiers (UP) TIME: 2 hours

More information

Measurement and Descriptive Statistics. Katie Rommel-Esham Education 604

Measurement and Descriptive Statistics. Katie Rommel-Esham Education 604 Measurement and Descriptive Statistics Katie Rommel-Esham Education 604 Frequency Distributions Frequency table # grad courses taken f 3 or fewer 5 4-6 3 7-9 2 10 or more 4 Pictorial Representations Frequency

More information

Methodology METHODOLOGY

Methodology METHODOLOGY METHODOLOGY This study was conducted at the department of Orthodontics, College of Dental Surgery, B.P. Koirala Institute of Health Sciences, Dharan, Nepal from January 2011 to November 2012. However the

More information

Procedia - Social and Behavioral Sciences 233 ( 2016 )

Procedia - Social and Behavioral Sciences 233 ( 2016 ) Available online at www.sciencedirect.com ScienceDirect Procedia - Social and Behavioral Sciences 233 ( 2016 ) 220 224 Annual International Scientific Conference Early Childhood Care and Education, ECCE

More information

Critical Evaluation of the Beach Center Family Quality of Life Scale (FQOL-Scale)

Critical Evaluation of the Beach Center Family Quality of Life Scale (FQOL-Scale) Critical Evaluation of the Beach Center Family Quality of Life Scale (FQOL-Scale) Alyssa Van Beurden M.Cl.Sc (SLP) Candidate University of Western Ontario: School of Communication Sciences and Disorders

More information

Chapter V Depression and Women with Spinal Cord Injury

Chapter V Depression and Women with Spinal Cord Injury 1 Chapter V Depression and Women with Spinal Cord Injury L ike all women with disabilities, women with spinal cord injury (SCI) may be at an elevated risk for depression due to the double jeopardy of being

More information

Validation of the Russian version of the Quality of Life-Rheumatoid Arthritis Scale (QOL-RA Scale)

Validation of the Russian version of the Quality of Life-Rheumatoid Arthritis Scale (QOL-RA Scale) Advances in Medical Sciences Vol. 54(1) 2009 pp 27-31 DOI: 10.2478/v10039-009-0012-9 Medical University of Bialystok, Poland Validation of the Russian version of the Quality of Life-Rheumatoid Arthritis

More information

ACDI. An Inventory of Scientific Findings. (ACDI, ACDI-Corrections Version and ACDI-Corrections Version II) Provided by:

ACDI. An Inventory of Scientific Findings. (ACDI, ACDI-Corrections Version and ACDI-Corrections Version II) Provided by: + ACDI An Inventory of Scientific Findings (ACDI, ACDI-Corrections Version and ACDI-Corrections Version II) Provided by: Behavior Data Systems, Ltd. P.O. Box 44256 Phoenix, Arizona 85064-4256 Telephone:

More information

Statistics for Psychosocial Research Session 1: September 1 Bill

Statistics for Psychosocial Research Session 1: September 1 Bill Statistics for Psychosocial Research Session 1: September 1 Bill Introduction to Staff Purpose of the Course Administration Introduction to Test Theory Statistics for Psychosocial Research Overview: a)

More information

Examining the Psychometric Properties of The McQuaig Occupational Test

Examining the Psychometric Properties of The McQuaig Occupational Test Examining the Psychometric Properties of The McQuaig Occupational Test Prepared for: The McQuaig Institute of Executive Development Ltd., Toronto, Canada Prepared by: Henryk Krajewski, Ph.D., Senior Consultant,

More information

The use of Autism Mental Status Exam in an Italian sample. A brief report

The use of Autism Mental Status Exam in an Italian sample. A brief report Life Span and Disability XX, 1 (2017), 93-103 The use of Autism Mental Status Exam in an Italian sample. A brief report Marinella Zingale 1, Simonetta Panerai 2, Serafino Buono 3, Grazia Trubia 4, Maurizio

More information

Survey research (Lecture 1) Summary & Conclusion. Lecture 10 Survey Research & Design in Psychology James Neill, 2015 Creative Commons Attribution 4.

Survey research (Lecture 1) Summary & Conclusion. Lecture 10 Survey Research & Design in Psychology James Neill, 2015 Creative Commons Attribution 4. Summary & Conclusion Lecture 10 Survey Research & Design in Psychology James Neill, 2015 Creative Commons Attribution 4.0 Overview 1. Survey research 2. Survey design 3. Descriptives & graphing 4. Correlation

More information

Survey research (Lecture 1)

Survey research (Lecture 1) Summary & Conclusion Lecture 10 Survey Research & Design in Psychology James Neill, 2015 Creative Commons Attribution 4.0 Overview 1. Survey research 2. Survey design 3. Descriptives & graphing 4. Correlation

More information

Adult Substance Use and Driving Survey-Revised (ASUDS-R) Psychometric Properties and Construct Validity

Adult Substance Use and Driving Survey-Revised (ASUDS-R) Psychometric Properties and Construct Validity T2007 Seattle, Washington Adult Substance Use and Driving Survey-Revised (ASUDS-R) Psychometric Properties and Construct Validity Kenneth W. Wanberg¹ and David S. Timken² ¹Center for Addictions Research

More information

An International Study of the Reliability and Validity of Leadership/Impact (L/I)

An International Study of the Reliability and Validity of Leadership/Impact (L/I) An International Study of the Reliability and Validity of Leadership/Impact (L/I) Janet L. Szumal, Ph.D. Human Synergistics/Center for Applied Research, Inc. Contents Introduction...3 Overview of L/I...5

More information

Doctoral Dissertation Boot Camp Quantitative Methods Kamiar Kouzekanani, PhD January 27, The Scientific Method of Problem Solving

Doctoral Dissertation Boot Camp Quantitative Methods Kamiar Kouzekanani, PhD January 27, The Scientific Method of Problem Solving Doctoral Dissertation Boot Camp Quantitative Methods Kamiar Kouzekanani, PhD January 27, 2018 The Scientific Method of Problem Solving The conceptual phase Reviewing the literature, stating the problem,

More information

Craft Personality Questionnaire

Craft Personality Questionnaire Craft Personality Questionnaire Evidence of Reliability and Validity 888-298-6227 TalentLens.com Copyright 2008 Pearson Education, Inc., or its affiliates. All rights reserved. Copyright 2008 by Pearson

More information

Reliability and Validity checks S-005

Reliability and Validity checks S-005 Reliability and Validity checks S-005 Checking on reliability of the data we collect Compare over time (test-retest) Item analysis Internal consistency Inter-rater agreement Compare over time Test-Retest

More information

Saville Consulting Wave Professional Styles Handbook

Saville Consulting Wave Professional Styles Handbook Saville Consulting Wave Professional Styles Handbook PART 4: TECHNICAL Chapter 19: Reliability This manual has been generated electronically. Saville Consulting do not guarantee that it has not been changed

More information

CHAPTER III RESEARCH METHOD. method the major components include: Research Design, Research Site and

CHAPTER III RESEARCH METHOD. method the major components include: Research Design, Research Site and CHAPTER III RESEARCH METHOD This chapter presents the research method and design. In this research method the major components include: Research Design, Research Site and Access, Population and Sample,

More information

Quantitative Methods in Computing Education Research (A brief overview tips and techniques)

Quantitative Methods in Computing Education Research (A brief overview tips and techniques) Quantitative Methods in Computing Education Research (A brief overview tips and techniques) Dr Judy Sheard Senior Lecturer Co-Director, Computing Education Research Group Monash University judy.sheard@monash.edu

More information

Analysis and Interpretation of Data Part 1

Analysis and Interpretation of Data Part 1 Analysis and Interpretation of Data Part 1 DATA ANALYSIS: PRELIMINARY STEPS 1. Editing Field Edit Completeness Legibility Comprehensibility Consistency Uniformity Central Office Edit 2. Coding Specifying

More information

Perspective. Making Geriatric Assessment Work: Selecting Useful Measures. Key Words: Geriatric assessment, Physical functioning.

Perspective. Making Geriatric Assessment Work: Selecting Useful Measures. Key Words: Geriatric assessment, Physical functioning. Perspective Making Geriatric Assessment Work: Selecting Useful Measures Often the goal of physical therapy is to reduce morbidity and prevent or delay loss of independence. The purpose of this article

More information

1/30/2018. Adaptive Behavior Profiles in Autism Spectrum Disorders. Disclosures. Learning Objectives

1/30/2018. Adaptive Behavior Profiles in Autism Spectrum Disorders. Disclosures. Learning Objectives Adaptive Behavior Profiles in Autism Spectrum Disorders Celine A. Saulnier, PhD Associate Professor Emory University School of Medicine Vineland Adaptive Behavior Scales, Third Edition 1 Disclosures As

More information

How Do We Assess Students in the Interpreting Examinations?

How Do We Assess Students in the Interpreting Examinations? How Do We Assess Students in the Interpreting Examinations? Fred S. Wu 1 Newcastle University, United Kingdom The field of assessment in interpreter training is under-researched, though trainers and researchers

More information

Technical Specifications

Technical Specifications Technical Specifications In order to provide summary information across a set of exercises, all tests must employ some form of scoring models. The most familiar of these scoring models is the one typically

More information

ABAS-II Ratings and Correlates of Adaptive Behavior in Children with HFASDs

ABAS-II Ratings and Correlates of Adaptive Behavior in Children with HFASDs J Dev Phys Disabil (2012) 24:391 402 DOI 10.1007/s10882-012-9277-1 ORIGINAL ARTICLE ABAS-II Ratings and Correlates of Adaptive Behavior in Children with HFASDs Christopher Lopata & Jeffery D. Fox & Marcus

More information

Prepared by: Assoc. Prof. Dr Bahaman Abu Samah Department of Professional Development and Continuing Education Faculty of Educational Studies

Prepared by: Assoc. Prof. Dr Bahaman Abu Samah Department of Professional Development and Continuing Education Faculty of Educational Studies Prepared by: Assoc. Prof. Dr Bahaman Abu Samah Department of Professional Development and Continuing Education Faculty of Educational Studies Universiti Putra Malaysia Serdang At the end of this session,

More information

Reliability and Validity of the Pediatric Quality of Life Inventory Generic Core Scales, Multidimensional Fatigue Scale, and Cancer Module

Reliability and Validity of the Pediatric Quality of Life Inventory Generic Core Scales, Multidimensional Fatigue Scale, and Cancer Module 2090 The PedsQL in Pediatric Cancer Reliability and Validity of the Pediatric Quality of Life Inventory Generic Core Scales, Multidimensional Fatigue Scale, and Cancer Module James W. Varni, Ph.D. 1,2

More information