LEVEL ONE MODULE EXAM PART TWO [Reliability Coefficients CAPs & CATs Patient Reported Outcomes Assessments Disablement Model]

Similar documents
The Predictive Validity of the Test of Infant Motor Performance on School Age Motor Developmental Delay

Measures. David Black, Ph.D. Pediatric and Developmental. Introduction to the Principles and Practice of Clinical Research

10 Intraclass Correlations under the Mixed Factorial Design

A profiling system for the assessment of individual needs for rehabilitation with hearing aids

Competency Rubric Bank for the Sciences (CRBS)

Closed Coding. Analyzing Qualitative Data VIS17. Melanie Tory


Reliability and Validity checks S-005

COGNITIVE FUNCTION. PROMIS Pediatric Item Bank v1.0 Cognitive Function PROMIS Pediatric Short Form v1.0 Cognitive Function 7a

Maltreatment Reliability Statistics last updated 11/22/05

Comparing Vertical and Horizontal Scoring of Open-Ended Questionnaires

1/24/15. In pursuit of evidence- based prac8ce. Accessibility of Available Evidence. Today s Purpose BUT FIRST... Levels of Evidence (LOE)

Last week: Introduction, types of empirical studies. Also: scribe assignments, project details

Construct Reliability and Validity Update Report

ABOUT PHYSICAL ACTIVITY

Responsiveness of the VAS and McGill Pain Questionnaire in Measuring Changes in Musculoskeletal Pain

CHAPTER VI RESEARCH METHODOLOGY

Evidence Informed Practice Online Learning Module Glossary

Thank You: Developmental social neuroscience meets public health challenge: The next generations of children with autism spectrum disorder

Model 1: Subject As Single Factor

Ryan Mattek, PhD Letitia Johnson PhD. SRA-FV: Evidence of Inter-rater Reliability in a Combined SOMMI Sample

ADMS Sampling Technique and Survey Studies

Linking Assessments: Concept and History

INTRODUCTION TO ASSESSMENT OPTIONS

Research Questions and Survey Development

Critical Review: Late Talkers : What Can We Expect?

Patient Reported Outcomes Academic Perspective on Clinical Research

D.L. Hart Memorial Outcomes Research Grant Program Details

Psychometric Evaluation of Self-Report Questionnaires - the development of a checklist

Alcohol interventions in secondary and further education

Champlain Assessment/Outcome Measures Forum February 22, 2010

2 Critical thinking guidelines

4 Diagnostic Tests and Measures of Agreement

PTHP 7101 Research 1 Chapter Assignments

CHAPTER 3 METHOD AND PROCEDURE

Chapter 2 A Guide to PROMs Methodology and Selection Criteria

Chapter 14: More Powerful Statistical Methods

Writing Measurable Educational Objectives

Systematic reviews: From evidence to recommendation. Marcel Dijkers, PhD, FACRM Icahn School of Medicine at Mount Sinai

Foundations of Research Methods

The Effects of Automated Risk Assessment on Reliability, Validity and Return on Investment (ROI)

Corporate Medical Policy

Reliability of the Columbia Impairment Scale (C.I.S.) for adolescents: Survey among an Italian sample in Lazio Region

Observer OPTION 5 Manual

CRITICALLY APPRAISED PAPER (CAP)

DATA is derived either through. Self-Report Observation Measurement

Appendix A AUTIM SPECTRUM DISORDER FEASIBILITY STUDY

Methods for Determining Random Sample Size

English 10 Writing Assessment Results and Analysis

SAMPLE. Autism Spectrum Rating Scales (6-18 Years) Teacher Ratings. Interpretive Report. By Sam Goldstein, Ph.D. & Jack A. Naglieri, Ph.D.

Validity and reliability of measurements

Critical Review: Does the participation of a significant other in aural rehabilitation classes reduce perceived hearing handicap for older adults?

Journal of Sport Rehabilitation. The reliability of strength tests performed in elevated shoulder positions using a hand-held dynamometer

Data Patterns for COS Ratings: What to Expect and What to Question

Last Updated: February 17, 2016 Articles up-to-date as of: July 2015

Carol M. Mangione, MD NEI VFQ-25 Scoring Algorithm August 2000

Critical Review: What Presenting Speech and Language Characteristics of Late Talkers Distinguish Those Who Recover from Those Who Do Not?

It s a New World New PT and PTA Coursework Tools

02a: Test-Retest and Parallel Forms Reliability

Essential Skills for Evidence-based Practice Understanding and Using Systematic Reviews

DESIGN TYPE AND LEVEL OF EVIDENCE: Randomized controlled trial, Level I

Table of Contents. Clinical Outcome Assessments (COAs): A Conceptual Foundation

Social Norms about a Health Issue in Work Group Networks

11/10/11. Memorie M. Gosa, M.S. CCC-SLP, BRS-S Senior Speech-Language Pathologist/ PhD Candidate LeBonheur Children s Hospital/ University of Memphis

The Cochrane Collaboration

Social Validity Assessments of Behavior-Change Procedures used with Young Children: A Review

Week 17 and 21 Comparing two assays and Measurement of Uncertainty Explain tools used to compare the performance of two assays, including

CRITICALLY APPRAISED PAPER (CAP)

Framework for Comparative Research on Relational Information Displays

Agreement Coefficients and Statistical Inference

Chapter Two. Classification and treatment plans

Mullen Scales of Early Learning: AGS Edition

Non-examined assessment: Exemplar 2 examiner commentary

SAMPLE REPORT. Conners 3 Parent Short Form Assessment Report. By C. Keith Conners, Ph.D.

10/18/2016. Vineland Adaptive Behavior Scales, Third Edition 1. Meet Dr. Saulnier. Bio. Celine A. Saulnier, PhD Vineland-3 Author

Brief Report: Interrater Reliability of Clinical Diagnosis and DSM-IV Criteria for Autistic Disorder: Results of the DSM-IV Autism Field Trial

Expanding the Arts Deaf and Disability Arts, Access and Equality Strategy Executive Summary

Comparison of the Null Distributions of

Critical Review Form Clinical Decision Analysis

Patient Reported Outcomes: are they appropriate for clinical practice? Jose M Valderas Clinical Lecturer

The reliability and validity of the Index of Complexity, Outcome and Need for determining treatment need in Dutch orthodontic practice

Early Childhood Measurement and Evaluation Tool Review

FATIGUE. A brief guide to the PROMIS Fatigue instruments:

Critical Review: Is Group Therapy an Effective Intervention Method for Improving Fluency in School-Aged Children and Adolescents who Stutter?

National Priorities of Oriented Research, Experimental Development and Innovation in the Czech Republic. March 14th, 2013 PACITA conference, Prague

Chapter 1. Drug Use: An Overview. The Drug Problem Talking About Drug Use. Talking About Drug Use

2017 American Academy of Physical Medicine & Rehabilitation. All rights reserved.

Process of a neuropsychological assessment

Ability to link signs/symptoms of current patient to previous clinical encounters; allows filtering of info to produce broad. differential.

Efficacy of segmental versus global core stabilization exercises for patients with chronic low back pain (LBP)

Statistical Validation of the Grand Rapids Arch Collapse Classification

Question Sheet. Prospective Validation of the Pediatric Appendicitis Score in a Canadian Pediatric Emergency Department

Validation of an Arabic Version of the ORWELL97 Questionnaire in Adults with Obesity

Workshop: Cochrane Rehabilitation 05th May Trusted evidence. Informed decisions. Better health.

A Profiling System for the Assessment of Individual Needs for Rehabilitation With Hearing Aids

PHENOMENOLOGICAL RESEARCH IN COMPULSORY LAND ACQUISITION AND COMPENSATION

Evaluation of Behaviour Change Interventions to Increase the Use of Pneumatic Otoscopy in Family Medicine A Pilot Randomized Trial

Quality ID #342: Pain Brought Under Control Within 48 Hours National Quality Strategy Domain: Person and Caregiver-Centered Experience and Outcomes

ASD Working Group Endpoints

Fitting the Method to the Question

Transcription:

1. Which Model for intraclass correlation coefficients is used when the raters represent the only raters of interest for the reliability study? A. 1 B. 2 C. 3 D. 4 2. The form for intraclass correlation coefficients that is used when a measurement does not report consistent results is 1. 3. Which of the following is a characteristic associated with the Kappa Statistic? A. Used for the assessment of interval data B. Used for assessment of nominal data C. Used for more than 2 raters D. Used to assess validity of a measure 4. Which ICC equation is applicable when the raters are randomly chosen from a larger population of raters, each subject is assessed by the same rater, and the mean of several recordings of a measure is used? A. 1,k B. 1,1 C. 2,k D. 2,1 5. An ICC value that is closer to 1.00 corresponds to stronger reliability. 6. The Kappa statistic focuses on agreement for nominal (categorical) data. 7. Which Model for intraclass correlation coefficients is rarely useful in clinical reliability studies? A. 1 B. 2 C. 3 D. 4 8. Which statistic would be used to assess the proportion of agreement between raters when evaluating presence or absence of a condition? A. Percent Agreement B. Intraclass Correlation Coefficient C. Kappa Statistic D. Interclass Correlation Coefficient

9. Which of the following ICC values corresponds to a moderate reliability interpretation? A. 0.00 0.50 B. 0.51 0.75 C. 0.76 0.90 D. 0.91 1.00 10. Which ICC equation is applicable when the raters used are the only ones of interest, the same raters assess each subject, and the reliability of a single measure is assessed? A. 1,1 B. 2,1 C. 3,1 D. 4,1 11. Which Kappa statistic value below would fit into the substantial agreement category? A. 0.58 B. 0.75 C. 0.85 D. 0.90 12. How many research studies are analyzed in a CAP? A. 1 B. 2 C. 3 D. 4 13. What is the purpose of the Clinical Scenario in a CAT? A. To apply the findings to a patient B. To compare studies on a particular condition C. To decide a course of action D. To provide an introduction to the topic 14. Which of the following types of validity is defined by the degree to which the results from a sample group can be generalized to a larger population? A. Internal validity B. External validity C. Predictive validity D. Statistical validity 15. What is the purpose of the Clinical Bottom Line section of the CAP? A. Assesses the validity of the study B. Compares the results of the study to other studies C. Summarizes how the study relates to the clinical question D. Summarizes the feasibility of applying the study results to a broader spectrum of patients

16. What symbol is used to designate the experimental intervention in the Summary of Key Evidence section of a CAP? A. O B. R C. T D. X 17. A CAT can provide a detailed synthesis of multiple peer-reviewed articles regarding a similar intervention and methodology. 18. In assessing the Level of Evidence of a CAP, which rating would be considered higher on the CEBM scale? A. 1b B. 2a C. 4 D. 5 19. Which part of the CAT would include the Boolean operators inserted between two terms? A. Results of the search B. Search strategy C. Search validity D. Summary of search 20. The use of tables and charts are typically used in a CAP. 21. Which term best describes the ability of a patient-reported outcome instrument to represent all of the components which it is intended to assess? A. Applicability B. Comprehensiveness C. Precision D. Reliability 22. Which of the following is an advantage of using a generic patient-reported outcome? A. Can be used with a wide variety of patients B. Detailed assessment of a particular area of concern C. More likely to detect changes across time with a treatment D. Relevant for a specific condition 23. Which of the following is an example of a specific patient-reported outcomes scale? A.Lower Extremity Functional Scale B. Pediatric Quality of Life Inventory C. Short Form 36 D. Sickness Impact Profile

24. Which of the following characteristics of a patient-reported outcome can be influenced by day-today variations in patients? A. Applicability B. Comprehensiveness C. Practicality D. Reliability 25. When determining applicability of a patient-reported outcome, which of the following should be a consideration? A. The ability to discriminate between patients B. That norms are established for your patient C. That the scale is scored easily D. A and B 26. What is the best term to describe the ability of a patient-reported outcome to detect change over the course of a treatment? A. Applicability B. Practicality C. Reliability D. Responsiveness 27. Which of the following scales would be best used to capture a broad range of health status concerns? A. Asthma Quality of Life Scale B. Child Health Questionnaire C. Lower Extremity Functional Scale D. McGill Pain Questionnaire 28. What would a patient-reported outcome be considered if it measures what it is intended to measure? A. Applicable B. Precise C. Reliable D. Valid 29. In clinical practice, it is best to administer more than one type of patient-reported outcome to obtain the most information regarding the patient. 30. Which of the following types of scales may not be able to assess changes to a patient s healthrelated quality of life? A. Disease specific B. Generic C. Region specific D. A and C

31. Which level of disablement would include clinician tasks of manual muscle and range of motion testing? 32. Which of the following aspects of disablement refers to the impact of acute or chronic conditions? A. Day to day functioning B. Human performance C. Societal expectations D. All of the above 33. Disablement models promote a common language between healthcare providers. 34. Which level of disablement would the inability to throw a baseball would fall under? 35. Assessment at the organ level requires the use of both clinician- and patient-based outcomes. 36. Which level of disablement is typically assessed using self-report patient outcomes? A. Organ B. Person C. Societal D. B and C 37. What level of disablement involves understanding how an individual s injury has affected his/her athletic participation role(s)? 38. Understanding how personal and environmental factors influence a patient s perception of disablement is not important in directing treatment.

39. Which level of disablement identifies the pathology of injury?