LEVEL ONE MODULE EXAM PART TWO [Reliability Coefficients CAPs & CATs Patient Reported Outcomes Assessments Disablement Model]

Size: px
Start display at page:

Download "LEVEL ONE MODULE EXAM PART TWO [Reliability Coefficients CAPs & CATs Patient Reported Outcomes Assessments Disablement Model]"

Transcription

1 1. Which Model for intraclass correlation coefficients is used when the raters represent the only raters of interest for the reliability study? A. 1 B. 2 C. 3 D The form for intraclass correlation coefficients that is used when a measurement does not report consistent results is Which of the following is a characteristic associated with the Kappa Statistic? A. Used for the assessment of interval data B. Used for assessment of nominal data C. Used for more than 2 raters D. Used to assess validity of a measure 4. Which ICC equation is applicable when the raters are randomly chosen from a larger population of raters, each subject is assessed by the same rater, and the mean of several recordings of a measure is used? A. 1,k B. 1,1 C. 2,k D. 2,1 5. An ICC value that is closer to 1.00 corresponds to stronger reliability. 6. The Kappa statistic focuses on agreement for nominal (categorical) data. 7. Which Model for intraclass correlation coefficients is rarely useful in clinical reliability studies? A. 1 B. 2 C. 3 D Which statistic would be used to assess the proportion of agreement between raters when evaluating presence or absence of a condition? A. Percent Agreement B. Intraclass Correlation Coefficient C. Kappa Statistic D. Interclass Correlation Coefficient

2 9. Which of the following ICC values corresponds to a moderate reliability interpretation? A B C D Which ICC equation is applicable when the raters used are the only ones of interest, the same raters assess each subject, and the reliability of a single measure is assessed? A. 1,1 B. 2,1 C. 3,1 D. 4,1 11. Which Kappa statistic value below would fit into the substantial agreement category? A B C D How many research studies are analyzed in a CAP? A. 1 B. 2 C. 3 D What is the purpose of the Clinical Scenario in a CAT? A. To apply the findings to a patient B. To compare studies on a particular condition C. To decide a course of action D. To provide an introduction to the topic 14. Which of the following types of validity is defined by the degree to which the results from a sample group can be generalized to a larger population? A. Internal validity B. External validity C. Predictive validity D. Statistical validity 15. What is the purpose of the Clinical Bottom Line section of the CAP? A. Assesses the validity of the study B. Compares the results of the study to other studies C. Summarizes how the study relates to the clinical question D. Summarizes the feasibility of applying the study results to a broader spectrum of patients

3 16. What symbol is used to designate the experimental intervention in the Summary of Key Evidence section of a CAP? A. O B. R C. T D. X 17. A CAT can provide a detailed synthesis of multiple peer-reviewed articles regarding a similar intervention and methodology. 18. In assessing the Level of Evidence of a CAP, which rating would be considered higher on the CEBM scale? A. 1b B. 2a C. 4 D Which part of the CAT would include the Boolean operators inserted between two terms? A. Results of the search B. Search strategy C. Search validity D. Summary of search 20. The use of tables and charts are typically used in a CAP. 21. Which term best describes the ability of a patient-reported outcome instrument to represent all of the components which it is intended to assess? A. Applicability B. Comprehensiveness C. Precision D. Reliability 22. Which of the following is an advantage of using a generic patient-reported outcome? A. Can be used with a wide variety of patients B. Detailed assessment of a particular area of concern C. More likely to detect changes across time with a treatment D. Relevant for a specific condition 23. Which of the following is an example of a specific patient-reported outcomes scale? A.Lower Extremity Functional Scale B. Pediatric Quality of Life Inventory C. Short Form 36 D. Sickness Impact Profile

4 24. Which of the following characteristics of a patient-reported outcome can be influenced by day-today variations in patients? A. Applicability B. Comprehensiveness C. Practicality D. Reliability 25. When determining applicability of a patient-reported outcome, which of the following should be a consideration? A. The ability to discriminate between patients B. That norms are established for your patient C. That the scale is scored easily D. A and B 26. What is the best term to describe the ability of a patient-reported outcome to detect change over the course of a treatment? A. Applicability B. Practicality C. Reliability D. Responsiveness 27. Which of the following scales would be best used to capture a broad range of health status concerns? A. Asthma Quality of Life Scale B. Child Health Questionnaire C. Lower Extremity Functional Scale D. McGill Pain Questionnaire 28. What would a patient-reported outcome be considered if it measures what it is intended to measure? A. Applicable B. Precise C. Reliable D. Valid 29. In clinical practice, it is best to administer more than one type of patient-reported outcome to obtain the most information regarding the patient. 30. Which of the following types of scales may not be able to assess changes to a patient s healthrelated quality of life? A. Disease specific B. Generic C. Region specific D. A and C

5 31. Which level of disablement would include clinician tasks of manual muscle and range of motion testing? 32. Which of the following aspects of disablement refers to the impact of acute or chronic conditions? A. Day to day functioning B. Human performance C. Societal expectations D. All of the above 33. Disablement models promote a common language between healthcare providers. 34. Which level of disablement would the inability to throw a baseball would fall under? 35. Assessment at the organ level requires the use of both clinician- and patient-based outcomes. 36. Which level of disablement is typically assessed using self-report patient outcomes? A. Organ B. Person C. Societal D. B and C 37. What level of disablement involves understanding how an individual s injury has affected his/her athletic participation role(s)? 38. Understanding how personal and environmental factors influence a patient s perception of disablement is not important in directing treatment.

6 39. Which level of disablement identifies the pathology of injury?

The Predictive Validity of the Test of Infant Motor Performance on School Age Motor Developmental Delay

The Predictive Validity of the Test of Infant Motor Performance on School Age Motor Developmental Delay Pacific University CommonKnowledge PT Critically Appraised Topics School of Physical Therapy 2012 The Predictive Validity of the Test of Infant Motor Performance on School Age Motor Developmental Delay

More information

Measures. David Black, Ph.D. Pediatric and Developmental. Introduction to the Principles and Practice of Clinical Research

Measures. David Black, Ph.D. Pediatric and Developmental. Introduction to the Principles and Practice of Clinical Research Introduction to the Principles and Practice of Clinical Research Measures David Black, Ph.D. Pediatric and Developmental Neuroscience, NIMH With thanks to Audrey Thurm Daniel Pine With thanks to Audrey

More information

10 Intraclass Correlations under the Mixed Factorial Design

10 Intraclass Correlations under the Mixed Factorial Design CHAPTER 1 Intraclass Correlations under the Mixed Factorial Design OBJECTIVE This chapter aims at presenting methods for analyzing intraclass correlation coefficients for reliability studies based on a

More information

A profiling system for the assessment of individual needs for rehabilitation with hearing aids

A profiling system for the assessment of individual needs for rehabilitation with hearing aids A profiling system for the assessment of individual needs for rehabilitation with hearing aids WOUTER DRESCHLER * AND INGE BRONS Academic Medical Center, Department of Clinical & Experimental Audiology,

More information

Competency Rubric Bank for the Sciences (CRBS)

Competency Rubric Bank for the Sciences (CRBS) Competency Rubric Bank for the Sciences (CRBS) Content Knowledge 1 Content Knowledge: Accuracy of scientific understanding Higher Order Cognitive Skills (HOCS) 3 Analysis: Clarity of Research Question

More information

Closed Coding. Analyzing Qualitative Data VIS17. Melanie Tory

Closed Coding. Analyzing Qualitative Data VIS17. Melanie Tory Closed Coding Analyzing Qualitative Data Tutorial @ VIS17 Melanie Tory A code in qualitative inquiry is most often a word or short phrase that symbolically assigns a summative, salient, essence capturing,

More information

alternate-form reliability The degree to which two or more versions of the same test correlate with one another. In clinical studies in which a given function is going to be tested more than once over

More information

Reliability and Validity checks S-005

Reliability and Validity checks S-005 Reliability and Validity checks S-005 Checking on reliability of the data we collect Compare over time (test-retest) Item analysis Internal consistency Inter-rater agreement Compare over time Test-Retest

More information

COGNITIVE FUNCTION. PROMIS Pediatric Item Bank v1.0 Cognitive Function PROMIS Pediatric Short Form v1.0 Cognitive Function 7a

COGNITIVE FUNCTION. PROMIS Pediatric Item Bank v1.0 Cognitive Function PROMIS Pediatric Short Form v1.0 Cognitive Function 7a COGNITIVE FUNCTION A brief guide to the PROMIS Cognitive Function instruments: ADULT PEDIATRIC PARENT PROXY PROMIS Item Bank v1.0 Applied Cognition - Abilities* PROMIS Item Bank v1.0 Applied Cognition

More information

Maltreatment Reliability Statistics last updated 11/22/05

Maltreatment Reliability Statistics last updated 11/22/05 Maltreatment Reliability Statistics last updated 11/22/05 Historical Information In July 2004, the Coordinating Center (CORE) / Collaborating Studies Coordinating Center (CSCC) identified a protocol to

More information

Comparing Vertical and Horizontal Scoring of Open-Ended Questionnaires

Comparing Vertical and Horizontal Scoring of Open-Ended Questionnaires A peer-reviewed electronic journal. Copyright is retained by the first or sole author, who grants right of first publication to the Practical Assessment, Research & Evaluation. Permission is granted to

More information

1/24/15. In pursuit of evidence- based prac8ce. Accessibility of Available Evidence. Today s Purpose BUT FIRST... Levels of Evidence (LOE)

1/24/15. In pursuit of evidence- based prac8ce. Accessibility of Available Evidence. Today s Purpose BUT FIRST... Levels of Evidence (LOE) Speeding Up the EBP Process: Using Evidence that is Appraised, Available, and Ready To Go In pursuit of evidence- based prac8ce Clinician s best judgment How do we gain access to available evidence? Cailee

More information

Last week: Introduction, types of empirical studies. Also: scribe assignments, project details

Last week: Introduction, types of empirical studies. Also: scribe assignments, project details Last week: Introduction, types of empirical studies Today: Types of data, Internal and external validity (slides from Human-Computer Interaction, An Empirical Research Perspective) Also: scribe assignments,

More information

Construct Reliability and Validity Update Report

Construct Reliability and Validity Update Report Assessments 24x7 LLC DISC Assessment 2013 2014 Construct Reliability and Validity Update Report Executive Summary We provide this document as a tool for end-users of the Assessments 24x7 LLC (A24x7) Online

More information

ABOUT PHYSICAL ACTIVITY

ABOUT PHYSICAL ACTIVITY PHYSICAL ACTIVITY A brief guide to the PROMIS Physical Activity instruments: PEDIATRIC PROMIS Pediatric Item Bank v1.0 Physical Activity PROMIS Pediatric Short Form v1.0 Physical Activity 4a PROMIS Pediatric

More information

Responsiveness of the VAS and McGill Pain Questionnaire in Measuring Changes in Musculoskeletal Pain

Responsiveness of the VAS and McGill Pain Questionnaire in Measuring Changes in Musculoskeletal Pain Journal of Sport Rehabilitation, 2011, 20, 250-255 2011 Human Kinetics, Inc. Critically Appraised Topic Responsiveness of the VAS and McGill Pain Questionnaire in Measuring Changes in Musculoskeletal Pain

More information

CHAPTER VI RESEARCH METHODOLOGY

CHAPTER VI RESEARCH METHODOLOGY CHAPTER VI RESEARCH METHODOLOGY 6.1 Research Design Research is an organized, systematic, data based, critical, objective, scientific inquiry or investigation into a specific problem, undertaken with the

More information

Evidence Informed Practice Online Learning Module Glossary

Evidence Informed Practice Online Learning Module Glossary Term Abstract Associations Attrition Bias Background and Significance Baseline Basic Science Bias Blinding Definition An abstract is a summary of a research article. It usually includes the purpose, methods,

More information

Thank You: Developmental social neuroscience meets public health challenge: The next generations of children with autism spectrum disorder

Thank You: Developmental social neuroscience meets public health challenge: The next generations of children with autism spectrum disorder Developmental social neuroscience meets public health challenge: The next generations of children with autism spectrum disorder th Annual Autism Spectrum Disorder Update: Autism Through the Life Span Palo

More information

Model 1: Subject As Single Factor

Model 1: Subject As Single Factor 3 Model 1: Subject As Single Factor 3.1 The Model In this section, I am considering reliability experiments where each subject is scored by a different group of r raters 1. The experimenter controls which

More information

Ryan Mattek, PhD Letitia Johnson PhD. SRA-FV: Evidence of Inter-rater Reliability in a Combined SOMMI Sample

Ryan Mattek, PhD Letitia Johnson PhD. SRA-FV: Evidence of Inter-rater Reliability in a Combined SOMMI Sample Ryan Mattek, PhD Letitia Johnson PhD SRA-FV: Evidence of Inter-rater Reliability in a Combined SOMMI Sample Declarations We have no financial interests to declare Goals/Objectives 1. Participants will

More information

ADMS Sampling Technique and Survey Studies

ADMS Sampling Technique and Survey Studies Principles of Measurement Measurement As a way of understanding, evaluating, and differentiating characteristics Provides a mechanism to achieve precision in this understanding, the extent or quality As

More information

Linking Assessments: Concept and History

Linking Assessments: Concept and History Linking Assessments: Concept and History Michael J. Kolen, University of Iowa In this article, the history of linking is summarized, and current linking frameworks that have been proposed are considered.

More information

INTRODUCTION TO ASSESSMENT OPTIONS

INTRODUCTION TO ASSESSMENT OPTIONS ASTHMA IMPACT A brief guide to the PROMIS Asthma Impact instruments: PEDIATRIC PROMIS Pediatric Item Bank v2.0 Asthma Impact PROMIS Pediatric Item Bank v1.0 Asthma Impact* PROMIS Pediatric Short Form v2.0

More information

Research Questions and Survey Development

Research Questions and Survey Development Research Questions and Survey Development R. Eric Heidel, PhD Associate Professor of Biostatistics Department of Surgery University of Tennessee Graduate School of Medicine Research Questions 1 Research

More information

Critical Review: Late Talkers : What Can We Expect?

Critical Review: Late Talkers : What Can We Expect? Critical Review: Late Talkers : What Can We Expect? Ian Gallant M.Cl.Sc (SLP) Candidate Western University: School of Communication Sciences and Disorders This critical review examines two specific questions

More information

Patient Reported Outcomes Academic Perspective on Clinical Research

Patient Reported Outcomes Academic Perspective on Clinical Research Patient Reported Outcomes Academic Perspective on Clinical Research Lillian Sung MD, PhD Associate Professor, Division of Haematology/Oncology The Hospital for Sick Children Toronto, Canada March 9, 2015

More information

D.L. Hart Memorial Outcomes Research Grant Program Details

D.L. Hart Memorial Outcomes Research Grant Program Details Purpose D.L. Hart Memorial Outcomes Research Grant Program Details Focus on Therapeutic Outcomes, Inc. (FOTO) invites applications for the D.L. HART Memorial Outcomes Research Grant. FOTO is seeking proposals

More information

Psychometric Evaluation of Self-Report Questionnaires - the development of a checklist

Psychometric Evaluation of Self-Report Questionnaires - the development of a checklist pr O C e 49C c, 1-- Le_ 5 e. _ P. ibt_166' (A,-) e-r e.),s IsONI 53 5-6b

More information

Alcohol interventions in secondary and further education

Alcohol interventions in secondary and further education National Institute for Health and Care Excellence Guideline version (Draft for Consultation) Alcohol interventions in secondary and further education NICE guideline: methods NICE guideline Methods

More information

Champlain Assessment/Outcome Measures Forum February 22, 2010

Champlain Assessment/Outcome Measures Forum February 22, 2010 Champlain Assessment/Outcome Measures Forum February 22, 2010 Welcome Table Configurations Each table has a card with the name of the discipline(s) and the mix of professions Select the discipline of interest

More information

2 Critical thinking guidelines

2 Critical thinking guidelines What makes psychological research scientific? Precision How psychologists do research? Skepticism Reliance on empirical evidence Willingness to make risky predictions Openness Precision Begin with a Theory

More information

4 Diagnostic Tests and Measures of Agreement

4 Diagnostic Tests and Measures of Agreement 4 Diagnostic Tests and Measures of Agreement Diagnostic tests may be used for diagnosis of disease or for screening purposes. Some tests are more effective than others, so we need to be able to measure

More information

PTHP 7101 Research 1 Chapter Assignments

PTHP 7101 Research 1 Chapter Assignments PTHP 7101 Research 1 Chapter Assignments INSTRUCTIONS: Go over the questions/pointers pertaining to the chapters and turn in a hard copy of your answers at the beginning of class (on the day that it is

More information

CHAPTER 3 METHOD AND PROCEDURE

CHAPTER 3 METHOD AND PROCEDURE CHAPTER 3 METHOD AND PROCEDURE Previous chapter namely Review of the Literature was concerned with the review of the research studies conducted in the field of teacher education, with special reference

More information

Chapter 2 A Guide to PROMs Methodology and Selection Criteria

Chapter 2 A Guide to PROMs Methodology and Selection Criteria Chapter 2 A Guide to PROMs Methodology and Selection Criteria Maha El Gaafary Introduction In general, medical management outcomes can be classified into clinical (e.g., cure, survival), personal (e.g.,

More information

Chapter 14: More Powerful Statistical Methods

Chapter 14: More Powerful Statistical Methods Chapter 14: More Powerful Statistical Methods Most questions will be on correlation and regression analysis, but I would like you to know just basically what cluster analysis, factor analysis, and conjoint

More information

Writing Measurable Educational Objectives

Writing Measurable Educational Objectives Writing Measurable Educational Objectives Establishing educational objectives is one of the most important steps in planning a CME activity, as they lay the foundation for what participants are expected

More information

Systematic reviews: From evidence to recommendation. Marcel Dijkers, PhD, FACRM Icahn School of Medicine at Mount Sinai

Systematic reviews: From evidence to recommendation. Marcel Dijkers, PhD, FACRM Icahn School of Medicine at Mount Sinai Systematic reviews: From evidence to recommendation Session 2 - June 18, 2014 Going beyond design, going beyond intervention: The American Academy of Neurology (AAN) Clinical Practice Guideline process

More information

Foundations of Research Methods

Foundations of Research Methods 1 Foundations of Research Methods Relevant dates and information 09/03/2017 Intermediate test (final test) >> to be defined 1 Things to do: Enrol yourself in the page of the course (obligatory) Sign every

More information

The Effects of Automated Risk Assessment on Reliability, Validity and Return on Investment (ROI)

The Effects of Automated Risk Assessment on Reliability, Validity and Return on Investment (ROI) The Effects of Automated Risk Assessment on Reliability, Validity and Return on Investment (ROI) Grant Duwe, Ph.D. Director, Research and Evaluation May 2016 Email: grant.duwe@state.mn.us Overview Recently

More information

Corporate Medical Policy

Corporate Medical Policy Corporate Medical Policy Quantitative Electroencephalography as a Diagnostic Aid for Attention File Name: Origination: Last CAP Review: Next CAP Review: Last Review: quantitative_electroencephalography_as_a_diagnostic_aid_for_adhd

More information

Reliability of the Columbia Impairment Scale (C.I.S.) for adolescents: Survey among an Italian sample in Lazio Region

Reliability of the Columbia Impairment Scale (C.I.S.) for adolescents: Survey among an Italian sample in Lazio Region ORIGINAL ARTICLES Epidemiology Biostatistics and Public Health - 2016, Volume 13, Number 1 Reliability of the Columbia Impairment Scale (C.I.S.) for adolescents: Survey among an Italian sample in Lazio

More information

Observer OPTION 5 Manual

Observer OPTION 5 Manual Observer OPTION 5 Manual Measuring shared decision making by assessing recordings or transcripts of encounters from clinical settings. Glyn Elwyn, Stuart W Grande, Paul Barr The Dartmouth Institute for

More information

CRITICALLY APPRAISED PAPER (CAP)

CRITICALLY APPRAISED PAPER (CAP) CRITICALLY APPRAISED PAPER (CAP) Johnson, C. R., Foldes, E., DeMand, A., & Brooks, M. M. (2015). Behavioral parent training to address feeding problems in children with autism spectrum disorder: A pilot

More information

DATA is derived either through. Self-Report Observation Measurement

DATA is derived either through. Self-Report Observation Measurement Data Management DATA is derived either through Self-Report Observation Measurement QUESTION ANSWER DATA DATA may be from Structured or Unstructured questions? Quantitative or Qualitative? Numerical or

More information

Appendix A AUTIM SPECTRUM DISORDER FEASIBILITY STUDY

Appendix A AUTIM SPECTRUM DISORDER FEASIBILITY STUDY Appendix A AUTIM SPECTRUM DISORDER FEASIBILITY STUDY Description: Representatives from the Departments of Social Services (DSS), Mental Health and Addiction Services (DMHAS), Children and Families (DCF),

More information

Methods for Determining Random Sample Size

Methods for Determining Random Sample Size Methods for Determining Random Sample Size This document discusses how to determine your random sample size based on the overall purpose of your research project. Methods for determining the random sample

More information

English 10 Writing Assessment Results and Analysis

English 10 Writing Assessment Results and Analysis Academic Assessment English 10 Writing Assessment Results and Analysis OVERVIEW This study is part of a multi-year effort undertaken by the Department of English to develop sustainable outcomes assessment

More information

SAMPLE. Autism Spectrum Rating Scales (6-18 Years) Teacher Ratings. Interpretive Report. By Sam Goldstein, Ph.D. & Jack A. Naglieri, Ph.D.

SAMPLE. Autism Spectrum Rating Scales (6-18 Years) Teacher Ratings. Interpretive Report. By Sam Goldstein, Ph.D. & Jack A. Naglieri, Ph.D. Autism Spectrum Rating Scales (6-18 Years) Teacher Ratings By Sam Goldstein, Ph.D. & Jack A. Naglieri, Ph.D. Interpretive Report This Interpretive Report is intended for use by qualified assessors only.

More information

Validity and reliability of measurements

Validity and reliability of measurements Validity and reliability of measurements 2 Validity and reliability of measurements 4 5 Components in a dataset Why bother (examples from research) What is reliability? What is validity? How should I treat

More information

Critical Review: Does the participation of a significant other in aural rehabilitation classes reduce perceived hearing handicap for older adults?

Critical Review: Does the participation of a significant other in aural rehabilitation classes reduce perceived hearing handicap for older adults? Critical Review: Does the participation of a significant other in aural rehabilitation classes reduce perceived hearing handicap for older adults? Christine De Luca M.Cl.Sc. (Aud) Candidate School of Communication

More information

Journal of Sport Rehabilitation. The reliability of strength tests performed in elevated shoulder positions using a hand-held dynamometer

Journal of Sport Rehabilitation. The reliability of strength tests performed in elevated shoulder positions using a hand-held dynamometer The reliability of strength tests performed in elevated shoulder positions using a hand-held dynamometer Journal: Manuscript ID: JSR.2015-0034.R2 Manuscript Type: Technical Report Keywords: dynamometry,

More information

Data Patterns for COS Ratings: What to Expect and What to Question

Data Patterns for COS Ratings: What to Expect and What to Question Data Patterns for COS Ratings: What to Expect and What to Question May 2018 Cornelia Taylor Dominique Tunzi SRI International The contents of this document were developed under a grant from the U.S. Department

More information

Last Updated: February 17, 2016 Articles up-to-date as of: July 2015

Last Updated: February 17, 2016 Articles up-to-date as of: July 2015 Reviewer ID: Mohit Singh, Nicole Elfring, Brodie Sakakibara, John Zhu, Jeremy Mak Type of Outcome Measure: SF-36 Total articles: 14 Author ID Study Design Setting Population (sample size, age) and Group

More information

Carol M. Mangione, MD NEI VFQ-25 Scoring Algorithm August 2000

Carol M. Mangione, MD NEI VFQ-25 Scoring Algorithm August 2000 Version 000 The National Eye Institute 5-Item Visual Function Questionnaire (VFQ-5) Version 000 This final version of the VFQ-5 differs from the previous version in that it includes an extra driving item

More information

Critical Review: What Presenting Speech and Language Characteristics of Late Talkers Distinguish Those Who Recover from Those Who Do Not?

Critical Review: What Presenting Speech and Language Characteristics of Late Talkers Distinguish Those Who Recover from Those Who Do Not? Critical Review: What Presenting Speech and Language Characteristics of Late Talkers Distinguish Those Who Recover from Those Who Do Not? Melissa Dumoulin M.Cl.Sc. Speech-Language Pathology Candidate University

More information

It s a New World New PT and PTA Coursework Tools

It s a New World New PT and PTA Coursework Tools It s a New World New PT and PTA Coursework Tools This article is based on a presentation by Susan K. Lindeblad, PhD, PT, FSBPT Staff, and Emilee Tison, PhD, DCI Consulting Group, Inc., at the 2016 FSBPT

More information

02a: Test-Retest and Parallel Forms Reliability

02a: Test-Retest and Parallel Forms Reliability 1 02a: Test-Retest and Parallel Forms Reliability Quantitative Variables 1. Classic Test Theory (CTT) 2. Correlation for Test-retest (or Parallel Forms): Stability and Equivalence for Quantitative Measures

More information

Essential Skills for Evidence-based Practice Understanding and Using Systematic Reviews

Essential Skills for Evidence-based Practice Understanding and Using Systematic Reviews J Nurs Sci Vol.28 No.4 Oct - Dec 2010 Essential Skills for Evidence-based Practice Understanding and Using Systematic Reviews Jeanne Grace Corresponding author: J Grace E-mail: Jeanne_Grace@urmc.rochester.edu

More information

DESIGN TYPE AND LEVEL OF EVIDENCE: Randomized controlled trial, Level I

DESIGN TYPE AND LEVEL OF EVIDENCE: Randomized controlled trial, Level I CRITICALLY APPRAISED PAPER (CAP) Hasan, A. A., Callaghan, P., & Lymn, J. S. (2015). Evaluation of the impact of a psychoeducational intervention for people diagnosed with schizophrenia and their primary

More information

Table of Contents. Clinical Outcome Assessments (COAs): A Conceptual Foundation

Table of Contents. Clinical Outcome Assessments (COAs): A Conceptual Foundation Clinical Outcome Assessments (COAs): A Conceptual Foundation Authors*: Walton MK(1), Powers JH(3), Hobart J, Patrick DL, Marquis P, Vamvakas, S(2), Isaac, M(2), Papadopoulos, E(1), Slagle, AF(1), Piault

More information

Social Norms about a Health Issue in Work Group Networks

Social Norms about a Health Issue in Work Group Networks Int. J. Environ. Res. Public Health 2015, 12, 11621-11639; doi:10.3390/ijerph120911621 Article International Journal of Environmental Research and Public Health ISSN 1660-4601 www.mdpi.com/journal/ijerph

More information

11/10/11. Memorie M. Gosa, M.S. CCC-SLP, BRS-S Senior Speech-Language Pathologist/ PhD Candidate LeBonheur Children s Hospital/ University of Memphis

11/10/11. Memorie M. Gosa, M.S. CCC-SLP, BRS-S Senior Speech-Language Pathologist/ PhD Candidate LeBonheur Children s Hospital/ University of Memphis Memorie M. Gosa, M.S. CCC-SLP, BRS-S Senior Speech-Language Pathologist/ PhD Candidate LeBonheur Children s Hospital/ University of Memphis Developed an 8 point interval scale to describe penetration &

More information

The Cochrane Collaboration

The Cochrane Collaboration The Cochrane Collaboration Version and date: V1, 29 October 2012 Guideline notes for consumer referees You have been invited to provide consumer comments on a Cochrane Review or Cochrane Protocol. This

More information

Social Validity Assessments of Behavior-Change Procedures used with Young Children: A Review

Social Validity Assessments of Behavior-Change Procedures used with Young Children: A Review Social Validity Assessments of Behavior-Change Procedures used with Young Children: A Review Nicole A. Heal Gregory P. Hanley Marissa Allen TxABA 2017 Introduction Social Validity (Kazdin, 1977; Wolf,

More information

Week 17 and 21 Comparing two assays and Measurement of Uncertainty Explain tools used to compare the performance of two assays, including

Week 17 and 21 Comparing two assays and Measurement of Uncertainty Explain tools used to compare the performance of two assays, including Week 17 and 21 Comparing two assays and Measurement of Uncertainty 2.4.1.4. Explain tools used to compare the performance of two assays, including 2.4.1.4.1. Linear regression 2.4.1.4.2. Bland-Altman plots

More information

CRITICALLY APPRAISED PAPER (CAP)

CRITICALLY APPRAISED PAPER (CAP) CRITICALLY APPRAISED PAPER (CAP) Gantman, A., Kapp, S. K., Orenski, K., & Laugeson, E. A. (2012). Social skills training for young adults with high-functioning autism spectrum disorders: A randomized controlled

More information

Framework for Comparative Research on Relational Information Displays

Framework for Comparative Research on Relational Information Displays Framework for Comparative Research on Relational Information Displays Sung Park and Richard Catrambone 2 School of Psychology & Graphics, Visualization, and Usability Center (GVU) Georgia Institute of

More information

Agreement Coefficients and Statistical Inference

Agreement Coefficients and Statistical Inference CHAPTER Agreement Coefficients and Statistical Inference OBJECTIVE This chapter describes several approaches for evaluating the precision associated with the inter-rater reliability coefficients of the

More information

Chapter Two. Classification and treatment plans

Chapter Two. Classification and treatment plans Chapter Two Classification and treatment plans Diagnosis Definition Good Dx Reliability & Validity History DSM-IV Other choices Weaknesses Treatment Outline 2 3 1. How do you feel about Dx? 4 Assessment

More information

Mullen Scales of Early Learning: AGS Edition

Mullen Scales of Early Learning: AGS Edition Overview The Mullen Scales of Early Learning: AGS Edition (Mullen, 1995) is an individually administered, standardized measure of cognitive functioning designed to be used with children from birth through

More information

Non-examined assessment: Exemplar 2 examiner commentary

Non-examined assessment: Exemplar 2 examiner commentary Non-examined assessment: Exemplar 2 examiner commentary A Level Geography Pearson Edexcel Level 3 Advanced GCE in Geography (9GE0) Non-examined assessment: Exemplar 2 Contents Candidate Title 1 Summary

More information

SAMPLE REPORT. Conners 3 Parent Short Form Assessment Report. By C. Keith Conners, Ph.D.

SAMPLE REPORT. Conners 3 Parent Short Form Assessment Report. By C. Keith Conners, Ph.D. By C. Keith Conners, Ph.D. Conners 3 Parent Short Form Assessment Report SAMPLE REPORT This Assessment report is intended for use by qualified assessors only, and is not to be shown or presented to the

More information

10/18/2016. Vineland Adaptive Behavior Scales, Third Edition 1. Meet Dr. Saulnier. Bio. Celine A. Saulnier, PhD Vineland-3 Author

10/18/2016. Vineland Adaptive Behavior Scales, Third Edition 1. Meet Dr. Saulnier. Bio. Celine A. Saulnier, PhD Vineland-3 Author Vineland Adaptive Behavior Scales, Third Edition Celine A. Saulnier, PhD Vineland-3 Author Director of Research Operations at the Marcus Autism Center & Associate Professor in the Department of Pediatrics

More information

Brief Report: Interrater Reliability of Clinical Diagnosis and DSM-IV Criteria for Autistic Disorder: Results of the DSM-IV Autism Field Trial

Brief Report: Interrater Reliability of Clinical Diagnosis and DSM-IV Criteria for Autistic Disorder: Results of the DSM-IV Autism Field Trial Journal of Autism and Developmental Disorders, Vol. 30, No. 2, 2000 Brief Report: Interrater Reliability of Clinical Diagnosis and DSM-IV Criteria for Autistic Disorder: Results of the DSM-IV Autism Field

More information

Expanding the Arts Deaf and Disability Arts, Access and Equality Strategy Executive Summary

Expanding the Arts Deaf and Disability Arts, Access and Equality Strategy Executive Summary Expanding the Arts Deaf and Disability Arts, Access and Equality Strategy Executive Summary THE STRATEGY In keeping with its commitment to equity, diversity and inclusive policies, the Canada Council for

More information

Comparison of the Null Distributions of

Comparison of the Null Distributions of Comparison of the Null Distributions of Weighted Kappa and the C Ordinal Statistic Domenic V. Cicchetti West Haven VA Hospital and Yale University Joseph L. Fleiss Columbia University It frequently occurs

More information

Critical Review Form Clinical Decision Analysis

Critical Review Form Clinical Decision Analysis Critical Review Form Clinical Decision Analysis An Interdisciplinary Initiative to Reduce Radiation Exposure: Evaluation of Appendicitis in a Pediatric Emergency Department with Clinical Assessment Supported

More information

Patient Reported Outcomes: are they appropriate for clinical practice? Jose M Valderas Clinical Lecturer

Patient Reported Outcomes: are they appropriate for clinical practice? Jose M Valderas Clinical Lecturer Patient Reported Outcomes: are they appropriate for clinical practice? Jose M Valderas Clinical Lecturer Key issues What are PROMs? Why PROMs? Assessing PROMs Interpreting PROMs Evidence for use in clinical

More information

The reliability and validity of the Index of Complexity, Outcome and Need for determining treatment need in Dutch orthodontic practice

The reliability and validity of the Index of Complexity, Outcome and Need for determining treatment need in Dutch orthodontic practice European Journal of Orthodontics 28 (2006) 58 64 doi:10.1093/ejo/cji085 Advance Access publication 8 November 2005 The Author 2005. Published by Oxford University Press on behalf of the European Orthodontics

More information

Early Childhood Measurement and Evaluation Tool Review

Early Childhood Measurement and Evaluation Tool Review Early Childhood Measurement and Evaluation Tool Review Early Childhood Measurement and Evaluation (ECME), a portfolio within CUP, produces Early Childhood Measurement Tool Reviews as a resource for those

More information

FATIGUE. A brief guide to the PROMIS Fatigue instruments:

FATIGUE. A brief guide to the PROMIS Fatigue instruments: FATIGUE A brief guide to the PROMIS Fatigue instruments: ADULT ADULT CANCER PEDIATRIC PARENT PROXY PROMIS Ca Bank v1.0 Fatigue PROMIS Pediatric Bank v2.0 Fatigue PROMIS Pediatric Bank v1.0 Fatigue* PROMIS

More information

Critical Review: Is Group Therapy an Effective Intervention Method for Improving Fluency in School-Aged Children and Adolescents who Stutter?

Critical Review: Is Group Therapy an Effective Intervention Method for Improving Fluency in School-Aged Children and Adolescents who Stutter? Critical Review: Is Group Therapy an Effective Intervention Method for Improving Fluency in School-Aged Children and Adolescents who Stutter? Laura Dickson M.Cl.Sc. (SLP) Candidate University of Western

More information

National Priorities of Oriented Research, Experimental Development and Innovation in the Czech Republic. March 14th, 2013 PACITA conference, Prague

National Priorities of Oriented Research, Experimental Development and Innovation in the Czech Republic. March 14th, 2013 PACITA conference, Prague National Priorities of Oriented Research, Experimental Development and Innovation in the Czech Republic March 14th, 2013 PACITA conference, Prague Contents National RDI priorities and TA in the Czech Republic

More information

Chapter 1. Drug Use: An Overview. The Drug Problem Talking About Drug Use. Talking About Drug Use

Chapter 1. Drug Use: An Overview. The Drug Problem Talking About Drug Use. Talking About Drug Use Chapter 1 Drug Use: An Overview The Drug Problem Talking About Drug Use To evaluate the extent of the drug problem and propose possible solutions, it helps to ask basic journalism questions: Who? What?

More information

2017 American Academy of Physical Medicine & Rehabilitation. All rights reserved.

2017 American Academy of Physical Medicine & Rehabilitation. All rights reserved. I. Executive Summary A. Background The American Academy of Physical Medicine and Rehabilitation (AAPM&R) is the national medical specialty organization representing more than 9,000 physicians who are specialists

More information

Process of a neuropsychological assessment

Process of a neuropsychological assessment Test selection Process of a neuropsychological assessment Gather information Review of information provided by referrer and if possible review of medical records Interview with client and his/her relative

More information

Ability to link signs/symptoms of current patient to previous clinical encounters; allows filtering of info to produce broad. differential.

Ability to link signs/symptoms of current patient to previous clinical encounters; allows filtering of info to produce broad. differential. Patient Care Novice Advanced Information gathering Organization of responsibilities Transfer of Care Physical Examination Decision Making Development and execution of plans Gathers too much/little info;

More information

Efficacy of segmental versus global core stabilization exercises for patients with chronic low back pain (LBP)

Efficacy of segmental versus global core stabilization exercises for patients with chronic low back pain (LBP) Pacific University CommonKnowledge PT Critically Appraised Topics School of Physical Therapy 2011 Efficacy of segmental versus global core stabilization exercises for patients with chronic low back pain

More information

Statistical Validation of the Grand Rapids Arch Collapse Classification

Statistical Validation of the Grand Rapids Arch Collapse Classification Statistical Validation of the Grand Rapids Arch Collapse Classification David Burkard, BS Michelle Padley, CRTM John Anderson, MD Donald Bohay, MD John Maskill, MD Daniel Patton, MD Orthopaedic Associates

More information

Question Sheet. Prospective Validation of the Pediatric Appendicitis Score in a Canadian Pediatric Emergency Department

Question Sheet. Prospective Validation of the Pediatric Appendicitis Score in a Canadian Pediatric Emergency Department Question Sheet Prospective Validation of the Pediatric Appendicitis Score in a Canadian Pediatric Emergency Department Bhatt M, Joseph L, Ducharme FM et al. Acad Emerg Med 2009;16(7):591-596 1. Provide

More information

Validation of an Arabic Version of the ORWELL97 Questionnaire in Adults with Obesity

Validation of an Arabic Version of the ORWELL97 Questionnaire in Adults with Obesity Validation of an Arabic Version of the ORWELL97 Questionnaire in Adults with Obesity Leila Itani 1, Simona Calugi 2, Dima Kriedieh 1, Germine El Kassas 1, Dana El Masri 1, Hana Tannir 1, Riccardo Della

More information

Workshop: Cochrane Rehabilitation 05th May Trusted evidence. Informed decisions. Better health.

Workshop: Cochrane Rehabilitation 05th May Trusted evidence. Informed decisions. Better health. Workshop: Cochrane Rehabilitation 05th May 2018 Trusted evidence. Informed decisions. Better health. Disclosure I have no conflicts of interest with anything in this presentation How to read a systematic

More information

A Profiling System for the Assessment of Individual Needs for Rehabilitation With Hearing Aids

A Profiling System for the Assessment of Individual Needs for Rehabilitation With Hearing Aids ISAAR Special Issue A Profiling System for the Assessment of Individual Needs for Rehabilitation With Hearing Aids Trends in Hearing 2016, Vol. 20: 1 8! The Author(s) 2016 Reprints and permissions: sagepub.co.uk/journalspermissions.nav

More information

PHENOMENOLOGICAL RESEARCH IN COMPULSORY LAND ACQUISITION AND COMPENSATION

PHENOMENOLOGICAL RESEARCH IN COMPULSORY LAND ACQUISITION AND COMPENSATION PHENOMENOLOGICAL RESEARCH IN COMPULSORY LAND ACQUISITION AND COMPENSATION BY IYENEMI IBIMINA KAKULU, NIGERIA, PETER BYRNE, UNITED KINGDOM KAUKO VIITANEN, FINLAND INTRODUCTION This paper is based on the

More information

Evaluation of Behaviour Change Interventions to Increase the Use of Pneumatic Otoscopy in Family Medicine A Pilot Randomized Trial

Evaluation of Behaviour Change Interventions to Increase the Use of Pneumatic Otoscopy in Family Medicine A Pilot Randomized Trial Evaluation of Behaviour Change Interventions to Increase the Use of Pneumatic Otoscopy in Family Medicine A Pilot Randomized Trial Michel Labrecque MD PhD Department of Family and Emergency Medicine Université

More information

Quality ID #342: Pain Brought Under Control Within 48 Hours National Quality Strategy Domain: Person and Caregiver-Centered Experience and Outcomes

Quality ID #342: Pain Brought Under Control Within 48 Hours National Quality Strategy Domain: Person and Caregiver-Centered Experience and Outcomes Quality ID #342: Pain Brought Under Control Within 48 Hours National Quality Strategy Domain: Person and Caregiver-Centered Experience and Outcomes 2018 OPTIONS FOR INDIVIDUAL MEASURES: REGISTRY ONLY MEASURE

More information

ASD Working Group Endpoints

ASD Working Group Endpoints Outcome Measures Lit Review Topics Current endpoints used in drug development, strengths and limitations Accounting for patients and carers perspective Suitability of outcomes for different age groups

More information

Fitting the Method to the Question

Fitting the Method to the Question Quantitative Research Design: Fitting the Method to the Question Deborah Eldredge, PhD, RN Director, Nursing Quality, Research & Magnet Oregon Health & Science University Healthcare Margo A. Halm, RN,

More information