Revising the In-Training Evaluation Report (ITER) to Improve its Utility
|
|
- Owen Simon
- 5 years ago
- Views:
Transcription
1 Revising the In-Training Evaluation Report (ITER) to Improve its Utility Clarissa Agusto, MD, FRCPC, PGY-5 Vijay Daniels MD, MHPE, FRCPC, Associate Professor Division of General Internal Medicine University of Alberta
2 I do not have an affiliation (financial or otherwise) with a pharmaceutical, medical device or communications organization. Je n ai aucune affiliation (financière ou autre) avec une entreprise pharmaceutique, un fabricant d appareils médicaux ou un cabinet de communication. 2
3 Background Formative utility Shift to CBME Assessment for Learning ITER is one of the most commonly used assessment tools yet is widely criticized for lack of validity Summative utility ITER Evidence of Validity» Scores reliable across multiple rotations and predictive validity for PGY3 Internal Medicine performance - Ginsburg et al» Within scale alpha too high (Kassam et al, locally)? Halo effect with rater fatigue reducing comment quality 3
4 Purpose The purpose of this study is to evaluate the effect of reducing length of the ITER used for an Internal Medicine residency program on one aspect of validity, reliability, and on the quality of feedback 4
5 Methods Setting Old ITER contained 35-items, based on the CanMEDS framework Consensus approach with Division of General Internal Medicine (GIM), reduced to 14-items» 13 items capturing broader competencies» 1 overall global rating scale 5
6 Methods ITER implementation academic year, PGY1 residents rotate through 4 GIM hospital sites Shorter (14-item) ITER at 2 GIM sites Longer (35-item) ITER at 2 other GIM sites Faculty Development 6
7 Analysis ITER reliability (G-studies) Within scale (Phi) Across two rotations with same ITER (Phi) Decision study to estimate reliability across 6, and 12 rotations ITER formative quality Completed Clinical Evaluation Report Rating (CCERR), Dudek et al» Each ITER rated by 3 GIM subspecialty residents using CCERR» CCERR reliability - overall G, internal consistency, inter-rater reliability» T-tests for differences in mean CCERR scores of long and short ITER to compare quality 7
8 Results ITER reliability Phi (reliability) Long (35-item) Short (14-item) Within scale Across 2 Rotations Across 6 Rotations Across 12 Rotations
9 Results ITER Formative Quality 33 PGY1 residents, 131 ITERs, 393 CCERRs scores CCERR reliability» Overall reliability G coefficient = 0.75» High internal consistency, Cronbach alpha 0.88» Very strong interrater reliability, ICC 0.86» ICC for each item at least moderate agreement, except item #1 (ICC -0.07) 9
10 Results ITER Formative Quality Average CCERR score (with and without Item #1)» Long ITER 2.76 vs Short ITER 2.92 (p-value 0.076)» Long ITER 2.68 vs Short ITER 2.85 (p-value 0.051) 10
11 Discussion Shortened ITER scores slightly less reliable But still acceptable for use» to determine who can progress to more advanced rotations earlier Shortened ITER likely provides better quality of feedback Although p=0.076 (0.051 without Item 1)» Would meet standard p<0.05 with one-tailed t-test Anecdotally (need to study)» Improved feasibility of use and timeliness of completion 11
12 Discussion Re-evaluation of the CCERR Very good reliability of CCERR scores Feasible: on average 3 to 4 mins/iter 12
13 Limitations Broader applicability PGY1 residents, GIM ward rotation Internal Medicine Residency Program at one institution Unusually high within scale reliability coefficients Rater errors Scale issues Items can be further reduced 13
14 Future Directions Implementation of the shortened ITER to all rotations in our program Further reduced ITER to 10-items Rotation-specific item content Further analysis of data across subspecialty rotations 14
15 References Chou S, Lockyer J, Cole G, McLaughlin K. Assessing postgraduate trainees in Canada: are we achieving diversity in methods? Med Teach 2009 February 1,;31(2):58. Patel R, Drover A, Chafe R. Pediatric faculty and residents' perspectives on In-Training Evaluation Reports (ITERs). Can Med Educ J 2015 December 11,;6(2):41. Watling CJ, Kenyon CF, Schulz V, Goldszmidt MA, Zibrowski E, Lingard L. An exploration of faculty perspectives on the in-training evaluation of residents. Acad Med 2010 July 1,;85(7): Bismil R, Dudek NL, Wood TJ. In-training evaluations: developing an automated screening tool to measure report quality. Med Educ 2014 July 1,;48(7): Ginsburg S, McIlroy J, Oulanova O, Eva K, Regehr G. Toward authentic clinical evaluation: pitfalls in the pursuit of competency. Acad Med 2010 May 1,;85(5): Ginsburg S, Eva K, Regehr G. Do in-training evaluation reports deserve their bad reputations? A study of the reliability and predictive ability of ITER scores and narrative comments. Acad Med 2013 October 1,;88(10): Dudek NL, Marks MB, Wood TJ, Lee AC. Assessing the quality of supervisors' completed clinical evaluation reports. Med Educ 2008 August 1,;42(8): Dudek NL, Marks MB, Bandiera G, White J, Wood TJ. Quality in-training evaluation reports--does feedback drive faculty performance? Acad Med 2013 August 1,;88(8): Gray JD. Global rating scales in residency education. Acad Med 1996 January 1,;71(1 Suppl):55. 15
16 References Norman GR, van der Vleuten C, Newble D. International handbook of research in medical education. Dordrecht :London: Kluwer Academic; Epstein RM. Assessment in medical education. N Engl J Med 2007 January 25,;356(4): Holmboe ES, Hawkins RE. Practical guide to the evaluation of clinical competence. Philadelphia, PA: Mosby Elsevier; Downing SM, Yudkowsky R. Assessment in health professions education. New York, NY: Routledge; Van Der Vleuten, C P. The assessment of professional competence: Developments, research and practical implications. Advances in health sciences education : theory and practice 1996 Jan;1(1): Watling CJ, Kenyon CF, Zibrowski EM, Schulz V, Goldszmidt MA, Singh I, et al. Rules of engagement: residents' perceptions of the in-training evaluation process. Academic medicine : journal of the Association of American Medical Colleges 2008 Oct;83(10 Suppl):S97. Driessen E, Scheele F. What is wrong with assessment in postgraduate training? Lessons from clinical practice and educational research. Medical Teacher 2013 Jul;35(7): Kassam A, Donnon T, Rigby I. Validity and reliability of an in-training evaluation report to measure the CanMEDS roles in emergency medicine residents. CJEM 2014 Mar;16(2): Frank JR, Snell LS, Cate OT, Holmboe ES, Carraccio C, Swing SR, et al. Competency-based medical education: theory to practice. Medical Teacher 2010 Aug;32(8): Ginsburg S, Gold W, Cavalcanti RB, Kurabi B, McDonald-Blumer H. Competencies "plus": the nature of written comments on internal medicine residents' evaluation forms. Academic medicine : journal of the Association of American Medical Colleges 2011 Oct;86(10 Suppl):S34. Chaudhry S, Holmboe E, Beasley B. The State of Evaluation in Internal Medicine Residency. J GEN INTERN MED 2008 Jul;23(7):
17 Thanks for your attention! Questions?? 17
18 Help us improve. Your input matters. Download the ICRE App, Visit the evaluation area in the Main Lobby, near Registration, or Go to: to complete the session evaluation. Aidez-nous à nous améliorer. Votre opinion compte! Téléchargez l application de la CIFR Visitez la zone d évaluation dans le hall principal, près du comptoir d inscription, ou Visitez le afin de remplir une évaluation de la séance. You could be entered to win 1 of 3 $100 gift cards. Vous courrez la chance de gagner l un des trois chèques-cadeaux d une valeur de
Promoting Smoking Cessation
Smoking cessation education for surgical residents: challenges in driving change Promoting Smoking Cessation Author: Gilgamesh Eamer MD Date: October 1, 2016 I do not have an affiliation (financial or
More informationMedicine as Art: The Development of Reflective Practitioners through an Arts-based Curriculum Author: Dr. Joyce Zazulak and Nicole Knibb Date:
Medicine as Art: The Development of Reflective Practitioners through an Arts-based Curriculum Author: Dr. Joyce Zazulak and Nicole Knibb Date: September 30, 2016 I do not have an affiliation (financial
More informationResolving Conflict with Communication: The Power of the PA. Hilary Writer September
Resolving Conflict with Communication: The Power of the PA Hilary Writer September 29 2016 I do not have an affiliation (financial or otherwise) with a pharmaceutical, medical device or communications
More informationA Systematic Review Establishing Absolute Standards for Technical Performance
A Systematic Review Establishing Absolute Standards for Technical Performance Authors: Mitchell G. Goldenberg, Alaina Garbens, Peter Szasz, Tyler Hauer, Teodor P. Grantcharov Date: October 1 st, 2016 I
More informationManaging Stress Tools to Help PAs Maintain Control. Sylvia Wu Manager Education UBC Department of Pediatrics October 17, 2012
Managing Stress Tools to Help PAs Maintain Control Sylvia Wu Manager Education UBC Department of Pediatrics October 17, 2012 I do not have an affiliation (financial or otherwise) with a pharmaceutical,
More informationAt the Point of Care: Point-of-Care Ultrasound in Core Internal Medicine and GIM Residency Programs in Canada
At the Point of Care: Point-of-Care Ultrasound in Core Internal Medicine and GIM Residency Programs in Canada Author: Jonathan Ailon, MDCM Date: October 20 th, 2012 I do not have an affiliation (financial
More informationKeyLIME: Top 10 Best teaching and learning literature
KeyLIME: Top 10 Best teaching and learning literature Author: Jamiu Busari, Maastricht University, Netherlands Ming-Ka Chan, University of Manitoba, Canada Date: 30 Sept, 2016 We do not have an affiliation
More informationfor effective teams & relationships
Leadership & Management Education for effective teams & relationships 20 Oct 2017 Diane de Camps Meschino MD Mcert FRCPC Anupam Thakur MD-Psychiatry MSc(Med. Ed) Co-Chairs Leadership Curriculum, University
More informationVictoria YY Xu PGY-2 Internal Medicine University of Toronto. Supervisor: Dr. Camilla Wong
Validity, Reliability, Feasibility, and Acceptability of Using the Consultation Letter Rating Scale to Assess Written Communication Competencies Among Geriatric Medicine Postgraduate Trainees Victoria
More informationVictoria YY Xu PGY-3 Internal Medicine University of Toronto. Supervisor: Dr. Camilla Wong
Validity, Reliability, Feasibility and Acceptability of Using the Consultation Letter Rating Scale to Assess Written Communication Competencies Among Geriatric Medicine Postgraduate Trainees Victoria YY
More informationAbstract. Introduction. Stephen D. Sisson, MD Amanda Bertram, MS Hsin-Chieh Yeh, PhD ORIGINAL RESEARCH
Concurrent Validity Between a Shared Curriculum, the Internal Medicine In- Training Examination, and the American Board of Internal Medicine Certifying Examination Stephen D. Sisson, MD Amanda Bertram,
More informationEntrustability Scales: Outlining Their Usefulness for Competency-Based Clinical Assessment. Abstract
Entrustability Scales: Outlining Their Usefulness for Competency-Based Clinical Assessment Janelle Rekman, MD, Wade Gofton, MD, MEd, Nancy Dudek, MD, MEd, Tyson Gofton, PhD, and Stanley J. Hamstra, PhD
More informationReliability of Rubrics in Mini-CEX
Original Article Reliability of Rubrics in Mini-CEX Anam Arshad, Muhammad Moin, Lubna Siddiq Pak J Ophthalmol 2017, Vol. 33, No. 1.....................................................................................................
More informationDevelopment, administration, and validity evidence of a subspecialty preparatory test toward licensure: a pilot study
Johnson et al. BMC Medical Education (2018) 18:176 https://doi.org/10.1186/s12909-018-1294-z RESEARCH ARTICLE Open Access Development, administration, and validity evidence of a subspecialty preparatory
More informationUNIVERSITY OF CALGARY. Reliability & Validity of the. Objective Structured Clinical Examination (OSCE): A Meta-Analysis. Ibrahim Al Ghaithi A THESIS
UNIVERSITY OF CALGARY Reliability & Validity of the Objective Structured Clinical Examination (OSCE): A Meta-Analysis by Ibrahim Al Ghaithi A THESIS SUBMITTED TO THE FACULTY OF GRADUATE STUDIES IN PARTIAL
More informationJoan Sargeant PhD Head, Division of Medical Education, Faculty of Medicine, Dalhousie University, Halifax, NS, Canada ABMS Conference 2016 Looking
MSF: A Diagnostic for Professional Behaviors? And if So, What s the Treatment? Joan Sargeant PhD Head, Division of Medical Education, Faculty of Medicine, Dalhousie University, Halifax, NS, Canada ABMS
More informationMini-PAT in Psychiatry Dr V M Aziz Dr Natalie Thomas
Mini-PAT in Psychiatry Dr V M Aziz Dr Natalie Thomas Practice Points: Learning that occurs in the context of the daily workplace is more likely to be relevant and reinforced, leading to better practice.
More informationDeveloping Skills at Making Observations
Developing Skills at Making Observations Lessons from Faculty Development and Rater Cognition Research Eric S. Holmboe Jennifer R. Kogan Roadmap 1. Define workplace based assessment and the theories supporting
More informationMiller s Assessment Pyramid
Roadmap Developing Skills at Making Observations Lessons from Faculty Development and Rater Cognition Research 1. Define workplace based assessment and the theories supporting direct observation 2. Identify
More informationImpact of Task-based Checklist Scoring and Two Domains Global Rating Scale in Objective Structured Clinical Examination of Pharmacy Students
Pharmaceutical Education Impact of Task-based Checklist Scoring and Two Domains Global Rating Scale in Objective Structured Clinical Examination of Pharmacy Students Sajesh Kalkandi Veettil * and Kingston
More informationPediatrics Milestones and Meaningful Assessment Translating the Pediatrics Milestones into Assessment Items for use in the Clinical Setting
Pediatrics Milestones and Meaningful Assessment Translating the Pediatrics Milestones into Assessment Items for use in the Clinical Setting Ann Burke Susan Guralnick Patty Hicks Jeanine Ronan Dan Schumacher
More informationAssessment of Psychiatrists in Practice Through Multisource Feedback
Assessment of Psychiatrists in Practice Through Multisource Feedback Claudio Violato, PhD 1 ; Jocelyn M Lockyer, PhD 2 ; Herta Fidler, MSc 3 Objective: To assess the feasibility and evidence for the reliability
More informationCommunication Skills in Standardized-Patient Assessment of Final-Year Medical Students: A Psychometric Study
Advances in Health Sciences Education 9: 179 187, 2004. 2004 Kluwer Academic Publishers. Printed in the Netherlands. 179 Communication Skills in Standardized-Patient Assessment of Final-Year Medical Students:
More informationReliability and Validity checks S-005
Reliability and Validity checks S-005 Checking on reliability of the data we collect Compare over time (test-retest) Item analysis Internal consistency Inter-rater agreement Compare over time Test-Retest
More informationDirect Observation in CBME: Importance and Challenges
Direct Observation in CBME: Importance and Challenges Eric Holmboe Jennifer Kogan Portions of this work have been supported by the American Board of Internal Medicine 1 Direct Observation Research Team
More informationAbout CBME/CBD Susan Glover Takahashi, Lisa St. Amant, Amy Wong,
About CBME/CBD Susan Glover Takahashi, Director, EIG, PGME Lisa St. Amant, Education Integration Group (EIG), PGME Amy Wong, Education Integration Group (EIG), PGME Disclosure of Commercial Support This
More informationSeen Through Their Eyes: Residents Reflections on the Cognitive and Contextual Components of Diagnostic Errors in Medicine
Seen Through Their Eyes: Residents Reflections on the Cognitive and Contextual Components of Diagnostic Errors in Medicine Academic Medicine. Oct 2012; 87(10):1361-1367 Alexis Ogdie, MD, MSCE on behalf
More informationCARDIOLOGY RESIDENCY PROGRAM MCMASTER UNIVERSITY
ECHOCARDIOGRAPHY CARDIOLOGY RESIDENCY PROGRAM MCMASTER UNIVERSITY ROTATION SUPERVISOR : DR. OMID SALEHIAN OVERVIEW The echocardiography rotation is primarily based at the HGH and JHCC. In the PGY4 year
More informationAre dimensions of psycho-social well-being different among Latvian and Romanian University students?
Available online at www.sciencedirect.com Procedia - Social and Behavioral Sciences 33 (202) 855 859 PSIWORLD 20 Are dimensions of psycho-social different among and University students? Santa Vorone a,
More informationAlternative scoring of the cutaneous assessment tool in juvenile dermatomyositis: Results using abbreviated formats
Himmelfarb Health Sciences Library, The George Washington University Health Sciences Research Commons Rheumatology Faculty Publications Medicine 3-15-2008 Alternative scoring of the cutaneous assessment
More information2013 Supervisor Survey Reliability Analysis
2013 Supervisor Survey Reliability Analysis In preparation for the submission of the Reliability Analysis for the 2013 Supervisor Survey, we wanted to revisit the purpose of this analysis. This analysis
More informationAssessing the quality of environmental design of nursing homes for people with dementia: development of a new tool
University of Wollongong Research Online Faculty of Science, Medicine and Health - Papers Faculty of Science, Medicine and Health 2015 Assessing the quality of environmental design of nursing homes for
More informationDesign and Preliminary Validation of an Instrument to Measure Medical Student Attitudes Toward the Homeless
Design and Preliminary Validation of an Instrument to Measure Medical Student Attitudes Toward the Homeless David S. Buck, MD, MPH F. Marconi Monteiro, EdD Suzanne Kneuper, MA Dana L. Clark, MD Allegra
More informationCompetency and Confidence in Interpretation of the Chest
Competency and Confidence in Interpretation of the Chest Radiograph in Junior Doctors and Medical Students Dr Timothy Cheung, Dr Harry Harianto, Dr Manfred Spanger, Dr Alan Young, Dr Vikas Wadhwa, Abstract
More informationEducation, Training, and Certification of Radiation Oncologists in Indonesia
Education, Training, and Certification of Radiation Oncologists in Indonesia with acknowledgement to Prof HM Djakaria (Indonesian College of Radiation Oncology) Outline Historical Context Current Status
More informationInstruments identified to measure indicators of the Shared Decision Making model (Coutu et al., 2015)
Instruments identified to measure indicators of the Shared Decision Making model (Coutu et al., 2015) Instruments 1 Authors Concepts measured Validation 1- OPTION Observing Patient Involvement 2- Observational
More informationDevelopment and Validation of a Bronchoscopy Competence Assessment Tool in a Clinical Setting
Development and Validation of a Bronchoscopy Competence Assessment Tool in a Clinical Setting Nha Voduc 1, Nancy Dudek 2, Christopher M. Parker 3, Krishna B. Sharma 2, and Timothy J. Wood 4 1 Division
More informationValidation of an Online Assessment of Orthopedic Surgery Residents Cognitive Skills and Preparedness for Carpal Tunnel Release Surgery
Validation of an Online Assessment of Orthopedic Surgery Residents Cognitive Skills and Preparedness for Carpal Tunnel Release Surgery Janet Shanedling, PhD Ann Van Heest, MD Michael Rodriguez, PhD Matthew
More informationThe Relationship between Academic Motivation and Lifelong Learning in Psychiatry Residents
The Relationship between Academic Motivation and Lifelong Learning in Psychiatry Residents BY SANJEEV SOCKALINGAM B.Sc., University of Manitoba 1998 B.A., University of Manitoba, 1999 M.D., University
More informationJune 26, E. Mineral Circle, Suite 350 Englewood, CO Critical Role of Performance Ratings
How Do You Rate What You Don t Know: The Impact of ity Between Raters and Ratees on Performance Evaluations John M. Ford Michael D. Blair Critical Role of Performance Ratings Administrative Decisions Compensation
More informationEDUCATIONAL INTERVENTION. The Use of an Objective Structured Clinical Examination With Postgraduate Residents in Pediatrics
EDUCATIONAL INTERVENTION The Use of an Objective Structured Clinical Examination With Postgraduate Residents in Pediatrics Robert I. Hilliard, MD, EdD, FRCPC; Susan E. Tallett, MBBS, FRCPC Objective: To
More informationAddendum Valorization paragraph
Addendum Valorization paragraph 171 1. (Relevance) What is the social (and/or economic) relevance of your research results (i.e. in addition to the scientific relevance)? Variability in ratings, human
More informationHealth Equity Workgroup. January 18, 2018
Health Equity Workgroup January 18, 2018 Health Equity Workgroup Co-Chairs Fleda Mask Jackson, PhD Founder, Save 100 Babies President and CEO, Majaica, LLC University Affiliate, Columbia University Arthur
More informationClinical psychology trainees experiences of supervision
Clinical psychology trainees experiences of supervision Item Type Article Authors Waldron, Michelle;Byrne, Michael Citation Waldron, M, & Byrne, M. (2014). Clinical psychology trainees' experiences of
More informationTeachers Sense of Efficacy Scale: The Study of Validity and Reliability
EUROPEAN ACADEMIC RESEARCH Vol. II, Issue 12/ March 2015 ISSN 2286-4822 www.euacademic.org Impact Factor: 3.1 (UIF) DRJI Value: 5.9 (B+) Teachers Sense of Efficacy Scale: The Study of Validity and Dr.
More informationComparing Vertical and Horizontal Scoring of Open-Ended Questionnaires
A peer-reviewed electronic journal. Copyright is retained by the first or sole author, who grants right of first publication to the Practical Assessment, Research & Evaluation. Permission is granted to
More informationEmergency medicine procedural skills: What do they need to know? A survey of Canadian emergency medicine residents & program directors
medicine procedural skills: What do they need to know? A survey of Canadian emergency medicine residents & program directors Andrew Petrosoniak, Jodi Herold & Karen Woolfrey, Residency Program and Wilson
More informationContinuity clinics in oncology training programs in Canada
Curr Oncol, Vol. 19, pp. e329-342; doi: http://dx.doi.org/10.3747/co.19.1046 CONTINUITY CLINICS IN ONCOLOGY TRAINING PROGRAMS ORIGINAL ARTICLE Continuity clinics in oncology training programs in Canada
More informationThe Development and Validation of Hand Motion Analysis to Evaluate Competency in Central Line Catheterization
EDUCATIONAL ADVANCE The Development and Validation of Hand Motion Analysis to Evaluate Competency in Central Line Catheterization David Clinkard, MSc, Matthew Holden, MSc, Tamas Ungi, MD, PhD, David Messenger,
More informationDimensionality, internal consistency and interrater reliability of clinical performance ratings
Medical Education 1987, 21, 130-137 Dimensionality, internal consistency and interrater reliability of clinical performance ratings B. R. MAXIMt & T. E. DIELMANS tdepartment of Mathematics and Statistics,
More informationUsing Direct Behavior Ratings in a Middle School Setting
Using Direct Behavior Ratings in a Middle School Setting P R E S E N T E R S : R I V K A H R O S E N, U N I V E R S I T Y O F C O N N E C T I C U T N I C H O L A S C R O V E L L O, U N I V E R S I T Y
More informationMedical Training in Psychiatric Residency: The PGY-1 Experience, 2014 Update
POSITION PAPER Medical Training in Psychiatric Residency: The PGY-1 Experience, 2014 Update M Natalie Husarewycz, MD, FRCPC 1 ; William Fleisher, MD, FRCPC 2 ; Kurt Skakum, MD, FRCPC 3 This position paper
More informationThe Patient and Observer Scar Assessment Scale: A Reliable and Feasible Tool for Scar Evaluation
The Patient and Observer Scar Assessment Scale: A Reliable and Feasible Tool for Scar Evaluation Lieneke J. Draaijers, M.D., Fenike R. H. Tempelman, M.D., Yvonne A. M. Botman, M.D., Wim E. Tuinebreijer,
More informationThe annual promotion assessment consists of the following components: a. Written examination b. Continuous Assessment
SAUDI BOARD RESIDENCY TRAINING PROGRAM Paediatric Dentistry Promotion Examination 2018 Objectives: The general objective of the annual promotion assessment is to evaluate that the trainee has satisfactorily
More informationFaculty: Brian L. Erstad, Pharm.D., FCCP, BCPS Professor, College of Pharmacy-Pulido Center, The University of Arizona, Tucson, Arizona
Clinical Career Advancement, Part I Activity No. 0217-0000-11-085-L04-P (Application-Based Activity) Monday, October 17 3:45 p.m. 5:45 p.m. Convention Center: Rooms 310 & 311 Part of the ACCP Academy Career
More informationFrom foundations to frontiers: the status and perception of formulation teaching in Canadian English-speaking psychiatry residency programs
DOI: 10.12740/APP/70659 From foundations to frontiers: the status and perception of formulation teaching in Canadian English-speaking psychiatry residency programs Catherine Hickey, Gilles Fleury, Angela
More informationThe Assessment of Physiotherapy Practice (APP) is a reliable measure of professional competence of physiotherapy students: a reliability study
Dalton et al: Reliability of the Assessment of Physiotherapy Practice The Assessment of Physiotherapy Practice (APP) is a reliable measure of professional competence of physiotherapy students: a reliability
More informationClinical Fellowship in Rural/Urban Geriatric Psychiatry. Department of Psychiatry McGill University. Pierre Janet Hospital Centre
Clinical Fellowship in Rural/Urban Geriatric Psychiatry Department of Psychiatry McGill University Pierre Janet Hospital Centre 12 September 2008 Location: Pierre Janet Hospital Centre 20 Pharand St Gatineau,
More informationThe Accreditation Council for Graduate Medical
BREAKOUT SESSION Assessing Interpersonal and Communication Skills in Emergency Medicine Teresa M. Chan, MD, Clare Wallner, MD, Thomas K. Swoboda, MD, Katrina A. Leone, MD, and Chad Kessler, MD, MHPE Abstract
More informationStephen B. Thomas, Ph.D.
Stephen B. Thomas, Ph.D. Inaugural Philip Hallen Professor of Community Health & Social Justice Associate Dean for Diversity Principal Investigator, Research Center of Excellence on Minority Health Disparities
More informationValidity, Reliability, and Defensibility of Assessments in Veterinary Education
Instructional Methods Validity, Reliability, and Defensibility of Assessments in Veterinary Education Kent Hecker g Claudio Violato ABSTRACT In this article, we provide an introduction to and overview
More informationPSYCHOMETRIC PROPERTIES OF CLINICAL PERFORMANCE RATINGS
PSYCHOMETRIC PROPERTIES OF CLINICAL PERFORMANCE RATINGS A total of 7931 ratings of 482 third- and fourth-year medical students were gathered over twelve four-week periods. Ratings were made by multiple
More information10 Intraclass Correlations under the Mixed Factorial Design
CHAPTER 1 Intraclass Correlations under the Mixed Factorial Design OBJECTIVE This chapter aims at presenting methods for analyzing intraclass correlation coefficients for reliability studies based on a
More informationDirect Observation of Procedural Skills in Radiology
Residents Section Clinical Perspective Bari Direct Observation of Procedural Skills Residents Section Clinical Perspective Vaqar Bari 1 Bari V Residents inradiology Keywords: assessment, direct observation
More informationEvaluation of Knowledge, Attitude and Practice of Parents of Children with Cardiac Disease about Oral Health
Original Article Evaluation of Knowledge, Attitude and Practice of Parents of Children with Cardiac Disease about Oral Health M. Fallahinejad Ghajari 1, S. Mojtahedzadeh 2, MJ. Kharazifard 3, B. Mahdavi
More informationEducation Performance on ABA- ASA In-training Examination predicts success for RCPSC certification
914 Education Performance on ABA- ASA In-training Examination predicts success for RCPSC certification Ramona A. Kearney MD FRCPC, Patrick Sullivan MD FRCPC, Ernest Skakun PhD Purpose: Most Canadian University
More informationTHE INFLUENCE OF UNCONSCIOUS NEEDS ON COLLEGE PROGRAM CHOICE
University of Massachusetts Amherst ScholarWorks@UMass Amherst Tourism Travel and Research Association: Advancing Tourism Research Globally 2007 ttra International Conference THE INFLUENCE OF UNCONSCIOUS
More informationAssessment of a Chief Complaint Based Curriculum for Resident Education in Geriatric Emergency Medicine
ORIGINAL RESEARCH Assessment of a Chief Complaint Based Curriculum for Resident Education in Geriatric Emergency Medicine Michael C. Wadman, MD* William L. Lyons, MD Lance H. Hoffman, MD* Robert L. Muelleman,
More informationSCOPE OF PRACTICE PGY-4 PGY-5
PGY-4 Examine in a timely fashion inpatients and outpatients, including ER visits, for which rheumatology consultation is requested. Prepare a thorough summary of clinical, serologic and radiographic findings
More informationFor the latest information about departments of internal medicine, please visit APM s website at
APM Perspectives The Association of Professors of Medicine (APM) is the national organization of departments of internal medicine at the US medical schools and numerous affiliated teaching hospitals as
More informationEnglish 10 Writing Assessment Results and Analysis
Academic Assessment English 10 Writing Assessment Results and Analysis OVERVIEW This study is part of a multi-year effort undertaken by the Department of English to develop sustainable outcomes assessment
More informationAC : AN EXAMINATION OF RAPID PROTOTYPING IN DESIGN EDUCATION
AC 2009-2313: AN EXAMINATION OF RAPID PROTOTYPING IN DESIGN EDUCATION Paul Schreuders, Utah State University Scott Greenhalgh, Utah State University Steven Mansfield, Utah State University American Society
More informationPre and Post Liver Transplantation Issues in NAFLD
Pre and Post Liver Transplantation Issues in NAFLD Karim Qumosani MD, PCME, ABIM, FRCPC Multiorgan Transplant Unit University Hospital London Ontario, Canada Financial Disclosures Research Grants Merck,
More informationCollaborative Research Strategy in. Nova Scotia. Tara Sampalli. May 17, Presenter:
Cape Breton Highlands Collaborative Research Strategy in May 17, 2018 Presenter: Tara Sampalli Nova Scotia Director of Research and Innovation, Primary Health Care and Chronic Disease Management Assistant
More informationExamining assisted living residents participation in a group-based art therapy program
Winthrop University Digital Commons @ Winthrop University Winthrop Faculty and Staff Publications Fall 10-15-2015 Examining assisted living residents participation in a group-based art therapy program
More informationEvaluating the Assessments in an Orthopaedic Residency Program
Evaluating the Assessments in an Orthopaedic Residency Program by Nicholas Carl Smith MD A Thesis submitted to the School of Graduate Studies in partial fulfillment of the requirements for the degree of
More informationPre-Clerkship Observerships to Increase Early Exposure to Geriatric Medicine
ORIGINAL RESEARCH Pre-Clerkship Observerships to Increase Early Exposure to Geriatric Medicine Peng You, BHSc 1, Marie Leung, BSc 1, Victoria Y. Y. Xu, BHSc 1, Alexander Astell, BSc 1, Sudeep S. Gill,
More informationCompetence by Design. Kenneth A. Harris, MD FRCSC Deputy CEO & Executive Director, Office of Specialty Education February 3, 2016
Competence by Design Kenneth A. Harris, MD FRCSC Deputy CEO & Executive Director, Office of Specialty Education February 3, 2016 The best health for all. The best care for all. Discussion Topics Overview
More informationLinking Curriculum and Assessment in a Competency-based Residency Training Program. Copyright 2011 The College of Family Physicians of Canada
Linking Curriculum and Assessment in a Competency-based Residency Training Program Copyright 2011 The College of Family Physicians of Canada Objective Explain the integration of: - CanMEDS-FM* - Domains
More informationEntrustable Professional Activities and Trainee Evaluation in Competency-Based Geriatric Psychiatry Training
Entrustable Professional Activities and Trainee Evaluation in Competency-Based Geriatric Psychiatry Training Robert Madan MD FRCPC, Geriatric Psychiatrist Baycrest, University of Toronto Faculty/Presenter
More informationLEVEL ONE MODULE EXAM PART TWO [Reliability Coefficients CAPs & CATs Patient Reported Outcomes Assessments Disablement Model]
1. Which Model for intraclass correlation coefficients is used when the raters represent the only raters of interest for the reliability study? A. 1 B. 2 C. 3 D. 4 2. The form for intraclass correlation
More informationAddressing the Challenges of Serogroup B Meningococcal Disease Outbreaks on Campuses
Addressing the Challenges of Serogroup B Meningococcal Disease Outbreaks on Campuses Monday, November 17, 2014 12:00 PM ET This activity is supported by an unrestricted educational grant from Novartis
More informationClassroom Walkthroughs with H.E.A.T. NOVEMBER 2012 Summary
Classroom Walkthroughs with H.E.A.T. NOVEMBER 2012 Summary The LoTi Sample School District is currently in its 1st A.) The survey is available for teachers to complete year of implementing the Classroom
More informationChapter 9. Ellen Hiemstra Navid Hossein pour Khaledian J. Baptist M.Z. Trimbos Frank Willem Jansen. Submitted
Chapter Implementation of OSATS in the Residency Program: a benchmark study Ellen Hiemstra Navid Hossein pour Khaledian J. Baptist M.Z. Trimbos Frank Willem Jansen Submitted Introduction The exposure to
More informationFELLOWSHIP in CEREBROVASCULAR SURGERY and SKULL BASE SURGERY
FELLOWSHIP in CEREBROVASCULAR SURGERY and SKULL BASE SURGERY Type of Fellowship: Clinical fellowship in cerebrovascular and skull base surgery Supervisors & Teaching Faculty: Dr Prof. David Sinclair, MD,
More informationEstablishing Interrater Agreement for Scoring Criterion-based Assessments: Application for the MEES
Establishing Interrater Agreement for Scoring Criterion-based Assessments: Application for the MEES Mark C. Hogrebe Washington University in St. Louis MACTE Fall 2018 Conference October 23, 2018 Camden
More informationPrinciples of Assessment: A Primer for Medical Educators in the Clinical Years
ISPUB.COM The Internet Journal of Medical Education Volume 1 Number 1 Principles of Assessment: A Primer for Medical Educators in the Clinical Years A Vergis, K Hardy Citation A Vergis, K Hardy.. The Internet
More informationA Coding System to Measure Elements of Shared Decision Making During Psychiatric Visits
Measuring Shared Decision Making -- 1 A Coding System to Measure Elements of Shared Decision Making During Psychiatric Visits Michelle P. Salyers, Ph.D. 1481 W. 10 th Street Indianapolis, IN 46202 mpsalyer@iupui.edu
More informationStructured Training and Assessment: United Kingdom Perspective. Prof Maggie Cruickshank Past President of BSCCP University of Aberdeen Aberdeen UK
Structured Training and Assessment: United Kingdom Perspective Prof Maggie Cruickshank Past President of BSCCP University of Aberdeen Aberdeen UK Disclosures No financial relationships or conflict of interest
More informationHow Do We Assess Students in the Interpreting Examinations?
How Do We Assess Students in the Interpreting Examinations? Fred S. Wu 1 Newcastle University, United Kingdom The field of assessment in interpreter training is under-researched, though trainers and researchers
More informationFREQUENTLY ASKED QUESTIONS Naturopathic Profession Regulation Proposed Key Elements
FREQUENTLY ASKED QUESTIONS Naturopathic Profession Regulation Proposed Key Elements July 2016 PROPOSED KEY ELEMENTS Q. What are key elements? A. Key elements cover the most important parts of the proposed
More informationEastern Mediterranean Health Journal, Vol. 11, No. 3,
Eastern Mediterranean Health Journal, Vol. 11, No. 3, 2005 349 Validity and reliability of the Persian translation of the SF-36 version 2 questionnaire N. Motamed, 1 A.R. Ayatollahi, 2 N. Zare 2 and A.
More informationA Research Program on Rapid Reviews
A Research Program on Rapid Reviews Andrea C. Tricco MSc, PhD Twitter: @ATricco Scientist, Knowledge Translation Program, Li Ka Shing Knowledge Institute of St. Michael s Hospital Co-Director, Queen's
More informationScaling the quality of clinical audit projects: a pilot study
International Journal for Quality in Health Care 1999; Volume 11, Number 3: pp. 241 249 Scaling the quality of clinical audit projects: a pilot study ANDREW D. MILLARD Scottish Clinical Audit Resource
More informationon Ethics, Work and Public Service
photo : istock photo /rené mansi s y m p o s i u m on Ethics, Work and Public Service January 30 th and 31 st 2009 The subjective dimensions of decision-making and work in the public service: between ethical
More informationCombined Milestones in Med-Peds
Making It Count Twice: Combined Milestones in Med-Peds Emily Machogu, MD Anna Volerman, MD Michael Aylward, MD Benjamin Kinnear, MD Objectives Analyze current use of combined or mapped milestones in Med-Peds
More informationUsing Standard and Asymmetric Confidence Intervals. Utilisation d intervalles de confiance standards et asymétriques. Christopher J.
Using Standard and Asymmetric Confidence Intervals Utilisation d intervalles de confiance standards et asymétriques KEY WORDS CONFIDENCE INTERVAL MEASUREMENT ERROR CONSISTENCY COEFFICIENT AGREEMENT COEFFICIENT
More informationProspective Comparison of Live Evaluation and Video Review in the Evaluation of Operator Performance in a Pediatric Emergency Airway Simulation
Prospective Comparison of Live Evaluation and Video Review in the Evaluation of Operator Performance in a Pediatric Emergency Airway Simulation Joseph B. House, MD Suzanne Dooley-Hash, MD Terry Kowalenko,
More informationCredentialing with Simulation
Credentialing with Simulation PP Chen COS, Department Anaesthesiology & Operating Services North District Hospital & Alice Ho Miu Ling Nethersole Hospital Director, NTE Simulation & Training Centre Outline
More informationA laboratory study on the reliability estimations of the mini-cex
Adv in Health Sci Educ (2013) 18:5 13 DOI 10.1007/s10459-011-9343-y A laboratory study on the reliability estimations of the mini-cex Alberto Alves de Lima Diego Conde Juan Costabel Juan Corso Cees Van
More information