Questionnaire Development and Testing. Barbara J. Stussman Survey Statistician NIH/NCCAM
|
|
- Eric Carter
- 6 years ago
- Views:
Transcription
1 Questionnaire Development and Testing Barbara J. Stussman Survey Statistician NIH/NCCAM
2 Acknowledgments Gordon Willis, Ph.D. Applied Research Program, NCI William Riley, Ph.D. Chief, Science of Research and Technology Branch, NCI
3 Outline of Lecture Self report measures Data collection methods Main questionnaire development steps 1. Determine analytic objectives/topic areas 2. Put together draft questionnaire 3. Cognitive testing and examples of common questionnaire problems 4. Field pretesting 5. Psychometrics 6. Translation Mixed Methods
4 Data Sources for Health Research Birth and death records Medical records at physician offices, hospitals, nursing homes, etc. Medical databases housed within various agencies, universities, and insurance companies Physical exams and laboratory testing Registers of diseases Self-report measures such as interviews and questionnaires
5 Self-Report Measures Some information can be gathered only by asking people questions (i.e. not easily observable) Self report measures are estimates of true scores True score + Measurement error = Survey response
6 What are the Pitfalls of Self-Report? Susceptible to the respondent s Mood Motivation Memory Understanding
7 What are the Pitfalls of Self-Report? Also susceptible to: Context circumstances of interview Social desirability choosing answers that are viewed favorably Thus, importance of rigorous methods
8 Common Types of Questions Open-ended What health conditions do you have? Closed Which of the following conditions do you currently have? Say yes or no to each. Diabetes? Asthma? Hypertension?
9 Common Types of Questions Response options Nominal unordered response categories (e.g. male, female) Ordinal ordered response categories (e.g. excellent, good, fair, poor) Type of information Factual objectively verifiable facts and events Subjective knowledge, perceptions, feelings, judgment
10 Outline of Lecture Self report measures Data collection methods Main questionnaire development steps 1. Determine analytic objectives/topic areas 2. Put together draft questionnaire 3. Cognitive testing and examples of common questionnaire problems 4. Field pretesting 5. Psychometrics 6. Translation Mixed Methods
11 DATA COLLECTION METHODS Interviewer Administered (Human) Self Administered Interactive Voice Response Computerized Surveys/ Electronic Data Capture In-person Telephone Web Smartphone Tablet Telephone Web Traditional Paper Surveys In-person Telephone Paper Not applicable
12 Computerized Surveys Pros Faster data availability Can handle complex skip patterns
13 Skip Patterns Have you ever had asthma? YES NO END Have you had an asthma attack in the past 12 months? YES NO END How many times have you gone to the emergency room because of asthma?
14 Computerized Surveys Pros Can handle complex skip patterns Can help to eliminate skip errors (but not always) Can be tailored to severity of symptoms or situation (computerized adaptive testing)
15 Computerized Surveys Cons Data can get lost if system crashes Requires power source
16 In-Person Interviewer Administered Pros Answer respondent questions, probe for adequate answers Administer to illiterate/low reading level Easier to reach poor, homeless, etc. Build rapport People feel more anonymous Can use visual aids
17
18
19 In-Person Interviewer Administered Cons Expensive Longer data collection period Interviewer presence/technique can bias results
20 Telephone Interviewer Administered Pros Lower Costs Can ensure uniform data collection Shorter data collection period Cell phones are best way to reach transient people
21 Telephone Interviewer Administered Cons Omit persons without phones 4 in 10 adults are cell phone only in U.S. Need complex statistical framework Cannot use visual aids Many of us do not answer our phone
22 Paper and Pen Self-Administration Pros Anonymity Can use longer, more complex response categories Can use visual aids Consistent across respondents Cover large geographic area Length easy to see (plus or minus?)
23 Paper and Pen Self-Administration Cons Good reading and writing skills required Cannot have complex skip patterns No quality control Similar cost and response rates to other methods
24 Web/Smartphone/Tablet Self-Administration Pros Anonymity Better for sensitive items Timely data Lower cost Can use long list of response categories Can use visual aids Any time/location Cover large geographic area Can use complex skip patterns
25 Web/Smartphone/Tablet Self-Administration Cons Varying degrees of computer skills, access, connection speeds, configurations Challenge to verify informed consent Concern about multiple responses from same person Difficult to track non-responders Could be biased sample
26 Effects of Data Collection Method Multiple methods increase response rates but at what cost? Aural vs. Visual (Interviewer vs. selfresponse) Aural more positive How would you describe your health, would you say excellent, good, fair or poor? Aural give more agreeable answers
27 Effects of Data Collection Method Questions often tailored to mode Yes/No popular with telephone; Long list of check boxes popular for web Long scales often used for selfadministered; shorter scales for telephone Vast array of visual/graphic choices available for computerized surveys
28 Outline of Lecture Self report measures Data collection methods Main questionnaire development steps 1. Determine analytic objectives/topic areas 2. Put together draft questionnaire 3. Cognitive testing and examples of common questionnaire problems 4. Field pretesting 5. Psychometrics 6. Translation Mixed Methods
29 Outline of Lecture Self report measures Data collection methods Main questionnaire development steps 1. Determine analytic objectives/topic areas 2. Put together draft questionnaire 3. Cognitive testing and examples of common questionnaire problems 4. Field pretesting 5. Psychometrics 6. Translation Mixed Methods
30 Main Development Steps: 1. Determine Analytic Objectives/Topic Areas What are the general concepts to be covered/research questions? Literature review, expert panels, think tanks, patient input, focus groups, etc. Do not forget the patient s perspective
31 1. Determine Analytic Objectives/Topic Areas What Type of Data Will Answer the Research Question? % of respondents who used yoga in past 12 months % who took a yoga class in past 12 months % who had insurance coverage for cost of yoga class Men (X%) Women (X%) (X%) (X%) (X%) (X%)
32 Outline of Lecture Self report measures Data collection methods Main questionnaire development steps 1. Determine analytic objectives/topic areas 2. Put together draft questionnaire 3. Cognitive testing and examples of common questionnaire problems 4. Field pretesting 5. Psychometrics 6. Translation Mixed Methods
33 Main Development Steps: 2. Put Together Draft Questionnaire Use existing instruments when possible National Field Surveys (e.g. NHIS, NHANES, National Health Service) Patient Reported Outcomes Measurement Information System (PROMIS) REDCap (Shared Library of data collection instruments) Pay attention to aesthetics Draft new questions using known criteria
34 How Do You Write a Question? Put together draft questionnaire Literacy < 9 th grade U.S. Specific better than broad Capturing what researcher intended Culturally sensitive Scales consistent Terms defined
35 How Do I Write a Question? Put together draft questionnaire Multiple concepts separated into single items Instructions clear Interpreted accurately by range of demographic groups Response options match question Reference periods clear
36 How Do We Write a Question? Put together draft questionnaire Avoid Social desirability effects Negative wording Double barreled Jargon Ambiguous Leading
37 Outline of Lecture Self report measures Data collection methods Main questionnaire development steps 1. Determine analytic objectives/topic areas 2. Put together draft questionnaire 3. Cognitive testing and examples of common questionnaire problems 4. Field pretesting 5. Psychometrics 6. Translation Mixed Methods
38 Main Development Steps: 3. Cognitive Testing Cognitive Testing Technique to study the way in which respondents understand, process, and respond to survey questions Probing techniques to determine how respondents interpret the questions
39 Cognitive Testing All components tested (stem, response categories, instructions, question ordering, etc.) Qualitative analysis performed to find common themes Often performed in laboratory by trained research team with discussion of findings Sometimes beneficial to go to the respondents (hard to reach populations)
40 Cognitive Testing Participants based on target population Participants start to lose focus after about 1 hour Participants usually paid
41 Cognitive Testing Iterative Process Test questionnaire Modify based on cognitive testing Goal Find and fix sources of Response Error
42 Sources of Response Error Respondent does not know the information They cannot recall it, although they do know it They do not understand the question They do not want to report the answer in the survey context (See Fowler F. (1991). Survey Research Methods, Sage)
43 Possible Actions Taken Based on Semi- Structured/Cognitive Interviews Accept original question Accept original question with minor edits Accept original question with major edits Drop question/draft new question
44 Examples of common questionnaire Original problems: Too Broad Do you think there is scientific evidence showing that SOME alternative therapies do the following? Please say yes or no to each. (1) Improve overall health and wellness (2) Prevent illnesses or diseases (3) Reduce pain (4) Treat or cure illnesses or diseases
45 Examples of common questionnaire problems: Too Broad Final Please tell me the reasons why you have never used [acupuncture, chiropractic, etc.]? [List is provided]
46 Examples of common questionnaire problems: Too Complex Original During the past 30 days did you use any of the following vitamins and minerals for your own health or treatment? Be sure to include ALL vitamins that you use. If you take a SINGLE vitamin or mineral supplement, such as niacin, that is not part of a combination multivitamin/mineral supplement, include it separately.
47 Examples of common questionnaire problems: Too Complex Final The next questions are about any vitamins and minerals you may take. Have you ever taken any vitamins or minerals listed on this card?
48 Examples of common questionnaire problems: Double-barreled Original What was the reason you chose to use acupuncture was it to treat a specific health problem or just to stay healthy or well?
49 Examples of common questionnaire problems: Double-barreled Final Did you use acupuncture for any of these reasons? Please say yes or no to each. For general wellness or general disease prevention? For one or more specific health problems, symptoms, or conditions?
50 Examples of common questionnaire problems: Information Unknown Questions dropped Do you currently see a practitioner for homeopathy more, less, or about the same as you did one year ago? At what age did you first start using [complementary therapy]? During the past 12 months, did your child pray for his/her own health?
51 Examples of common questionnaire problems: Terms Undefined Original During the past 12 months did you use movement therapies for your own health or treatment?
52 Examples of common questionnaire Final problems: Terms Undefined Have you ever practiced any of the following movement or exercise techniques? Alexander Technique? Feldenkrais? Pilates? Trager Psychophysical Integration?
53 Examples of common questionnaire problems: Cultural salience Have you ever switched from a stronger to a lighter cigarette? (Original) During the past 12 months, did you see a practitioner for/use [therapy] because it is how you were raised? (Final) During the past 12 months, did you see a practitioner for/use [therapy] because it was part of your upbringing?
54 Examples of common questionnaire problems: Inconsistent response options 10-fold increase in children reported to have cerebral palsy cases in cases in 2003 Caused by interviewer error when survey moved to new screen design
55 Looking at this list, has a doctor or other health professional ever told you that {child name} had any of these conditions? (00) None (01) Down s syndrome (02) Cerebral Palsy (03) Muscular Dystrophy (04) Cystic Fibrosis (05) Sickle cell anemia (06) Autism (07) Diabetes (08) Arthritis (09) Congenital heart disease (10) Other heart condition
56 Examples of common questionnaire problems: Ordering effects Original Have you ever had a sigmoidoscopy? When was your most recent? Have you ever had a colonoscopy? When was your most recent?
57 Examples of common questionnaire problems: Ordering effects Final Have you ever had a colonoscopy? When was your most recent? Have you ever had a sigmoidoscopy? When was your most recent?
58 Pay Attention to Length Ideally <= 30 minutes for face-to-face <=15 minutes for phone or web Too long will increase costs, decrease response rates Interviewers will rush; respondents will get tired, be less careful Keystroke data have shown cheating
59 Outline of Lecture Self report measures Data collection methods Main questionnaire development steps 1. Determine analytic objectives/topic areas 2. Put together draft questionnaire 3. Cognitive testing and examples of common questionnaire problems 4. Field pretesting 5. Psychometrics 6. Translation Mixed Methods
60 Main Development Steps: 4. Field Pretesting Realistic survey setting to evaluate process (aim for 200 cases) For Interviewer-administered surveys Experienced interviewers use near final instrument Interviewer/observer rating forms Debriefing
61 Field Pretesting For Self-administered surveys Interview respondents after they complete survey Observe respondents as they fill out survey
62 Tabulated data Field Pretesting Analyze response distributions Design closed response categories from open-ended questions Collapse/eliminate response categories Alter skip patterns Drop items
63 Outline of Lecture Self report measures Data collection methods Main questionnaire development steps 1. Determine analytic objectives/topic areas 2. Put together draft questionnaire 3. Cognitive testing and examples of common questionnaire problems 4. Field pretesting 5. Psychometrics 6. Translation Mixed Methods
64 Main Development Steps: 5. Psychometrics Quantitative methods to statistically assess the reliability and validity of survey instruments; also a way to establish scoring mechanisms Enables users to combine a set of items and come up with a single score (e.g. level of depression or physical functioning)
65 Psychometrics Usually done after a large scale field test (larger instruments require larger sample) Classical Test Theory (Old science) Requires the use of EVERY item in a set Modern Test Theory (Current standard) Focuses on contribution of each individual item in a set
66 Psychometrics Item response theory (IRT) Focus on contribution of SINGLE items. To what extent does each item measure the underlying construct?
67 In the past 7 days, I felt Unhappy Never Never Never Rarely Rarely Sometimes Sometimes Often Often Always I had no reason Never Never Never Never Never Never Rarely Sometimes Often Always for living
68 Psychometrics Differential item functioning (DIF) detects error related to subgroups of people Identify items that introduce bias (Example I cry easily )
69 Psychometrics Karon Cook, PhD Psychometrician/Outcomes Researcher Research Professor in Medical Sciences Northwestern University Feinberg School of Medicine, Chicago, IL Youtube video on Modern Response Theory http// q8m
70 Computerized Adaptive Testing Combines item response theory (IRT) and computer technology Question selected based on person s response to previous questions Reduces number of questions People near top or bottom of scale receive items appropriate to them
71 Outline of Lecture Self report measures Data collection methods Main questionnaire development steps 1. Determine analytic objectives/topic areas 2. Put together draft questionnaire 3. Cognitive testing and examples of common questionnaire problems 4. Field pretesting 5. Psychometrics 6. Translation Mixed Methods
72 6. Translation PROMIS Approach One version for multiple countries Allows comparisons across subgroups Translators from different regions and dialects Avoid colloquial expressions Pre-test questionnaire with participants from relevant regions
73 Outline of Lecture Self report measures Data collection methods Main questionnaire development steps 1. Determine analytic objectives/topic areas 2. Put together draft questionnaire 3. Cognitive testing and examples of common questionnaire problems 4. Field pretesting 5. Psychometrics 6. Translation Mixed Methods
74 Mixed Methods Integrating or combining qualitative and quantitative methods to draw on strengths of each Reasons for using mixed methods View problems from multiple perspectives Contextualize information Develop more complete understanding of problem Challenges Teamwork, resources, sample size, interpretation
75 Basic Mixed Methods Designs Qualitative Quantitative qualitative used to develop outcome measure or intervention Quantitative Qualitative qualitative used to explain quantitative outcomes in-depth Concurrent Qualitative used to understand participant s experiences with intervention/describe process
76 Mixed Methods - Examples Nutting et al. (2002) Why are primary care physicians and nurses unable to initiate depression treatment in their practices? 1. Interviewed 12 physicians and 6 nurse managers 2. Developed checklist of barriers physicians completed checklist for 64 patients 4. Cluster analysis identified groups of patients with common barrier profiles
77 Nutting et. al. (2002) Results: Cluster Domains Patient resistant to diagnosis or treatment Patient noncompliant with visits Physician judgment overrules guidelines Patient has psychosocial problems and limited access to care System barriers
78 Mixed Methods - Examples Patient Reported Outcomes Measurement Information System (PROMIS) Developed measures of patient-reported health status for physical, mental, and social well-being Expert review focus groups cognitive testing field to representative sample psychometrics
79 Mixed Methods - Examples Clinical practice setting Use qualitative component to understand quantitative data Study at NIH Clinical Center on persons with and without Fibromyalgia
80 Mixed Methods - Examples Brain imaging study where patients are given heat probes and asked to rate their level of pain Qualitative component added to learn how patient s determine pain ratings Looking for differences between FM patients and healthy patients
81 Suggested Resources Cognitive Interviewing (Willis, 2005/Sage) Survey Research Methods (Fowler, 2014/Sage) Designing and Conducting Mixed Methods Research (Creswell and Clark, 2007/Wiley) Mail and Web Surveys (Dillman, 2007/Wiley)
82 Useful Web Resources Question Appraisal System (Willis & Lessler, 1999) (appliedresearch.cancer.gov/areas/ cognitive/qas99.pdf) Patient Reported Outcomes Measurement Information System (PROMIS) ( PROMIS Assessment Center https//
83 Useful Web Resources Youtube video on Modern Response Theory ( lmyq8m) United Health Service Surveys (U.K.) ( Centers for Disease Control and Prevention (CDC) Surveys ( REDCap Shared Library (
84 Questions?
Questionnaire Development and Testing. Acknowledgments. Outline of Lecture. Barbara J. Stussman Survey Statistician NIH/NCCAM
Questionnaire Development and Testing Barbara J. Stussman Survey Statistician NIH/NCCAM Acknowledgments Gordon Willis, Ph.D. Applied Research Program, NCI William Riley, Ph.D. Chief, Science of Research
More informationQuestionnaire Development and Testing Barbara J. Stussman Survey Statistician NIH/NCCAM
Questionnaire Development and Testing Barbara J. Stussman Survey Statistician NIH/NCCAM Acknowledgments Gordon Willis, Ph.D. Applied Research Program, NCI William Riley, Ph.D. Chief, Science of Research
More informationQuestionnaire Development and Testing. Acknowledgments. Outline of Lecture. Barbara J. Stussman Survey Statistician NIH/NCCIH
Questionnaire Development and Testing Barbara J. Stussman Survey Statistician NIH/NCCIH Acknowledgments Gordon Willis, Ph.D. Applied Research Program, NCI William T. Riley, Ph.D. Director Office of Behavioral
More informationDeveloping and Testing Survey Items
Developing and Testing Survey Items William Riley, Ph.D. Chief, Science of Research and Technology Branch National Cancer Institute With Thanks to Gordon Willis Contributions to Self-Report Errors Self-report
More informationUtilizing the NIH Patient-Reported Outcomes Measurement Information System
www.nihpromis.org/ Utilizing the NIH Patient-Reported Outcomes Measurement Information System Thelma Mielenz, PhD Assistant Professor, Department of Epidemiology Columbia University, Mailman School of
More informationINTRODUCTION TO QUESTIONNAIRE DESIGN October 22, 2014 Allyson L. Holbrook
INTRODUCTION TO QUESTIONNAIRE DESIGN October 22, 2014 Allyson L. Holbrook www.srl.uic.edu General information Please hold questions until the end of the presentation Slides available at www.srl.uic.edu/seminars/fall14seminars.htm
More informationDOING SOCIOLOGICAL RESEARCH C H A P T E R 3
DOING SOCIOLOGICAL RESEARCH C H A P T E R 3 THE RESEARCH PROCESS There are various methods that sociologists use to do research. All involve rigorous observation and careful analysis These methods include:
More informationSLEEP DISTURBANCE ABOUT SLEEP DISTURBANCE INTRODUCTION TO ASSESSMENT OPTIONS. 6/27/2018 PROMIS Sleep Disturbance Page 1
SLEEP DISTURBANCE A brief guide to the PROMIS Sleep Disturbance instruments: ADULT PROMIS Item Bank v1.0 Sleep Disturbance PROMIS Short Form v1.0 Sleep Disturbance 4a PROMIS Short Form v1.0 Sleep Disturbance
More informationPROMIS Overview: Development of New Tools for Measuring Health-related Quality of Life and Related Outcomes in Patients with Chronic Diseases
PROMIS Overview: Development of New Tools for Measuring Health-related Quality of Life and Related Outcomes in Patients with Chronic Diseases William Riley, Ph.D. National Heart, Lung, and Blood Institute
More informationComplementary, Alternative, or Integrative Health: What s In a Name?
Complementary, Alternative, or Integrative Health: What s In a Name? Complementary and alternative medicine, complementary medicine, alternative medicine, integrative medicine we have all seen these terms
More informationPHYSICAL STRESS EXPERIENCES
PHYSICAL STRESS EXPERIENCES A brief guide to the PROMIS Physical Stress Experiences instruments: PEDIATRIC PROMIS Pediatric Bank v1.0 - Physical Stress Experiences PROMIS Pediatric Short Form v1.0 - Physical
More informationMEANING AND PURPOSE. ADULT PEDIATRIC PARENT PROXY PROMIS Item Bank v1.0 Meaning and Purpose PROMIS Short Form v1.0 Meaning and Purpose 4a
MEANING AND PURPOSE A brief guide to the PROMIS Meaning and Purpose instruments: ADULT PEDIATRIC PARENT PROXY PROMIS Item Bank v1.0 Meaning and Purpose PROMIS Short Form v1.0 Meaning and Purpose 4a PROMIS
More informationINTRODUCTION TO ASSESSMENT OPTIONS
ASTHMA IMPACT A brief guide to the PROMIS Asthma Impact instruments: PEDIATRIC PROMIS Pediatric Item Bank v2.0 Asthma Impact PROMIS Pediatric Item Bank v1.0 Asthma Impact* PROMIS Pediatric Short Form v2.0
More informationThe Origins and Promise of PROMIS Patient Reported Outcomes Measurement Information System
The Origins and Promise of PROMIS Patient Reported Outcomes Measurement Information System Gene A. Kallenberg, MD Professor and Chief, Division of Family Medicine Director, UCSD Center for Integrative
More informationABOUT PHYSICAL ACTIVITY
PHYSICAL ACTIVITY A brief guide to the PROMIS Physical Activity instruments: PEDIATRIC PROMIS Pediatric Item Bank v1.0 Physical Activity PROMIS Pediatric Short Form v1.0 Physical Activity 4a PROMIS Pediatric
More informationPHYSICAL FUNCTION A brief guide to the PROMIS Physical Function instruments:
PROMIS Bank v1.0 - Physical Function* PROMIS Short Form v1.0 Physical Function 4a* PROMIS Short Form v1.0-physical Function 6a* PROMIS Short Form v1.0-physical Function 8a* PROMIS Short Form v1.0 Physical
More informationFATIGUE. A brief guide to the PROMIS Fatigue instruments:
FATIGUE A brief guide to the PROMIS Fatigue instruments: ADULT ADULT CANCER PEDIATRIC PARENT PROXY PROMIS Ca Bank v1.0 Fatigue PROMIS Pediatric Bank v2.0 Fatigue PROMIS Pediatric Bank v1.0 Fatigue* PROMIS
More informationPSYCHOLOGICAL STRESS EXPERIENCES
PSYCHOLOGICAL STRESS EXPERIENCES A brief guide to the PROMIS Pediatric and Parent Proxy Report Psychological Stress Experiences instruments: PEDIATRIC PROMIS Pediatric Item Bank v1.0 Psychological Stress
More informationPatient Reported Outcomes (PROs) Tools for Measurement of Health Related Quality of Life
Patient Reported Outcomes (PROs) Tools for Measurement of Health Related Quality of Life David Victorson, Ph.D. Assistant Professor Department of Medical Social Sciences Northwestern University Feinberg
More informationExploring a Method to Evaluate Survey Response Scales
Exploring a Method to Evaluate Survey Response Scales René Bautista 1, Lisa Lee 1 1 NORC at the University of Chicago, 55 East Monroe, Suite 2000, Chicago, IL 60603 Abstract We present results from a qualitative
More informationANXIETY A brief guide to the PROMIS Anxiety instruments:
ANXIETY A brief guide to the PROMIS Anxiety instruments: ADULT PEDIATRIC PARENT PROXY PROMIS Pediatric Bank v1.0 Anxiety PROMIS Pediatric Short Form v1.0 - Anxiety 8a PROMIS Item Bank v1.0 Anxiety PROMIS
More informationPAIN INTERFERENCE. ADULT ADULT CANCER PEDIATRIC PARENT PROXY PROMIS-Ca Bank v1.1 Pain Interference PROMIS-Ca Bank v1.0 Pain Interference*
PROMIS Item Bank v1.1 Pain Interference PROMIS Item Bank v1.0 Pain Interference* PROMIS Short Form v1.0 Pain Interference 4a PROMIS Short Form v1.0 Pain Interference 6a PROMIS Short Form v1.0 Pain Interference
More informationCancer and CAM. Key Points. 1. What is complementary and alternative medicine?
Cancer and CAM Key Points Complementary and alternative medicine (CAM) is a group of diverse medical and health care systems, practices, and products that are not presently considered to be part of conventional
More informationIntroduction to Survey Research. Clement Stone. Professor, Research Methodology.
Clement Stone Professor, Research Methodology Email: cas@pitt.edu 1 Presentation Outline What is survey research and when is it used? Stages of survey research 1. Specifying research questions, target
More informationThe Use of Complementary and Alternative Medicine in Australia Charlie Changli Xue, Lin Zhang, Vivian Lin and David F. Story
The Use of Complementary and Alternative Medicine in Australia Charlie Changli Xue, Lin Zhang, Vivian Lin and David F. Story Despite apparent high usage of complementary and alterative medicine (CAM) and
More informationStressors that Contribute to Emergency Service Use in Persons with IDD and Mental Health Needs
Stressors that Contribute to Emergency Service Use in Persons with IDD and Mental Health Needs Joan B. Beasley, Ph.D. Research Associate Professor Director, Center for START Services University of New
More informationINTRODUCTION TO ASSESSMENT OPTIONS
DEPRESSION A brief guide to the PROMIS Depression instruments: ADULT ADULT CANCER PEDIATRIC PARENT PROXY PROMIS-Ca Bank v1.0 Depression PROMIS Pediatric Item Bank v2.0 Depressive Symptoms PROMIS Pediatric
More informationCOGNITIVE FUNCTION. PROMIS Pediatric Item Bank v1.0 Cognitive Function PROMIS Pediatric Short Form v1.0 Cognitive Function 7a
COGNITIVE FUNCTION A brief guide to the PROMIS Cognitive Function instruments: ADULT PEDIATRIC PARENT PROXY PROMIS Item Bank v1.0 Applied Cognition - Abilities* PROMIS Item Bank v1.0 Applied Cognition
More informationINTRODUCTION TO HEALTH LITERACY October 12-13, 2016 Milan Rome, Italy
INTRODUCTION TO HEALTH LITERACY October 12-13, 2016 Milan Rome, Italy Peter J. Schulz Institute of Communication & Health Sothern Switzerland University, Lugano, Switzerland Michaela Liuccio Biomedical
More informationPDRF About Propensity Weighting emma in Australia Adam Hodgson & Andrey Ponomarev Ipsos Connect Australia
1. Introduction It is not news for the research industry that over time, we have to face lower response rates from consumer surveys (Cook, 2000, Holbrook, 2008). It is not infrequent these days, especially
More informationIntroducing the OWLQOL and WRSM Instruments
Introducing the OWLQOL and WRSM Instruments Previously developed weight-specific Patient-Reported-Outcome measures (PROs) were either developed for application to more severely obese populations, or without
More informationUse of Mind Body Approaches among US Children Age 4-17 Years: Child Characteristics and Reported Reasons and Benefits for Use
Use of Mind Body Approaches among US Children Age 4-17 Years: Child Characteristics and Reported Reasons and Benefits for Use Data source: 2007 and 2012 National Health Interview Survey (NHIS) and Child
More informationISC- GRADE XI HUMANITIES ( ) PSYCHOLOGY. Chapter 2- Methods of Psychology
ISC- GRADE XI HUMANITIES (2018-19) PSYCHOLOGY Chapter 2- Methods of Psychology OUTLINE OF THE CHAPTER (i) Scientific Methods in Psychology -observation, case study, surveys, psychological tests, experimentation
More informationThe TRUE Guide to Diabetes Care
monitor track manage A TRUEinsight Guide manage The TRUE Guide to Diabetes Care Important Questions and Informative Answers for People With Diabetes A Guide to Diabetes Care You ve been diagnosed with
More informationSurvey research. Survey. A data collection method based on: Survey. Survey. It also comes with shortcomings. In general, survey offers:
Survey Survey research A data collection method based on: asking questions and recording self-reported answers in a structured manner Defined Survey Survey In general, survey offers: Standardized questions
More informationHighlights. Attitudes and Behaviors Regarding Weight and Tobacco. A scientific random sample telephone survey of 956 citizens in. Athens-Clarke County
Highlights Attitudes and Behaviors Regarding Weight and Tobacco A scientific random sample telephone survey of 956 citizens in Athens-Clarke County July 2003 Northeast Health District Community Health
More informationGENERAL SELF-EFFICACY AND SELF-EFFICACY FOR MANAGING CHRONIC CONDITIONS
GENERAL SELF-EFFICACY AND SELF-EFFICACY FOR MANAGING CHRONIC CONDITIONS A brief guide to the PROMIS Self-Efficacy Instruments ADULT PROMIS Item Bank v1.0 General Self-Efficacy PROMIS Short Form v1.0 General
More informationAssessing the Risk: Protecting the Child
Assessing the Risk: Protecting the Child Impact and Evidence briefing Key findings is an assessment service for men who pose a sexual risk to children and are not in the criminal justice system. Interviews
More informationChoosing Life: Empowerment, Action, Results! CLEAR Menu Sessions. Substance Use Risk 5: Drugs, Alcohol, and HIV
Choosing Life: Empowerment, Action, Results! CLEAR Menu Sessions Substance Use Risk 5: This page intentionally left blank. Session Aims: (70 Minutes) To understand the health consequences of drugs and
More informationReal-world data in pragmatic trials
Real-world data in pragmatic trials Harold C. Sox,MD The Patient-Centered Outcomes Research Institute Washington, DC Presenter Disclosure Information In compliance with the accrediting board policies,
More informationModes of Measurement. Outline. Modes of Measurement. PSY 395 Oswald
Modes of Measurement PSY 395 Oswald Outline Modes of Measurement Direct questioning Paper-and-pencil Face-to-face Telephone Interviews Newer Modes Internet Experience Sampling Implicit measures Third-party
More informationTHE PUBLIC AND GENETIC EDITING, TESTING, AND THERAPY
THE PUBLIC AND GENETIC EDITING, TESTING, AND THERAPY January 2016 0 INTRODUCTION A new poll of adults in the United States conducted by STAT and Harvard T.H. Chan School of Public Health shows that Americans
More informationSmoking Social Motivations
Smoking Social Motivations A brief guide to the PROMIS Smoking Social Motivations instruments: ADULT PROMIS Item Bank v1.0 Smoking Social Motivations for All Smokers PROMIS Item Bank v1.0 Smoking Social
More informationCRITICALLY APPRAISED PAPER (CAP)
CRITICALLY APPRAISED PAPER (CAP) Yasukawa, A., Patel, P., & Sisung, C. (2006). Pilot study: Investigating the effects of Kinesio Taping in an acute pediatric rehabilitation setting. American Journal of
More informationMeasuring Patient Health with PROMIS : Applications for Social Integration Research and Care
Measuring Patient Health with PROMIS : Applications for Social Integration Research and Care Ashley Wilder Smith, PhD, MPH Chief, Outcomes Research Branch, NCI, NIH NIH Chief Science Officer, HealthMeasures
More informationMeasuring Fall and Fall-Related Injury Rates and Prevention Practices Presented by Julia Neily, RN, M.S., M.P.H. Veterans Health Administration
Measuring Fall and Fall-Related Injury Rates and Prevention Practices Presented by Julia Neily, RN, M.S., M.P.H. Veterans Health Administration National Center for Patient Safety Welcome! Thank you for
More informationOVERVIEW OF QUALITATIVE AND MIXED METHODS RESEARCH. Elyse R. Park, Ph.D., M.P.H Director, Qualitative Research Core MGH Division of Clinical Research
OVERVIEW OF QUALITATIVE AND MIXED METHODS RESEARCH Elyse R. Park, Ph.D., M.P.H Director, Qualitative Research Core MGH Division of Clinical Research INTRODUCTIONS COURSE OVERVIEW Advanced Courses Date
More informationQUESTIONNAIRE USER'S GUIDE
QUESTIONNAIRE USER'S GUIDE OUTBREAK INVESTIGATION Arthur L. Reingold's article "Outbreak Investigations--A Perspective" 1 provides an excellent synopsis of the procedures, challenges, and unique attributes
More informationResearch Questions and Survey Development
Research Questions and Survey Development R. Eric Heidel, PhD Associate Professor of Biostatistics Department of Surgery University of Tennessee Graduate School of Medicine Research Questions 1 Research
More informationUsing mixed methods approach in a health research setting
Using mixed methods approach in a health research setting Dr Caroline Bulsara, School of Primary, Aboriginal and Rural Health Care, University of Western Australia Reasons why people prefer one methodology
More informationAppraising Qualitative Research
Appraising Qualitative Research Robert Hayward Centre for Health Evidence Outline Introduction Objectives Qualitative inquiry Qualitative Research Guides Credibility Applicability Summary Objectives Be
More informationMeasuring impact. William Parienté UC Louvain J PAL Europe. povertyactionlab.org
Measuring impact William Parienté UC Louvain J PAL Europe povertyactionlab.org Course overview 1. What is evaluation? 2. Measuring impact 3. Why randomize? 4. How to randomize 5. Sampling and Sample Size
More informationNational Survey of Young Adults on HIV/AIDS
REPORT National Survey of Young Adults on HIV/AIDS November 2017 Kaiser Family Foundation Introduction More than three and a half decades have passed since the first case of AIDS. An entire generation
More informationMN 400: Research Methods. PART II The Design of Research
MN 400: Research Methods PART II The Design of Research 1 MN 400: Research Methods CHAPTER 6 Research Design 2 What is Research Design? A plan for selecting the sources and types of information used to
More informationANXIETY. A brief guide to the PROMIS Anxiety instruments:
ANXIETY A brief guide to the PROMIS Anxiety instruments: ADULT ADULT CANCER PEDIATRIC PARENT PROXY PROMIS Bank v1.0 Anxiety PROMIS Short Form v1.0 Anxiety 4a PROMIS Short Form v1.0 Anxiety 6a PROMIS Short
More informationTIPSHEET QUESTION WORDING
TIPSHEET QUESTION WORDING What would the perfect survey look like? All questions would measure the concept they intend to measure. No question would erroneously measure unintended concepts. All respondents
More informationAssessment: Interviews, Tests, Techniques. Clinical Psychology Lectures
Lecture 6 Assessment: Interviews, Tests, Techniques Clinical Psychology Lectures Psychodiagnostic Assessment Also termed: personality assessment, diagnostic assessment, pretreatment assessments or psychological
More informationNATIONAL SURVEY OF YOUNG ADULTS ON HIV/AIDS
NATIONAL SURVEY OF YOUNG ADULTS ON HIV/AIDS Kaiser Family Foundation November 30, 2017 Introduction More than three and a half decades have passed since the first case of AIDS. An entire generation has
More informationABOUT SMOKING NEGATIVE PSYCHOSOCIAL EXPECTANCIES
Smoking Negative Psychosocial Expectancies A brief guide to the PROMIS Smoking Negative Psychosocial Expectancies instruments: ADULT PROMIS Item Bank v1.0 Smoking Negative Psychosocial Expectancies for
More informationComparison of Estimates From An Address-Based Mail Survey And A RDD Telephone Survey
Comparison of Estimates From An Address-Based Mail Survey And A RDD Telephone Survey David Cantor Brett McBride Westat Presentation for the International Total Survey Error Workshop, Stowe, VT., June 13
More informationNational Survey of Young Adults on HIV/AIDS
Topline Kaiser Family Foundation National Survey of Young Adults on HIV/AIDS November 30, 2017 The 2017 Kaiser Family Foundation National Survey of Young Adults on HIV/AIDS is based on interviews with
More informationfor DUMMIES How to Use this Guide Why Conduct Research? Research Design - Now What?
EAGALA Research for DUMMIES How to Use this Guide This guide was created for the people who really want to do research, but don t know where to start. It is a general outline created so that those who
More informationNew Technologies and Analytic Techniques for Dietary Assessment
New Technologies and Analytic Techniques for Dietary Assessment Amy F. Subar, PhD, MPH, RD US National Cancer Institute Division of Cancer Control and Population Sciences Risk Factor Monitoring and Methods
More informationIssues in Clinical Measurement
Issues in Clinical Measurement MERMAID Series January 15, 2016 Galen E. Switzer, PhD Clinical and Translational Science Institute University of Pittsburgh What is Measurement? observation of people, clinical
More informationUse of Amazon MTurk Online Marketplace for Questionnaire Testing and Experimental Analysis of Survey Features
Use of Amazon MTurk Online Marketplace for Questionnaire Testing and Experimental Analysis of Survey Features Introduction Stephanie Fowler, PhD, MPH Gordon Willis, PhD Richard Moser, PhD Rebecca Ferrer,
More informationRARE DISEASE WORKSHOP SERIES Improving the Clinical Development Process. Disclaimer:
RARE DISEASE WORKSHOP SERIES Improving the Clinical Development Process Disclaimer: Presentation slides from the Rare Disease Workshop Series are posted by the Kakkis EveryLife Foundation, for educational
More information2010 Community Health Needs Assessment Final Report
2010 Community Health Needs Assessment Final Report April 2011 TABLE OF CONTENTS A. BACKGROUND 3 B. DEMOGRAPHICS 4 C. GENERAL HEALTH STATUS 10 D. ACCESS TO CARE 11 E. DIABETES 12 F. HYPERTENSION AWARENESS
More informationDementia Quality of Life (DEMQOL)
This is a Sample version of the Dementia Quality of Life (DEMQOL) The full version of the Dementia Quality of Life (DEMQOL) comes without sample watermark.. The full complete version includes Overview
More informationSurvey Methods in Relationship Research
Purdue University Purdue e-pubs Department of Psychological Sciences Faculty Publications Department of Psychological Sciences 1-1-2009 Survey Methods in Relationship Research Christopher Agnew Purdue
More informationChoosing Life: Empowerment, Action, Results! CLEAR Menu Sessions. Health Care 3: Partnering In My Care and Treatment
Choosing Life: Empowerment, Action, Results! CLEAR Menu Sessions Health Care 3: Partnering In My Care and Treatment This page intentionally left blank. Session Aims: Partnering In My Care and Treatment
More informationChoosing Life: empowerment, Action, Results! CLEAR Menu Sessions. Adherence 1: Understanding My Medications and Adherence
Choosing Life: empowerment, Action, Results! CLEAR Menu Sessions Adherence 1: Understanding My Medications and Adherence This page intentionally left blank. Understanding My Medications and Adherence Session
More informationGCSE PSYCHOLOGY UNIT 2 FURTHER RESEARCH METHODS
GCSE PSYCHOLOGY UNIT 2 FURTHER RESEARCH METHODS GCSE PSYCHOLOGY UNIT 2 SURVEYS SURVEYS SURVEY = is a method used for collecting information from a large number of people by asking them questions, either
More informationI. Task List INTERVIEWING SKILLS
INTERVIEWING SKILLS Acknowledgement: The majority of this information was abstracted from the training program Foodborne Illness Investigations March 1999 developed by the FDA s State Training Branch.
More informationMethodological Considerations in Using Patient Reported Measures in Dialysis Clinics. Acknowledgements
Methodological Considerations in Using Patient Reported Measures in Dialysis Clinics John D Peipert Ron D Hays Acknowledgements Funding for this work provided by the Kidney Care Quality Alliance 1 Patient
More informationGallup-Palmer College of Chiropractic Annual Report Americans Views of Prescription Pain Medication and Chiropractic Care
Gallup-Palmer College of Chiropractic Annual Report Americans Views of Prescription Pain Medication and Chiropractic Care Table of Contents 4 Copyright Standards 5 Executive Summary 7 Introduction 8 Significant
More informationInterviewing, Structured and Unstructured
Interviewing, Structured and Unstructured Department of Government London School of Economics and Political Science 1 Participant Observation 2 Questionnaire Methods Recall-type Questions Evaluative Questions
More informationAssessing Cultural Competency from the Patient s Perspective: The CAHPS Cultural Competency (CC) Item Set
Assessing Cultural Competency from the Patient s Perspective: The CAHPS Cultural Competency (CC) Item Set Robert Weech-Maldonado Department of Health Services Administration University of Alabama at Birmingham
More informationSurvey Errors and Survey Costs
Survey Errors and Survey Costs ROBERT M. GROVES The University of Michigan WILEY- INTERSCIENCE A JOHN WILEY & SONS, INC., PUBLICATION CONTENTS 1. An Introduction To Survey Errors 1 1.1 Diverse Perspectives
More informationChristine A. Bono, PhD Program Associate. Elizabeth Shenkman, PhD Principal Investigator. October 24, 2003
COMPARING HEALTH CARE OUTCOMES FOR CHILDREN ENROLLED IN THE FLORIDA HEALTHY KIDS PROGRAM AND CARED FOR BY PEDIATRICIANS VS. FAMILY PRACTITIONERS A REPORT PREPARED FOR THE HEALTHY KIDS BOARD OF DIRECTORS
More informationTim Johnson Survey Research Laboratory University of Illinois at Chicago September 2011
Tim Johnson Survey Research Laboratory University of Illinois at Chicago September 2011 1 Characteristics of Surveys Collection of standardized data Primarily quantitative Data are consciously provided
More informationEvidence Informed Practice Online Learning Module Glossary
Term Abstract Associations Attrition Bias Background and Significance Baseline Basic Science Bias Blinding Definition An abstract is a summary of a research article. It usually includes the purpose, methods,
More informationPsychological testing
Psychological testing Lecture 11 Mikołaj Winiewski, PhD Marcin Zajenkowski, PhD Strategies for test development and test item considerations The procedures involved in item generation, item selection,
More informationMEDICAL HISTORY DO YOU HAVE OR HAVE YOU HAD ANY OF THE FOLLOWING PLEASE CHECK ALL THAT APPLY. Patients s Name Date Yes No Yes No
MEDICAL HISTORY DO YOU HAVE OR HAVE YOU HAD ANY OF THE FOLLOWING PLEASE CHECK ALL THAT APPLY Patients s Name Date Yes No Yes No Anemia Arthritis Artificial Joints or Heart Valve Asthma Cancer/tumors Chest
More informationPatient Reported Outcomes in Clinical Research. Overview 11/30/2015. Why measure patientreported
Patient Reported Outcomes in Clinical Research Kevin P. Weinfurt, PhD Introduction to the Principles and Practice of Clinical Research National Institutes of Health November 30, 2015 Overview 1. Why measure
More informationPilot Testing Data Collection Instruments Janine Johal and Walid Sherif
Pilot Testing Data Collection Instruments Janine Johal and Walid Sherif Introduction The Tobacco Control Evaluation Center (TCEC) at the University of California at Davis provides evaluation technical
More informationData Collection Instruments
Data Collection Instruments After the researcher has defined his problem and purpose of the study, stated his hypotheses or research questions and has determined his sample, the next logical steps in the
More informationCRITICALLY APPRAISED PAPER (CAP)
CRITICALLY APPRAISED PAPER (CAP) FOCUSED QUESTION What are the observed effects on pain and fatigue when comparing two occupational therapy activity-pacing interventions in adults with osteoarthritis?
More informationPediatric Dental Clinic David H. Merritt, D.M.D., M.S., P.C. 162 Ana drive Florence, Alabama
Pediatric Dental Clinic David H. Merritt, D.M.D., M.S., P.C. 162 Ana drive 256-766-0270 Father: DOB: SS#: Home Address: Home #: Work #: Cell #: Employed By: Address: Do you have dental insurance? Yes No
More informationA research report of the therapeutic effects of yoga for health and wellbeing Prepared at ScHARR for the British Wheel of Yoga
A research report of the therapeutic effects of yoga for health and wellbeing Prepared at ScHARR for the British Wheel of Yoga About The British Wheel of Yoga The British Wheel of Yoga The British Wheel
More informationConceptual and Practical Issues in Measurement Validity
Conceptual and Practical Issues in Measurement Validity MERMAID Series, December 10, 2010 Galen E. Switzer, PhD Clinical and Translational Science Institute VA Center for Health Equity Research and Promotion
More informationWhat do we want to know when we assess willingness to be vaccinated? How many/what proportion of eligible ibl individuals id will be vaccinated if a v
Assessing willingness to be vaccinated Bonita Stanton, MD Wayne State University Children s Hospital of Michigan What do we want to know when we assess willingness to be vaccinated? How many/what proportion
More informationCLAPA Regional Coordinators Project: Scotland
The Hugh Fraser Foundation Tay Charitable Trust CLAPA Regional Coordinators Project: Scotland Evaluation Interim Report Focus group study in Scotland (Inverness) May 2016 Contributors: Mr Matthew Ridley
More informationAbout this consent form
Protocol Title: Development of the smoking cessation app Smiling instead of Smoking Principal Investigator: Bettina B. Hoeppner, Ph.D. Site Principal Investigator: n/a Description of Subject Population:
More informationVariable Data univariate data set bivariate data set multivariate data set categorical qualitative numerical quantitative
The Data Analysis Process and Collecting Data Sensibly Important Terms Variable A variable is any characteristic whose value may change from one individual to another Examples: Brand of television Height
More informationObservation in Evaluation by Richard Krueger, Ph.D. Professor Emeritus, University of Minnesota, USA Richard A. Krueger, 2017
Observation in Evaluation by Richard Krueger, Ph.D. Professor Emeritus, University of Minnesota, USA Richard A. Krueger, 2017 Observation can be invaluable when conducting an evaluation. Or it can also
More informationConsiderations for requiring subjects to provide a response to electronic patient-reported outcome instruments
Introduction Patient-reported outcome (PRO) data play an important role in the evaluation of new medical products. PRO instruments are included in clinical trials as primary and secondary endpoints, as
More informationWelcome to the Center for Surgical and Medical Weight Loss. Thank you for choosing our Center at Saint Thomas for your weight loss journey.
Welcome to the Center for Surgical and Medical Weight Loss. Thank you for choosing our Center at Saint Thomas for your weight loss journey. Once your initial appointment has been scheduled, you will receive
More informationSAMPLE PATIENT SURVEY QUESTIONNAIRE
This document includes questions you could use- either as a stand alone document or as part of a larger survey- to assess a patient s satisfaction with their contraceptive care experience. --- Patient
More informationPatient-Centered Endpoints in Oncology
Patient-Centered Endpoints in Oncology SIXTH ANNUAL PATIENT-REPORTED OUTCOME CONSORTIUM WORKSHOP April 29-30, 2015 Silver Spring, MD Disclaimer The views and opinions expressed in the following slides
More informationPatient Follow-up Form - Version 1.1
Physician: [Last Name GO PROJECT Patient Follow-up Form - Version 1.1 Thank you for participating in the Glioma Outcomes Project. To continue participating in this important project, complete or correct
More information