Response Scales in CATI Surveys. Interviewers Experience
|
|
- Lillian Webb
- 6 years ago
- Views:
Transcription
1 Response Scales in CATI Surveys. Interviewers Experience Wojciech Jablonski University of Lodz Poland 5th ESRA Conference Ljubljana, Slovenia 17th July 2013
2 AGENDA Introduction Method Results Conclusions Wojciech Jablonski Univ. of Lodz, PL Response Scales in CATI Surveys. Is Experience 2
3 AGENDA Introduction Method Results Conclusions Wojciech Jablonski Univ. of Lodz, PL Response Scales in CATI Surveys. Is Experience 3
4 CATI CHARACTERISTICS There is no visual contact between the interviewer and the respondent its has an impact on the quality of the obtained data (de Leeuw 2002) satisficing (Krosnick 1999) - CATI interviewers are much more constrained than f2f interviewers as far as using visual aids is concerned Wojciech Jablonski Univ. of Lodz, PL Response Scales in CATI Surveys. Is Experience 4
5 CATI CHARACTERISTICS SPECIAL TECHNIQUES keyword summary (Dillman 1978) unfolding (Groves 1979) split questions (Dillman 1978; Dillman et al. 2009) branching (Malhotra, Krosnick & Thomas 2009) end-point only scales (Frey 1989; de Leeuw 2002) / with midpoint (Courser & Lavrakas 2012) pre-categorised questions Wojciech Jablonski Univ. of Lodz, PL Response Scales in CATI Surveys. Is Experience 5
6 RESEARCH QUESTION What are the CATI interviewers opinions and attitudes towards different response scales formats used by survey organizations? We consider the interviewers opinions of an interview to be reliable indicators of the quality of the conversation and the validity of the obtained data Wojciech Jablonski Univ. of Lodz, PL Response Scales in CATI Surveys. Is Experience 6
7 AGENDA Introduction Method Results Conclusion Wojciech Jablonski Univ. of Lodz, PL Response Scales in CATI Surveys. Is Experience 7
8 METHOD Data collection: Nov 2009 Aug major Polish survey research companies 4P research mix ASM ARC Rynek i Opinia Expert-Monitor (at present: Kantar Media) GfK Polonia IMAS International IPSOS IQS Group MillwardBrown SMG/KRC PBS DGA TNS Pentor (at present: TNS Poland) TNS OBOP (at present: TNS Poland) N of cases = 846 interviewer questionnaires & 32 IDIs Wojciech Jablonski Univ. of Lodz, PL Response Scales in CATI Surveys. Is Experience 8
9 AGENDA Introduction Method Results Conclusion Wojciech Jablonski Univ. of Lodz, PL Response Scales in CATI Surveys. Is Experience 9
10 RESULTS ADV/DISADV The job of a telephone interviewer, as any other job, has both disadvantages and advantages. Below there are several features of CATI interviewer s job listed. For each of them, say to what extent you consider it an advantage or a disadvantage. Use the scale of 1 to 5 shown below, where 1 means this feature is a disadvantage and 5 means that it is an advantage. The other values on the scale may be used to express opinions in-between the two extremes. Communication with the respondent is verbal only there is no eye contact 14% 35% 48% disadvantage advantage 3% hard to say Wojciech Jablonski Univ. of Lodz, PL Response Scales in CATI Surveys. Is Experience 10
11 RESULTS GENERAL TRAINING Below is a list of different elements, which make up the general training organised for interviewer candidates. For each of them, state to what extent, in your opinion, is it useful for participants. Use the scale of 1 to 5 shown below, where 1 means this issue is completely redundant (and so there is no point in discussing it) and 5 means it is very useful (and so discussing it is necessary). The other values on the scale may be used to express opinions in-between the two extremes. Information about the types of questions used in CATI scripts 5% 16% 78% redundant necessary element element 1% hard to say Wojciech Jablonski Univ. of Lodz, PL Response Scales in CATI Surveys. Is Experience 11
12 RESULTS GENERAL TRAINING ELEMENT Information about the types of questions used in CATI scripts Information about the research company (outline of the history, scope of operation) NECESSARY (points 4-5) 78% 47% Information about the ESOMAR code regulations 55% Information about the Data Protection Act 65% Information about the methods of sampling in telephone research Information about the methods of selecting respondent within a household 66% 72% Wojciech Jablonski Univ. of Lodz, PL Response Scales in CATI Surveys. Is Experience 12
13 RESULTS PROBLEMS Situation considered to be particularly troublesome: handling respondents who have difficulty in understanding the questions According to the interviewers the questions used in CATI scripts are often formulated using complicated vocabulary and syntax. The questions have not been adapted to suit the intellectual skills of an average respondent Wojciech Jablonski Univ. of Lodz, PL Response Scales in CATI Surveys. Is Experience 13
14 Sometimes questions are so long that when I finish reading them I don t understand what the beginning is. The respondent without written text all the more. RESULTS PROBLEMS Some questions are just too clever. Even when I look through them I have to really get into them. ( ) The questions are not designed for ordinary people but for the ones better educated. Imagine a question in which you have 39 items, an 11 point scale and you must read it 4 times for different companies. It s a nightmare. When you conduct such interviews, you can notice a moment when the respondents let their minds wander, they give answers at random. Wojciech Jablonski Univ. of Lodz, PL Response Scales in CATI Surveys. Is Experience 14
15 RESULTS Is STRATEGIES A majority of interviewers claim that they sometimes deviate from interviewing rules Unfolding questions with semantic (fully-labeled) scales Transforming fully-labeled scales into end-point only scales Transforming check-all-that-apply questions into item-based yes-or-no questions Wojciech Jablonski Univ. of Lodz, PL Response Scales in CATI Surveys. Is Experience 15
16 AGENDA Introduction Method Results Conclusion Wojciech Jablonski Univ. of Lodz, PL Response Scales in CATI Surveys. Is Experience 16
17 CONSLUSION Interviewers demonstrate good methodological intuition they recognize questions that according to professional guidelines should and should not be used in CATI scripts The design of some questions used in CATI scripts do not follow these regulations. As a result, interactional problems between the interviewers and the respondents occur. The interviewers sometimes solve such problems by destandardizing the interview protocol Wojciech Jablonski Univ. of Lodz, PL Response Scales in CATI Surveys. Is Experience 17
18 REFERENCES Courser, M.W., Lavrakas, P.J. (2012). Item Nonresponse and the 10-Point Response Scale in Telephone Surveys. Survey Practice 5(4): 1-5. de Leeuw, E.D. (2002). Data Quality in Mail, Telephone and Face to Face Surveys. Amsterdam: TT-Publikaties. Dillman, D.A. (1978). Mail and Telephone Surveys. The Total Design Method. New York: John Wiley & Sons. Dillman, D.A., Smyth, J.D., Christian, L.M. (2009). Internet, Mail and Mixed-Mode Surveys. The Tailored Design Method. Hoboken: John Wiley & Sons. Frey, J.H. (1989). Survey Research by Telephone. Newbury Park: Sage Publications. Groves, R.M. (1979). Actors and Questions in Telephone and Personal Interview Surveys. Public Opinion Quarterly 43(2): Krosnick, J.A. (1999). Survey Research. Annual Review of Psychology 50: Malhotra, N., Krosnick, J.A., Thomas, R.K. (2009). Optimal Design of Branching Questions to Measure Bipolar Constructs. Public Opinion Quarterly 73(2): Wojciech Jablonski Univ. of Lodz, PL Response Scales in CATI Surveys. Is Experience 18
19 PUBLICATIONS CONCERNING THE PROJECT Jablonski, W. (2012). Stressful Situations in Telephone Interviews. Survey Practice 5(4): Jablonski, W. (2012). CATI Interviewers Job Satisfaction Level. Proceedings of the Survey Research Section of the American Statistical Association: Jablonski, W. (2012). Landline versus Cell Phone Surveys: Interviewers Experience. Proceedings of the ISA RC338th International Conference on Social Science Methodology: Wojciech Jablonski Univ. of Lodz, PL Response Scales in CATI Surveys. Is Experience 19
20 THANK YOU! Wojciech Jablonski Wojciech Jablonski Univ. of Lodz, PL Response Scales in CATI Surveys. Is Experience 20
Landline versus Cell Phone Surveys: Interviewers' Experience
Wojciech Jablonski Department of Social Research Methods & Techniques Institute of Sociology University of Lodz, Poland e-mail: wjablonski@uni.lodz.pl Landline versus Cell Phone Surveys: Interviewers'
More informationINTRODUCTION TO QUESTIONNAIRE DESIGN October 22, 2014 Allyson L. Holbrook
INTRODUCTION TO QUESTIONNAIRE DESIGN October 22, 2014 Allyson L. Holbrook www.srl.uic.edu General information Please hold questions until the end of the presentation Slides available at www.srl.uic.edu/seminars/fall14seminars.htm
More informationEvaluating Questionnaire Issues in Mail Surveys of All Adults in a Household
Evaluating Questionnaire Issues in Mail Surveys of All Adults in a Household Douglas Williams, J. Michael Brick, Sharon Lohr, W. Sherman Edwards, Pamela Giambo (Westat) Michael Planty (Bureau of Justice
More informationItem Nonresponse and the 10-Point Response Scale in Telephone Surveys 1
Vol. 5, no 4, 2012 www.surveypractice.org The premier e-journal resource for the public opinion and survey research community Item Nonresponse and the 10-Point Response Scale in Telephone Surveys 1 Matthew
More informationImproving Response to the American Community Survey (ACS)
Improving Response to the American Community Survey (ACS) For National Academies Workshop on Respondent Burden in the American Community Survey March 8, 2016 By Don A. Dillman, Regents Professor Department
More informationItem-Nonresponse and the 10-Point Response Scale in Telephone Surveys
Vol. 5, Issue 4, 2012 Item-Nonresponse and the 10-Point Response Scale in Telephone Surveys Matthew Courser 1, Paul J. Lavrakas 2 Survey Practice 10.29115/SP-2012-0021 Dec 01, 2012 Tags: measurement error,
More informationGeneral Online Research Conference (GOR 17) March 2017 HTW Berlin University of Applied Sciences Berlin, Germany
General Online Research Conference (GOR 17) 15-17 March 2017 HTW Berlin University of Applied Sciences Berlin, Germany Edith de Leeuw, Utrecht University Joop Hox, Utrecht University Benjamin Rosche, Utrecht
More informationQuestionnaire Design Clinic
Questionnaire Design Clinic Spring 2008 Seminar Series University of Illinois www.srl.uic.edu 1 Cognitive Steps in Answering Questions 1. Understand question. 2. Search memory for information. 3. Integrate
More informationAn Examination of Visual Design Effects in a Self- Administered Mail Survey
An Examination of Visual Design Effects in a Self- Administered Mail Survey Sarah Hastedt 1, Douglas Williams 2, and Catherine Billington, Ph.D. 2 1 National Center for Education Statistics, 1990 K Street
More informationTim Johnson Survey Research Laboratory University of Illinois at Chicago September 2011
Tim Johnson Survey Research Laboratory University of Illinois at Chicago September 2011 1 Characteristics of Surveys Collection of standardized data Primarily quantitative Data are consciously provided
More informationMODE EFFECTS IN RESPONSE TO A MAIL AND TELEPHONE SURVEY 1
SAM HOUSTON STATE UNIVERSITY CENTER FOR RURAL STUDIES WORKING PAPER SERIES MODE EFFECTS IN RESPONSE TO A MAIL AND TELEPHONE SURVEY 1 Fern K. Willits The Pennsylvania State University A.E. Luloff The Pennsylvania
More informationSurvey Methods in Relationship Research
Purdue University Purdue e-pubs Department of Psychological Sciences Faculty Publications Department of Psychological Sciences 1-1-2009 Survey Methods in Relationship Research Christopher Agnew Purdue
More informationSurvey Errors and Survey Costs
Survey Errors and Survey Costs ROBERT M. GROVES The University of Michigan WILEY- INTERSCIENCE A JOHN WILEY & SONS, INC., PUBLICATION CONTENTS 1. An Introduction To Survey Errors 1 1.1 Diverse Perspectives
More informationISC- GRADE XI HUMANITIES ( ) PSYCHOLOGY. Chapter 2- Methods of Psychology
ISC- GRADE XI HUMANITIES (2018-19) PSYCHOLOGY Chapter 2- Methods of Psychology OUTLINE OF THE CHAPTER (i) Scientific Methods in Psychology -observation, case study, surveys, psychological tests, experimentation
More informationRESPONSE FORMATS HOUSEKEEPING 4/4/2016
RESPONSE FORMATS Allyson L. Holbrook Associate Professor of Public Administration and Psychology & Associate Research Professor at the Survey Research Laboratory of the University of Illinois at Chicago
More informationThe Impact of Advance Letters on Cellphone Response in a Statewide Dual-Frame Survey
Vol. 11, Issue 2, 2018 The Impact of Advance Letters on Cellphone Response in a Statewide Dual-Frame Survey Eva Aizpurua *, Ki H. Park, Mitchell Avery, Jill Wittrock *, Rodney Muilenburg, Mary E. Losch
More informationIs There any Difference Between the Results of the Survey Marked by the Interviewer and the Respondent?
Is There any Difference Between the Results of the Survey Marked by the Interviewer and the Respondent? Cetin Kalburan, PhD Cand. Tugce Aksoy, Graduate Student Institute of Social Sciences, Pamukkale University,
More informationSelection bias and models in nonprobability sampling
Selection bias and models in nonprobability sampling Andrew Mercer Senior Research Methodologist PhD Candidate, JPSM A BRIEF HISTORY OF BIAS IN NONPROBABILITY SAMPLES September 27, 2017 2 In 2004-2005
More informationTime-Sharing Experiments for the Social Sciences. Impact of response scale direction on survey responses to factual/behavioral questions
Impact of response scale direction on survey responses to factual/behavioral questions Journal: Time-Sharing Experiments for the Social Sciences Manuscript ID: TESS-0.R Manuscript Type: Original Article
More informationThe Accuracy and Utility of Using Paradata to Detect Interviewer Question-Reading Deviations
University of Nebraska - Lincoln DigitalCommons@University of Nebraska - Lincoln 2019 Workshop: Interviewers and Their Effects from a Total Survey Error Perspective Sociology, Department of 2-26-2019 The
More informationStrategic Sampling for Better Research Practice Survey Peer Network November 18, 2011
Strategic Sampling for Better Research Practice Survey Peer Network November 18, 2011 Thomas Lindsay, CLA Survey Services John Kellogg, Office of Institutional Research Tom Dohm, Office for Measurement
More informationYOUNG PEOPLE AND DRUGS
Flash Eurobarometer 401 YOUNG PEOPLE AND DRUGS Survey requested by the Directorate-General for Justice (DG JUST) and co-ordinated by the Directorate-General for Communication (DG COMM "Strategy, Corporate
More informationStandardized Survey Interviewing
Standardized Survey Interviewing In a standardized survey interview, the interview proceeds according to a script that is intended to minimize any potential impact of individual interviewers behavior on
More informationTopic 2 Traits, Motives, and Characteristics of Leaders
Topic 2 Traits, Motives, and Characteristics of Leaders Introduction Are some individuals endowed with special qualities that allow them to lead? Why is one person more successful than another? Can we
More informationChapter 3 Introducing a Control Variable (Multivariate Analysis)
SSRIC Teaching Resources Depository Public Opinion on Social Issues -- 1975-2004 Elizabeth N. Nelson and Edward E. Nelson, California State University, Fresno Chapter 3 Introducing a Control Variable (Multivariate
More informationSurvey Research Centre. An Introduction to Survey Research
Survey Research Centre An Introduction to Survey Research Outline Introduction to the SRC Beginning with data Two design choices: cross-sectional survey and experiments Coffee break Best practices Your
More informationExecutive Summary. Lupus Awareness Survey. October 2012
Executive Summary Lupus Awareness Survey October 2012 GfK Roper Public Affairs & Corporate Communications Lupus Awareness Survey October 2012 Executive Summary A recent survey of American adults conducted
More informationWhat are Indexes and Scales
ISSUES Exam results are on the web No student handbook, will have discussion questions soon Next exam will be easier but want everyone to study hard Biggest problem was question on Research Design Next
More informationMode Effects on In-Person and Internet Surveys: A Comparison of the General Social Survey and Knowledge Network Surveys
Mode Effects on In-Person and Internet Surveys: A Comparison of the General Social Survey and Knowledge Network Surveys Tom W. Smith 1, J. Michael Dennis 2 1 National Opinion Research Center/University
More informationIntroduction: Statistics, Data and Statistical Thinking Part II
Introduction: Statistics, Data and Statistical Thinking Part II FREC/STAT 608 Dr. Tom Ilvento Department of Food and Resource Economics Let s Continue with our introduction We need terms and definitions
More informationSleep & Effectiveness are Linked, but Few Plan Their Sleep
Sleep in America Poll 2018 Sleep & Effectiveness are Linked, but Few Plan Their Sleep A majority of American adults (65%) think sleep contributes to next day effectiveness. Great sleepers realize the benefit,
More informationResponse rates are the most widely compared statistic for judging survey quality. Outline. Main Problem Confronting Us
Managing Nonresponse as a General Methodological Problem Linda Owens Survey Research Laboratory University of Illinois at Chicago Outline Overview of response rate issue Overview of non-response bias issue
More informationAn evaluation of the weighting procedures for an online access panel survey
Survey Research Methods (2008) Vol.2, No.2, pp. 93-105 ISSN 1864-3361 http://www.surveymethods.org c European Survey Research Association An evaluation of the weighting procedures for an online access
More informationPerception and insights on fats and fatty acids: knowledge of fat quality of the diet
Perception and insights on fats and fatty acids: knowledge of fat quality of the diet Background Research indicates that consumers nowadays are very aware of their health and the major role nutrition plays
More informationQuestionnaire development
Questionnaire development documentation in Generations and Gender Programme Andrej Kveder GGP project manager kveder@nidi.nl Outline About GGP Questionnaire development Documentation Implementation Automated
More informationWeb Survey Paradata on Response Time Outliers: A Systematic Literature Review
Metodološki zvezki, Vol. 15, No. 1, 2018, 23 41 Web Survey Paradata on Response Time Outliers: A Systematic Literature Review Miha Matjašič 1 Vasja Vehovar 2 Katja Lozar Manfreda 3 Abstract In the last
More informationMixed Modes and Measurement Error: Using Cognitive Interviewing to Explore the Results of a Mixed Modes Experiment
8 Mixed Modes and Measurement Error: Using Cognitive Interviewing to Explore the Results of a Mixed Modes Experiment Pamela Campanelli The Survey Coach Margaret Blake Ipsos MORI Michelle Mackie (Gray)
More informationModes of Measurement. Outline. Modes of Measurement. PSY 395 Oswald
Modes of Measurement PSY 395 Oswald Outline Modes of Measurement Direct questioning Paper-and-pencil Face-to-face Telephone Interviews Newer Modes Internet Experience Sampling Implicit measures Third-party
More informationCHARACTERISTICS OF RESPONDENTS IN BUSINESS WEB SURVEYS IN CROATIA: CASE OF STATISTICAL METHODS USE SURVEYS
CHARACTERISTICS OF RESPONDENTS IN BUSINESS WEB SURVEYS IN CROATIA: CASE OF STATISTICAL METHODS USE SURVEYS Berislav ŽMUK Faculty of Economics and Business, University of Zagreb, Trg J. F. Kennedyja 6,
More informationChapter 2 Survey Research Design and Quantitative Methods of Analysis for Cross-Sectional Data
SSRIC Teaching Resources Depository Public Opinion on Social Issues -- 1975-2010 Elizabeth N. Nelson and Edward E. Nelson, California State University, Fresno Chapter 2 Survey Research Design and Quantitative
More informationTHE STUDY OF HEALTH-CARE USERS: SAMPLING AND METHODOLOGY
THE STUDY OF HEALTH-CARE USERS: SAMPLING AND METHODOLOGY The privatisation process of health care introduced mixed economy of care and a greater assortment of health services which has resulted in a variety
More informationFollowing a Telephone Survey with a Mail Survey
Following a Telephone Survey with a Mail Survey Katrina Wynkoop Simmons, Ph.D. BRFSS Coordinator Center for Health Statistics Washington State Department of Health 6 th Annual Regional Training Workshop
More informationModule One: What is Statistics? Online Session
Module One: What is Statistics? Online Session Introduction The purpose of this online workshop is to aid you in better understanding the materials you have read within the class textbook. The goal of
More informationTHE LAST-BIRTHDAY SELECTION METHOD & WITHIN-UNIT COVERAGE PROBLEMS
THE LAST-BIRTHDAY SELECTION METHOD & WITHIN-UNIT COVERAGE PROBLEMS Paul J. Lavrakas and Sandra L. Bauman, Northwestern University Survey Laboratory and Daniel M. Merkle, D.S. Howard & Associates Paul J.
More informationAppraisal tool for Cross-Sectional Studies (AXIS)
Appraisal tool for Cross-Sectional Studies (AXIS) Critical appraisal (CA) is used to systematically assess research papers and to judge the reliability of the study being presented in the paper. CA also
More informationMEASURING HAPPINESS IN SURVEYS: A TEST OF THE SUBTRACTION HYPOTHESIS. ROGER TOURANGEAU, KENNETH A. RASINSKI, and NORMAN BRADBURN
MEASURING HAPPINESS IN SURVEYS: A TEST OF THE SUBTRACTION HYPOTHESIS ROGER TOURANGEAU, KENNETH A. RASINSKI, and NORMAN BRADBURN Abstract Responses to an item on general happiness can change when that item
More informationEffects of Data Collection Methods On Participant Responses In Television Research Studies
Cairo University Faculty of Mass Communication Radio and Television Department Effects of Data Collection Methods On Participant Responses In Television Research Studies A Comparative Study A Summary of
More informationMissouri Institute of Mental Health Asking the Questions: The First Step of the MOSBIRT Protocol Rita Adkins, MPA Seven Word Sentence:
Missouri Institute of Mental Health Asking the Questions: The First Step of the MOSBIRT Protocol Rita Adkins, MPA Change Seven Word Sentence: Needed The For Is Today Time Seven Word Sentence: Change Needed
More informationSTA630 Research Methods Solved MCQs By
STA630 Research Methods Solved MCQs By http://vustudents.ning.com 31-07-2010 Quiz # 1: Question # 1 of 10: A one tailed hypothesis predicts----------- The future The lottery result The frequency of the
More informationLife After Prostate Cancer Diagnosis Research Study
Life After Prostate Cancer Diagnosis Research Study If you are looking at this information sheet this means you have read the covering letter and therefore have had a diagnosis of prostate cancer. If you
More informationEUROPEAN CITIZENS DIGITAL HEALTH LITERACY
Flash Eurobarometer 404 EUROPEAN CITIZENS DIGITAL HEALTH LITERACY SUMMARY Fieldwork: September 2014 Publication: November 2014 This survey has been requested by the European Commission, Directorate-General
More informationNHS Institute for Innovation and Improvement All rights reserved.
Film: Introduction The ebd approach a service improvement methodology Before we start, a quick survey How satisfied were you with the information you received prior to this event? A B C D E Very Good Very
More informationSub-optimal Respondent Behavior and Data Quality in Online Surveys. Randall K. Thomas GfK Custom Research
Sub-optimal Respondent Behavior and Data Quality in Online Surveys Randall K. Thomas GfK Custom Research Sub-optimal Response in Surveys Survey satisficing occurs when respondents respond in ways that
More informationRanking: Perceptions of Tied Ranks and Equal Intervals on a Modified Visual Analog Scale
University of Dayton ecommons Psychology Faculty Publications Department of Psychology 2-2016 Ranking: Perceptions of Tied Ranks and Equal Intervals on a Modified Visual Analog Scale Jerry Timbrook University
More informationPDRF About Propensity Weighting emma in Australia Adam Hodgson & Andrey Ponomarev Ipsos Connect Australia
1. Introduction It is not news for the research industry that over time, we have to face lower response rates from consumer surveys (Cook, 2000, Holbrook, 2008). It is not infrequent these days, especially
More informationTesting for non-response and sample selection bias in contingent valuation: Analysis of a combination phone/mail survey
Whitehead, J.C., Groothuis, P.A., and Blomquist, G.C. (1993) Testing for Nonresponse and Sample Selection Bias in Contingent Valuation: Analysis of a Combination Phone/Mail Survey, Economics Letters, 41(2):
More informationEVALUATING THE IMPACT OF A NEW CATI SCREENER IN THE NATIONAL IMMUNIZATION SURVEY
EVALUATING THE IMPACT OF A NEW CATI SCREENER IN THE NATIONAL IMMUNIZATION SURVEY Michael P. Battaglia, Vicki Huggins, Ann-Sofi Rodén, Abt Associates Inc.; Robert A. Wright, National Center for Health Statistics;
More informationOpen Day Deutsche Börse IT conference Customer Technical Support organisation behind the scenes Florian Rodeit / Daniel Vollstedt.
Open Day Deutsche Börse IT conference Customer Technical Support organisation behind the scenes Florian Rodeit / Daniel Vollstedt 16 October 2014 Deutsche Börse Group 1 Agenda 01 Your feedback 2013 02
More informationSurvey Mode as a Moderator of Context Effects
Metodološki zvezki, Vol. 14, No. 1, 2017, 1 17 Survey Mode as a Moderator of Context Effects May Doušak 1 Abstract After decades of survey quality research and many experiments on the mode of data collection
More informationSummary of the Milestone Report 3.3
Summary of the Milestone Report 3.3 Purpose The purpose and research issue of WP 3.3 is to gain knowledge and acceptance on the use and handling of mobile devices by people in need of care and people suffering
More informationDesign, Evaluation, and Analysis of Questionnaires for Survey Research
Wiley Series in Survey Methodology Design, Evaluation, and Analysis of Questionnaires for Survey Research SECOND EDITION Willem E. Saris Irmtraud N. Gallhofer Design, Evaluation, and Analysis of Questionnaires
More informationSURVEY TOPIC INVOLVEMENT AND NONRESPONSE BIAS 1
SURVEY TOPIC INVOLVEMENT AND NONRESPONSE BIAS 1 Brian A. Kojetin (BLS), Eugene Borgida and Mark Snyder (University of Minnesota) Brian A. Kojetin, Bureau of Labor Statistics, 2 Massachusetts Ave. N.E.,
More informationLEAVING EVERYONE WITH THE IMPRESSION OF INCREASE The Number One Key to Success
LESSON ELEVEN LEAVING EVERYONE WITH THE IMPRESSION OF INCREASE The Number One Key to Success 167 Lesson Eleven AREA 1 NAME AREA 2 NAME AREA 3 NAME KEY POINTS Riches, in the context of this program, refers
More informationDoes Voice Matter for Youth Reports of Tobacco Use? An Interactive Voice Response Experiment
Does Voice Matter for Youth Reports of Tobacco Use? An Interactive Voice Response Experiment Niki Mayo, Brenna Muldavin, and Doug Currivan May 15, 2010 RTI International is a trade name of Research Triangle
More informationExploring a Method to Evaluate Survey Response Scales
Exploring a Method to Evaluate Survey Response Scales René Bautista 1, Lisa Lee 1 1 NORC at the University of Chicago, 55 East Monroe, Suite 2000, Chicago, IL 60603 Abstract We present results from a qualitative
More informationFINNISH NATIONAL HEALTH INTERVIEW SURVEY USING BLAISE CATI
FINNISH NATIONAL HEALTH INTERVIEW SURVEY USING BLAISE CATI Timo Byckling Statistics Finland, Helsinki, Finland 1. Conversion from personal interviews to CAT! From the early sixties onwards a series of
More informationTHE IMPACT OF EMOTIONAL INTELLIGENCE IN THE CONTEXT OF LANGUAGE LEARNING AND TEACHING
THE IMPACT OF EMOTIONAL INTELLIGENCE IN THE CONTEXT OF LANGUAGE LEARNING AND TEACHING ElenaSpirovska Tevdovska South East European University, e.spirovska@seeu.edu.mk DOI: 10.1515/seeur-2017-0009 Abstract
More informationMEETING AGENDA. Thursday, January 4, 2018 Page No. Meeting: Program & Planning Committee Date: January 4, 2018 Time:
MEETING AGENDA Meeting: Program & Planning Committee Date: January 4, 2018 Time: 9:00 am Location: Trust Authority Building, 3745 Community Park Loop, Anchorage Teleconference: (844) 740-1264 / Meeting
More informationWhy study perceived injustice in individuals with disabilities?
Perceptions of Injustice as a Risk Factor for Prolonged Work-Disability: Assessment and Intervention Why study perceived injustice in individuals with disabilities? If only he could see what he has done
More informationComparison of Estimates From An Address-Based Mail Survey And A RDD Telephone Survey
Comparison of Estimates From An Address-Based Mail Survey And A RDD Telephone Survey David Cantor Brett McBride Westat Presentation for the International Total Survey Error Workshop, Stowe, VT., June 13
More informationMental Wellbeing in Norfolk and Waveney
Mental Wellbeing in Norfolk and Waveney Shaping the Future What you told us and what happens now Easy Read Version 1 What is in this document? Page 3 6: What is this document about? Pages 7 10: What you
More information2017 TOBACCO USAGE COMMUNITY SURVEY. Tobacco-Free Action of Columbia Greene
2017 TOBACCO USAGE COMMUNITY SURVEY Tobacco-Free Action of Table of Contents County 2017: Summary... 2 County 2017: Summary... 2 Smoking Behavior... 2 Display and Sale of Tobacco Products... 2 Attitudes
More informationEVALUATION OF A MONETARY INCENTIVE PAYMENT EXPERIMENT IN THE NATIONAL LONGITUDINAL SURVEY OF YOUTH, 1997 COHORT
EVALUATION OF A MONETARY INCENTIVE PAYMENT EXPERIMENT IN THE NATIONAL LONGITUDINAL SURVEY OF YOUTH, 1997 COHORT A. Rupa Datta Michael W. Horrigan James R. Walker 1 The evidence on incentives in survey
More informationUsing mixed methods approach in a health research setting
Using mixed methods approach in a health research setting Dr Caroline Bulsara, School of Primary, Aboriginal and Rural Health Care, University of Western Australia Reasons why people prefer one methodology
More informationInteractive Health Literacy: Individual Difference and Message Listenability
Health Literacy Annual Research Conference October 19-20, 2009 Washington, DC Interactive Health Literacy: Individual Difference and Message Listenability Don Rubin drubin@uga.edu Interpersonal Interaction
More informationMATH-134. Experimental Design
Experimental Design Controlled Experiment: Researchers assign treatment and control groups and examine any resulting changes in the response variable. (cause-and-effect conclusion) Observational Study:
More informationI. Introduction and Data Collection B. Sampling. 1. Bias. In this section Bias Random Sampling Sampling Error
I. Introduction and Data Collection B. Sampling In this section Bias Random Sampling Sampling Error 1. Bias Bias a prejudice in one direction (this occurs when the sample is selected in such a way that
More informationNonresponse Bias in a Longitudinal Follow-up to a Random- Digit Dial Survey
Nonresponse Bias in a Longitudinal Follow-up to a Random- Digit Dial Survey Doug Currivan and Lisa Carley-Baxter RTI International This paper was prepared for the Method of Longitudinal Surveys conference,
More informationHandout 16: Opinion Polls, Sampling, and Margin of Error
Opinion polls involve conducting a survey to gauge public opinion on a particular issue (or issues). In this handout, we will discuss some ideas that should be considered both when conducting a poll and
More informationIS THERE ANYTHING WRONG WITH THE MTMM APPROACH TO QUESTION EVALUATION?
Pan-Pacific Management Review 2013, Vol.16, No.1: 49-77 IS THERE ANYTHING WRONG WITH THE MTMM APPROACH TO QUESTION EVALUATION? WILLEM SARIS Research and Expertise Centre for Survey Methodology, Universitat
More informationTCM Clinical Training
1 TCM Clinical Training 1. INTRODUCTION... 2 2. WHO CAN PROFIT FROM THIS TCM CLINICAL TRAINING?... 2 3. HOW TO APPLY FOR THE TCM CLINICAL TRAINING?... 2 4. WHAT SHOULD I PREPARE BEFORE I START MY TCM CLINICAL
More informationI. Survey Methodology
I. Survey Methodology The Elon University Poll is conducted using a stratified random sample of households with telephones in the population of interest in this case, citizens in North Carolina. The sample
More informationThe Five Facet Mindfulness Questionnaire
The Five Facet Mindfulness Questionnaire Mindfulness Questionnaire 8-10 min. Client The Five Facet Mindfulness Questionnaire (FFMQ; Baer, Smith, Hopkins, Krietemeyer, & Toney, 2006; Baer et al., 2008)
More informationDoes Voice Matter for Youth Reports of Tobacco Use? An Interactive Voice Response Experiment
Does Matter for Youth Reports of Tobacco Use? An Interactive Response Experiment (DRAFT please do not cite) Niki Mayo, Brenna Muldavin and Douglas Currivan RTI International May 6, 2010 This paper was
More informationSample size for pre-tests of questionnaires. PERNEGER, Thomas, et al. Abstract
Article Sample size for pre-tests of questionnaires PERNEGER, Thomas, et al. Abstract To provide guidance regarding the desirable size of pre-tests of psychometric questionnaires, when the purpose of the
More informationON-LINE TECHNICAL APPENDIX
ON-LINE TECHNICAL APPENDIX Not another safety culture survey : Using the Canadian Patient Safety Climate Survey (Can-PSCS) to measure provider perceptions of PSC across health settings Authors: Ginsburg,
More informationScripted protocols were developed so that eye
Protocol for Excessive Grief Marilyn Luber Philadelphia, PA Protocol for Excessive Grief is excerpted from Eye Movement Desensitization and Reprocessing (EMDR) Scripted Protocols: Basics and Special Situations
More informationTECH 646 Analysis of Research in Industry and Technology
TECH 646 Analysis of Research in Industry and Technology PART III The Sources and Collection of data: Measurement,, Questionnaires & Instruments, Sampling Ch. 12 Lecture note based on the text book and
More informationRole Playing & Goal Setting
ACTIVITY OUTLINE Role Playing & Goal Setting These activities will allow members to: Learn how to set goals and develop team-building skills. Practice active listening. Think through problems to find solutions.
More informationHuber, Gregory A. and John S. Lapinski "The "Race Card" Revisited: Assessing Racial Priming in
Huber, Gregory A. and John S. Lapinski. 2006. "The "Race Card" Revisited: Assessing Racial Priming in Policy Contests." American Journal of Political Science 50 (2 April): 421-440. Appendix, Version 1.0
More informationDisclosure statement
Early verbal working memory as a predictor of later language outcomes in late talkers Jayne Newbury, Thomas Klee, Stephanie Stokes and Catherine Moran University of Canterbury, New Zealand Disclosure statement
More informationDesign and Analysis of Surveys
Beth Redbird; redbird@northwestern.edus Soc 476 Office Location: 1810 Chicago Room 120 R 9:30 AM 12:20 PM Office Hours: R 3:30 4:30, Appointment Required Location: Harris Hall L06 Design and Analysis of
More informationVariable Data univariate data set bivariate data set multivariate data set categorical qualitative numerical quantitative
The Data Analysis Process and Collecting Data Sensibly Important Terms Variable A variable is any characteristic whose value may change from one individual to another Examples: Brand of television Height
More informationExploring the Methodological Tradeoffs of Mixed-Mode Surveys with an Experimental Design
Exploring the Methodological Tradeoffs of Mixed-Mode Surveys with an Experimental Design David Sterrett, Dan Malato, Jennifer Benz, Trevor Tompson, Ipek Bilgen, Nadarajasundaram Ganesh, J. Michael Dennis,
More informationPublic Views of the Zika Virus Outbreak
Public Views of the Zika Virus Outbreak Technical Assistance for National Public Health Information Coalition Harvard Opinion Research Program Harvard T.H. Chan School of Public Health Harvard T.H. Chan
More informationBehaviorism: An essential survival tool for practitioners in autism
Behaviorism: An essential survival tool for practitioners in autism What we re going to do today 1. Review the role of radical behaviorism (RB) James M. Johnston, Ph.D., BCBA-D National Autism Conference
More informationImproving Informed Consent to Clinical Research. Charles W. Lidz Ph.D.
Improving Informed Consent to Clinical Research Charles W. Lidz Ph.D. Housekeeping Items Please note that this broadcast is being recorded and will be available soon for viewing on SPARC s website. Please
More informationTHIS PROBLEM HAS BEEN SOLVED BY USING THE CALCULATOR. A 90% CONFIDENCE INTERVAL IS ALSO SHOWN. ALL QUESTIONS ARE LISTED BELOW THE RESULTS.
Math 117 Confidence Intervals and Hypothesis Testing Interpreting Results SOLUTIONS The results are given. Interpret the results and write the conclusion within context. Clearly indicate what leads to
More informationDeveloping and Testing Survey Items
Developing and Testing Survey Items William Riley, Ph.D. Chief, Science of Research and Technology Branch National Cancer Institute With Thanks to Gordon Willis Contributions to Self-Report Errors Self-report
More informationRECOMMENDED CITATION: Pew Research Center, December, 2014, Perceptions of Job News Trend Upward
NUMBERS, FACTS AND TRENDS SHAPING THE WORLD FOR RELEASE DECEMBER 16, 2014 FOR FURTHER INFORMATION ON THIS REPORT: Carroll Doherty, Director of Political Research Seth Motel, Research Analyst Rachel Weisel,
More information