Interviewer Characteristics & Interviewer Effects in PIAAC Germany

Size: px

Start display at page:

Download "Interviewer Characteristics & Interviewer Effects in PIAAC Germany"

Franklin Owen
5 years ago
Views:

1 Interviewer Characteristics & Interviewer Effects in PIAAC Germany Natascha Massing 1, Daniela Ackermann 1 & Annelies Blom 2 1 GESIS Leibniz Institute for the Social Sciences 2 University of Mannheim The 5th Conference of the European Survey Research Association (ESRA), Ljubljana, July 16 th, 2013

2 Research Topic July 16th, 2013 N. Massing, D. Ackermann & A. Blom 2

3 Research Topic Interviewer most important in getting cooperation by respondents Activities by interviewers are crucial determinants of measurement error (Durrant et al. 2010) What are reasons why some interviewers perform better than others? Focus: cooperation rate July 16th, 2013 N. Massing, D. Ackermann & A. Blom 3

4 PIAAC in Germany July 16th, 2013 N. Massing, D. Ackermann & A. Blom 4

5 PIAAC in Germany 129 interviewers Response rate: 55% Cooperation rate: 70% Very high quality standards on controlling interviewer s work (international) Extensive interviewer training July 16th, 2013 N. Massing, D. Ackermann & A. Blom 5

6 PIAAC Interviewer Questionnaire July 16th, 2013 N. Massing, D. Ackermann & A. Blom 6

7 PIAAC Interviewer Questionnaire After the interviewer training Paper based questionnaire By mail About 90% of interviewers sent back the questionnaire July 16th, 2013 N. Massing, D. Ackermann & A. Blom 7

8 PIAAC Interviewer Questionnaire: Content July 16th, 2013 N. Massing, D. Ackermann & A. Blom 8

9 PIAAC Interviewer Questionnaire: Content Background questions about the interviewer Own behaviour Attitudes Expectations about PIAAC July 16th, 2013 N. Massing, D. Ackermann & A. Blom 9

10 PIAAC Interviewer Questionnaire: Results July 16th, 2013 N. Massing, D. Ackermann & A. Blom 10

11 Who are the PIAAC interviewers in comparison to other studies? Comparison with: German Internet Panel (GIP) SHARE Germany July 16th, 2013 N. Massing, D. Ackermann & A. Blom 11

12 Gender comparison to other German surveys 70% 60% 50% 40% 30% 20% PIAAC SHARE GIP 10% 0% Male Female July 16th, 2013 N. Massing, D. Ackermann & A. Blom 12

13 Age comparison to other German surveys 50% 40% 30% 20% 10% PIAAC GIP SHARE 0% <= 45 years years years > 65 years Interviewer age (categories) July 16th, 2013 N. Massing, D. Ackermann & A. Blom 13

14 50% Experience comparison to other German surveys 40% 30% 20% 10% PIAAC GIP SHARE 0% < 2 years 2-5 years 6-10 years years > 15 years Experience July 16th, 2013 N. Massing, D. Ackermann & A. Blom 14

15 Highest educational level comparison to other surveys 50% 40% 30% 20% PIAAC 10% 0% graduated from lowerlevel secondary school graduated from medium-level secondary school advanced technical college entrance qualification/ graduated from upper-level secondary school university degree GIP SHARE July 16th, 2013 N. Massing, D. Ackermann & A. Blom 15

16 50% Working hours per week comparison to other surveys 40% 30% 20% 10% PIAAC GIP SHARE 0% <=10 hours hours hours hours > 40 hours working hours (categories) July 16th, 2013 N. Massing, D. Ackermann & A. Blom 16

17 Reasons for working as an interviewer 7 1 = not importantatall, 7 = veryimportant PIAAC (mean) GIP (mean) SHARE (mean) 2 1 payment interest socialize insight research society time July 16th, 2013 N. Massing, D. Ackermann & A. Blom 17

18 Cooperation rate Percent July 16th, 2013 N. Massing, D. Ackermann & A. Blom 18

19 Interviewer Effect on Cooperation Which is the general effect that can be attributed to the interviewers? July 16th, 2013 N. Massing, D. Ackermann & A. Blom 19

20 Interviewer Effect on Cooperation Random-effects logistic regression Coef. Std. Err. _cons rho July 16th, 2013 N. Massing, D. Ackermann & A. Blom 20

21 Interviewer Effect on Cooperation Interviewer effect is significant in Germany However, it is very low ~ 2% GIP and other surveys: 7% July 16th, 2013 N. Massing, D. Ackermann & A. Blom 21

22 Interviewer Effect on Cooperation Other variables? Coef. Std. Err. Large city Male Years of experience Full time work p < 0.1 July 16th, 2013 N. Massing, D. Ackermann & A. Blom 22

23 Expected Response Rate Is there a relationship between expected response rate an cooperation rate? They seem to be correlated ( 0.3) Area could be important determinant of this relationship July 16th, 2013 N. Massing, D. Ackermann & A. Blom 23

24 Conclusion July 16th, 2013 N. Massing, D. Ackermann & A. Blom 24

25 Conclusion I Interviewers working on PIAAC have a lot of experience They do not differ to other interviewers concerning their motivation Interviewer effect on cooperation is very low July 16th, 2013 N. Massing, D. Ackermann & A. Blom 25

26 Conclusion II Further analyses More detailed analyses concerning interviewers characteristics with individual response rates realized Comparing results with other German studies Interviewer effect on contact July 16th, 2013 N. Massing, D. Ackermann & A. Blom 26

org Phone: +49 621 1246 508 Daniela Ackermann Mail: daniela.

27 Thank you for your attention! Contact Natascha Massing Mail: Phone: Daniela Ackermann Mail: Phone: July 16th, 2013 N. Massing, D. Ackermann & A. Blom 27

On the Importance of Representative Online Survey Data : Probability Sampling and Non-Internet Households

On the Importance of Representative Online Survey Data : Probability Sampling and Non-Internet Households Annelies G. Blom Principal Investigator of the German Internet Panel Juniorprofessor for Methods