Virtual Reality Job Interview Training and Employment Outcomes Adults with Severe Mental Illness

Transcription

1 Northwestern University Feinberg School of Medicine Virtual Reality Job Interview Training and Employment Outcomes Adults with Severe Mental Illness October 14th, 2017 Department of Psychiatry and Behavioral Sciences Matthew J. Smith, Ph.D., LCSW, MPE Adjunct Associate Professor Rachel Sax, MS Research Coordinator Ilona Dewald, BS Research Assistant

2 Disclosures This research was supported by the NIMH via grants (R44 MH080496, R01 MH110524) Northwestern University is a research partner with SIMmersion LLC and the investigators do not receive any payment or honorarium from them. 2

3 Talk Outline 1. Employment for individuals with severe mental illness 2. Job interview as barrier to employment 3. Available interview training 4. Virtual Reality Interventions 5. Virtual Reality Job Interview 3 Training (VR-JIT) 6. Randomized Controlled Trials of VR-JIT Northwestern University Feinberg School of Medicine

4 Employment for Individuals with Severe Mental Illness Severe Mental Illness (SMI) bipolar disorder, major depressive disorder, schizophrenia as well as Veterans with PTSD Luciano et al., 2014; Zivin et al.,

5 Interviewing as barrier to employment Most proximal factor to finding a job for clients receiving services Several factors contribute to poor interviewing Stakeholders (e.g., consumers, employers) suggest interviewing is a critical barrier to employment (Marwaha et al., 2006) 5

6 Available Interview Training Most programs rely on clinicianfacilitated role-play training Minimal evidence that this method is effective, but it is widely used 10 Year-follow-up study indicated that only 30% of clients receiving standardized vocational services reported that role-playing with a counselor was helpful Novel evidence-based interventions are needed to fill this gap in services 6

7 Virtual Reality Job Interview Training (VR-JIT) NIMH funded Developed for Individuals with psychiatric disorders 7

8 Virtual Reality Interventions Has demonstrated efficacy at: -Teaching FBI agents to interrogate suspects -Teaching physicians to talk to patients about drug abuse -Teaching social skills to neuropsychiatric populations Why does VR appear to help? -Behavioral learning principles -Hierarchical learning (easy-to-medium-to-hard) -Repeated practice (drill-and-repeat) -Reward conditioning and feedback (makes practice enjoyable) 8

9 VR-JIT Design Feature Outline Virtual HR interviewer developed with matrix that generates 9 characters that can evolve based on trainee response Individually customizable Core features for clinical populations Hierarchical learning Web-based didactics Automated feedback 9

10 Virtual HR Interviewer 10

11 Molly Porter statements/questions recorded by Actress Example Interview Questions: What is your greatest strength? I see there are gaps in your work history, can you tell me more about that? Trainees speak from 5-15 statements & questions 11 Example Trainee Responses: I m good at pretty much everything I do. This is my first job out of school.

12 VR-JIT Interface 12

13 Individually Customizable Job application informs the interview questions 13

14 Core Features for Clinical Populations Asking for accommodations Negotiating scheduled time off Discussing gaps in work history Discussing prior conviction Discussing applicability of military training to community job Recognizing and handling illegal questions Disclosing one s diagnosis 14

15 Hierarchical Learning Friendly Molly Business Molly 15

16 Educational Curriculum Trainees are provided web-based content on interview basics 16

17 Automated Feedback Real-time feedback from non-verbal job coach 17

18 Scripted Feedback After each simulated interview, trainees receive color coded in a transcript to identify whether responses were helpful or hurtful to rapport with Molly (or were neutral) Responses can be played back so trainees can hear how they sound. 18

19 19 Green = Good Response Red = Poor Response Black = Neutral Response

20 How does VR-JIT compare to current methods? 20

21 21 Who s ready to talk to Molly?

22 Great, so we developed this novel intervention that should work in theory What s next? 22

23 Research Results We ve evaluated Molly in 5 different groups of consumers and see similar effects in each group *Schizophrenia *Mood Disorders *Military Veterans with PTSD (and mood disorders) *Autism Spectrum Disorder 23

24 Study Procedures SBIR Grant VR-JIT Trainees Waitlist TAU Par7cipants Pre-Test Cogni.on Interviewing Self-Confidence Employment history 2 Pre-Test Role-Plays 2-Week Training 5 sessions of VR-JIT, Up to 2 hours per session, min per virtual interview Post-Test Interviewing Self-Confidence 2 Post-Test Role-Plays Cogni.on Interviewing Self-Confidence Employment history 2 Pre-Test Role-Plays TAU Interviewing Self-Confidence 2 Post-Test Role-Plays 24

25 Study Procedures Process Measures - VR-JIT scores each virtual interview scores monitored by SIMmersion and recorded by staff Acceptability measures - Monitored # of completed trials, session attendance, time using system, selfreported experience using VR-JIT 25

26 Results No differences between trainees/non-trainees in: - Cognition - Prior vocational training - Prior paid employment - Months since last job All groups: - completed >90% of training sessions - completed >500 out of 600 minutes of training - completed >14 virtual interviews - >90% agreed or strongly agreed that VR-JIT was enjoyable, helpful, and instilled them with confidence. 26

27 Results Process Measures - Did trainees improve their performance across trials while increasing difficulty from easy to medium to hard? 27

28 Results Adults with Schizophrenia Smith et al.,

29 Results Adults with Mood Disorders 100 Average VR-JIT Score Easy Medium Hard Smith et al., 2014a 29 Job Training Trial Number and Difficulty

30 Results Veterans with PTSD 100 Average VR-JIT Score Easy Medium Hard Job Training Trial Number and Difficulty Smith et al.,

31 Results Young adults with ASD 100 Average VR-JIT Score Easy Medium Hard Smith et al., 2014b 31 Job Training Trial Number and Difficulty

32 Results Individuals with Schizophrenia Role-Play Performance VR-JIT TAU Interviewing Self-Confidence VR-JIT TAU Pre Post 40 Pre Post Smith et al.,

33 Results Individuals with Mood Disorders Role-Play Performance Interviewing Self-Confidence VR-JIT TAU VR-JIT TAU Pre Post 35 Pre Post Smith et al., 2014a 33

34 Results Veterans with PTSD Role-Play Performance VR-JIT TAU Interviewing Self-Confidence VR-JIT TAU Pre Post Pre Post Smith et al.,

35 Results Young Adults with Autism Spectrum Disorders Role-Play Performance Interviewing Self-Confidence VR-JIT TAU VR-JIT TAU Pre Post 40 Pre Post Smith et al., 2014b 35

36 Employment Outcome Data Rate of Job Offers for SMI and ASD Cohorts at 6-Month Follow-up 60% 50% 40% 30% 20% 10% 0% 51% 53% 25% 25% Series1 Controls Series2 VR-JIT Trainees SMI Cohort ASD Cohort 36

37 Overview of Findings Molly training is associated with: - improved skills as mechanism - higher rate of job offers - high rate of acceptability 37

38 Currently Funded Studies of Molly NIMH - Community Effectiveness (Does training work in a community setting?) - Improved skills - Higher employment rate - Get jobs faster - Initial Implementation Evaluation (Are we delivering the training with an optimal method?) - Cost Effectiveness (Is it cheaper to do usual care or use Molly?) 38

39 Thank you for your Attention! 39

40 Acknowledgements NU Faculty Collaborators Michael Fleming, MD Neil Jordan, PhD NU Research Staff Rachel Sax Ilona Dewald Michael Wright Emily Ginger Katy Wright Ivy Mosely Brianne Nunn Pam Voss Melody Fairchild Sara Rocus Cassandra Walker Yale Faculty Collaborators Morris Bell, PhD SIMmersion Collaborators Dale Olsen, PhD Laura Boteler Humm Community Partners Jesse Brown VA Hines VA Anixter Center Stone Mental Health Center Trilogy, Inc Wanda Satkas, Chicagoland Autism Connection Nanette Larson, CRSS State of Illinois, Division of Mental Health 40

41 References Autism Speaks. Employment Think Tank Report (Internet). Accessed07/31/2014. Corbiere M, Zaniboni S, Lecomte T, Bond G, Gilles PY, Lesage A, Goldner E. Job acquisition for people with severe mental illness enrolled in supported employment programs: a theoretically grounded empirical study. J Occup Rehabil. 2011;21(3): Hendricks D. Employment and adults with autism spectrum disorders: challenges and strategies for success. J Vocat Rehabil. 2010;32(2): Marwaha S, Johnson S. Views and experiences of employment among people with psychosis: a qualitative descriptive study. International Journal of Social Psychiatry. 2006;51(4): Shattuck PT, Narendorf SC, Cooper B, Sterzing PR, Wagner M, Taylor JL. Postsecondary education and employment among youth with an autism spectrum disorder. Pediatrics. 2012;129(6): Smith MJ, Ginger EJ, Wright K, Wright MA, Humm LB, Olsen D, Bell MB, & Fleming MF. (2014). Virtual Reality Job Interview Training in Individuals with Psychiatric Disabilities. Journal of Nervous and Mental Disorders, 202, Smith MJ, Ginger EJ, Wright K, Wright MA, Taylor JL, Boteler Humm L, Olsen D, Bell MB, & Fleming MF. (2014). Virtual Reality Job Interview Training in Adults with Autism Spectrum Disorder. Journal of Autism and Developmental Disorders, 44, Smith MJ, Humm LB, Fleming MF, Jordan N, Wright MA, Ginger EJ, Wright K, Olsen D, & Bell MD. (2015). Virtual Reality Job Interview Training in Veterans with Posttraumatic Stress Disorder, Journal of Vocational Rehabilitation, 42, (IF=NA) Smith MJ, Fleming MF, Wright MA, Roberts AG*, Humm LB, Olsen D, & Bell MD. (2015). Virtual reality job interview training and 6-month employment outcomes for individuals with schizophrenia seeking employment. Schizophrenia Research, 166,

42 References Smith MJ, Fleming MF, Wright MA, Losh M, Humm LB, Olsen D, & Bell MD. (2015). Vocational outcomes for young adults with autism spectrum disorders at six months after virtual reality job interview training. Journal of Autism and Developmental Disabilities. 45, Smith MJ, Fleming MF, Wright MA, Jordan N, Humm LB, Olsen D, & Bell MD. (2015). Job offers among adults with severe mental illness after virtual reality job interview training. Psychiatric Services, 66, Smith MJ, Bell MD, Wright MA, Humm LB, Olsen D, & Fleming MF. (2016). Virtual reality job interview training and 6-month employment outcomes for individuals with substance use disorders seeking employment. Journal of Vocational Rehabilitation, 44, (3) Smith MJ, Smith JD, Fleming MF, Jordan N, Brown CH, Humm LB, Olsen D, & Bell MD. (in press). Mechanism of action for obtaining job offers after virtual reality job interview training. Psychiatric Services. 42