Perception of Music: Problems and Prospects

Transcription

1 A neuroscience perspective on using music to achieve emotional objectives Perception of Music: Problems and Prospects Frank Russo Ryerson University Frank Russo SMARTLab Ryerson University Room 217 February 10, of 41

2 The importance of emotion regulation and emotional communication Emotions affect our cognition and behavior Emotions are primarily conveyed nonverbally 7%-38%-55% rule (lexical, prosodic, facial) Necessity of facial and vocal expressivity is evident throughout the lifespan Still-face paradigm (Tronick and colleagues) Botox effect (Davis et al., 2010, Emotion) 2 of 402

3 Emotional mimicry in song 3 of 403

4 zygomaticus (smiling) happy 0 perception imagery neutral sad Chan, Livingstone & Russo (2013), Music Perception 4 of 404

5 corrugator (frowning) perception imagery happy neutral sad of 405

6 Emotion Induction (Stress Regulation Adults) Sandstrom & Russo (2009), Music and Medicine 6 of 406

7 7 of 407

8 Recovery from stress GSR (Z-score) Sad (Grieg) Agitated (Shostakovich) Peaceful (Bizet) Happy (Strauss) Time Sandstrom & Russo (2010), Music & Medicine Peaceful music White noise Absorption (TAS) Absorption (TAS) Sandstrom & Russo (2009), Psychology of Music AIMS Scale 8 of 408

9 Emotion Induction (Stress Regulation Infants) Ghazban, Russo, Trehub & Boudreau (in progress) 9 of 409

10 10 of 10 40

11 Music and Emotional Communication in Deaf children who use CIs 11 of 11 40

12 CIs and Music Children who use CIs generally take pleasure in listening to music and many participate in musical activities (Gfeller et al., 1999; Nakata et al., 2005) Early work suggested that perception of rhythm is in tact but perception of melody impaired (Cooper, Tobey, & Loizou, 2008) 12 of 12 40

13 Measures: Music Perception MBEA for Children (Peretz & Béland, 2013) Uses 5 subscales of music perception including Scale, Different Contour, Interval, Rhythm, and incidental Memory Examples: 13

14 CIs and Music Perception Hopyan, Peretz, Chan, Papsin, Gordon, of 14 40

15 Experimental findings in normal hearing children Children randomly assigned to receive keyboard lessons for one year were more successful at determining the correct emotion in semantically neutral spoken sentences than a control group (Thompson et al., 2004) 15 of 15 40

16 Stress patterns Music Phrasing Pitch Emotional speech 16 of 16 40

17 VS. Regular Practice/ Weekly Lessons 6 months 17 of 17 40

18 Music Perception 18 of 18 40

19 Percentage of correct responses Percentage of correct responses Music Perception: Subscales * * * Pre Mid Post Scale Contour Interval Rhythm Memory Scale Contour Interval Rhythm Memory 19 of 19 40

20 Speech Perception Audio-visual Audio-only 20 of 20 40

21 Possible mechanisms Changes in auditory cortex and the structural connectivity of cortical and subcortical networks Schlaug et al., 2010; Strait & Kraus, of 21 40

22 Possible mechanisms (contd). Increased auditory attention and/or working memory Strait & Kraus, of 22 40

23 Summary Deaf Children who use CI s o Participants in the music condition improved on music perception tasks to a greater extent than children in the art condition. o Participants in the music condition transferred skills to the detection of emotion in speech o Future work should consider mechanisms, the modality of training (voice, keyboard, ear training), and contributions of multimodal feedback (visual, vibrotactile) 23 of 23 40

24 Emotional Communication in People living with Parkinson s PD exhibit deficits in spontaneous facial expressions, termed the Masked face 24 of 24 40

25 Rhythmic Auditory Stimulation Rhythmic auditory stimulation while walking can improve gait velocity, stride length, step cadence 1-2 Dance therapy may also improve measures of gait and balance 3-5 Can rhythmically supported intentional mimicry assist rehabilitation of spontaneous facial function in PD?

26 Baseline Assessment Participants 27 PD patients 28 aged-matched controls Procedure Observe videos of emotional speech and song 1-2 Spontaneous facial movements recorded with EMG 3-5 Placement of electrodes for EMG Green = zygomaticus (smiling muscles for positive emotions) Red = Corrugator (frowning muscles for negative emotions) Purple = Frontalis major (frowning muscle for negative emotions) 26 of 26 40

27 delayed response 27 of 27 40

28 Singing Intervention A 13-week imitative facial expressive singing program Participants 26 Parkinson s Disease patients 13 Treatment 13 Control Procedure Observe videos of emotional speech and song 1-2 Spontaneous facial movements recorded with EMG 3-5 Assessment Week 1, Week13, and 2 month follow-up 28 of 28 40

29 Results 29 of 29 40

30 Results 30 of 30 40

31 Emotional Communication in Autism 31 of 31 40

32 Deficits in mimicry Decreased congruent automatic mimicry of facial expressions (McIntosh et al., 2006) Delayed mimicry of facial expressions (Oberman et al., 2009) 32 of 32 40

33 Abnormal functioning of actionobservation network Individuals with autism: diminished activation of this network in response to emotion displays (Oberman et al., 2005) 33 of 33 40

34 Imitation therapy using song: Video game for autism 34 of 34 40

35 35 of 35 40

36 Autism video game study: DV s EEG mu wave (index of action observation network) EMG (corrugator supercilli and zygomaticus major) Basic Empathy Scale (Jolliffe & Farrington, 2006) Accuracy on emotion judgments Social Responsiveness Scale (Bölte et al., 2008) 36 of 36 40

37 Preliminary results (N = 9) Pre-Training Accuracy of Emotion Detection Post-Training Imitation group Observation group 37 of 37 40

38 Preliminary results (N = 9) Social Responsiveness Scale * Imitation Group Observation Group Pre-Training Post-Training 38 of 38 40

39 39 of 39 40