A Pragmatic Approach to Implementation of Emotional Intelligence in Machines

Transcription

1 A Pragmatic Approach to Implementation of Emotional Intelligence in Machines Michal Ptaszynski Rafal Rzepka Kenji Araki Language Media Laboratory Graduate School of Information Science and Technology Hokkaido University

2 Presentation Outline 1. Affective Computing (AC) - a bit of criticism 2. Our approach - Pragmatism in AC research 3. What we did already - AC through Pragmatics 4. (Near and Far) Future Work 2 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

3 Affective Computing Criticism 3 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

4 Affective Computing Criticism Goal of Affective Computing (Picard, 1995, 1997): To create a machine able to understand the emotions of a user and adapt its behavior according to them. R. W. Picard, "Affective Computing," MIT-TR, 321, 1995 R. W. Picard, Affective Computing, MIT Press, AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

5 Affective Computing Criticism Two approaches to fulfill this goal: 1. Recognizing user emotions (user-focused) 2. Implementing emotion experience in machines (machine-focused) 5 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

6 Affective Computing Criticism 2. Emotion Experience in Machines Motivations: Human-like / Socialized Robots Learn about the emotion processes in humans (by analogy) Find a cure for psychosomatic diseases (stress, depression, etc.) 6 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

7 Affective Computing Criticism 2. Emotion Experience in Machines Human-like / Socialized Robots 7 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

8 Affective Computing Criticism 2. Emotion Experience in Machines Human-like / Socialized Robots What does it mean to be HUMAN-LIKE? Charles Manson is a human Do we need our robots to be like C.M.? Which robots should be human-like? Which needn t? Quarrels, fights and disputes are also social phenomena User: Make me a coffee. Robot: I m not in the mood right now Very human-like, but would you buy it? 8 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

9 Affective Computing Criticism 2. Emotion Experience in Machines Learn about the emotion processes in humans (by analogy) But And unfortunately To actually implement emotions into machines we already need to know the process We don t, and our knowledge about emotions is often not computable yet. * GOOD EXAMPLE: see Karl Fua 9 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

10 Affective Computing Criticism 2. Emotion Experience in Machines Find cure for psychosomatic diseases (stress, depression, etc.) For research like that you need to employ psychologists, neuropsychologists, psychiatrists, medicine doctors, more than computer scientists. Computer scientists: dirty work of computing the knowledge. * GOOD EXAMPLE: see Diane Gromala 10 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

11 Affective Computing Criticism 1. Emotion Recognition Facial Expressions Voice Biometric data Gestures Language Use some (behavioral) assumptions to determine emotional state of a human 11 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

12 Affective Computing Criticism 1. Emotion Recognition Examples of assumptions: User is crying = sad Speaks loudly = angry His waving hands above his head = angry High blood pressure = excited Says f*ck = irritated 12 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

13 Affective Computing Criticism 1. Emotion Recognition Examples of assumptions: User is crying = sad Maybe he s cutting an onion in the kitchen? Speaks loudly = angry Maybe is listening to the music and cannot hear well? His waving hands above his head = angry Maybe it means help! High blood pressure = excited Could this be hypertension? Says f*ck = irritated What is he is saying it like Oh, f*ck, yeah! 13 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

14 Affective Computing Criticism 1. Emotion Recognition Very little research Problem 1. Need to continuously review the assumptions according to context. Simplified to motivation on the beginning of papers Almost no research Problem 2. How to use the recognized information further? Problem 3. Is it enough to recognize the emotions, or is there more? 14 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

15 Our Approach Pragmatism in AC 15 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

16 Our Approach Pragmatism in AC Emotions are strategies/abilities that (should) enhance our lives.* Robots are tools to enhance human lives. *) Robert C. Solomon. The Passions: Emotions and the Meaning of Life, Hackett Publishing, AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

17 Our Approach Pragmatism in AC Emotions are strategies/abilities robots fulfill to enhance tools to What functions could Robots are that (should) our (emotional) lives? enhance enhance human lives. our lives.* *) Robert C. Solomon. The Passions: Emotions and the Meaning of Life, Hackett Publishing, AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

18 Our Approach Pragmatism in AC Conversation 18 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

19 Our Approach Pragmatism in AC Conversation 19 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

20 Our Approach Pragmatism in AC Peter Salovey & John D. Mayer: Emotional Intelligence The ability to recognize, monitor one's own and others' emotions, to discriminate among them and to use this information to guide one's thinking and actions. Salovey, P. & Mayer, J.D. (1990) "Emotional intelligence" Imagination, Cognition, and Personality, 9, AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

21 Our Approach Pragmatism in AC 21 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

22 Our Approach Pragmatism in AC manage emotion in oneself and others. Emotion management is the final ability! 22 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

23 Our Approach Pragmatism in AC recognize emotions After over 15 years of Affective Computing we re still here!! 23 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

24 Our Approach Pragmatism in AC discriminate between [ ] appropriate and inappropriate [ ] expressions of emotions It s time to go a half step further! 24 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

25 Our Work AC through Pragmatics 25 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

26 Our Work AC through Pragmatics 26 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

27 Our Work AC through Pragmatics 27 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

28 Our Work AC through Pragmatics 28 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

29 Our Work AC through Pragmatics 29 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

30 Our Work AC through Pragmatics Expressions of emotion appearing most often = appropriate /natural/ for this context Confront expression from the sentence with the list I m so happy (because) I passed the exam! 30 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

31 Our Work AC through Pragmatics Baseline = 45%-50% Baseline+CVS = 50% Blog mining = 60% Blogs+CVS = 60%-70% 31 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

32 Future Work Other abilities are waiting! 32 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

33 Future Work With EI framework Reformulate some abilities for the need of machine implementation There are some attempts toward other abilities in several research With conversational agent Gather appropriate conversational strategies Create conversation model Implications toward ethics Could we compute irony, sarcasm using information about emotion appropriateness? And a lot more! 33 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009

34 Thank you for your attention! 34 AAAI Fall Symposium on Biologically Inspired Cognitive Architectures (BICA-09), 5-7 November 2009