Verbal and nonverbal discourse planning
|
|
- Osborn Howard
- 5 years ago
- Views:
Transcription
1 Verbal and nonverbal discourse planning Berardina De Carolis Catherine Pelachaud Isabella Poggi University of Bari University of Rome La Sapienza University of Rome Three Department of Informatics Department of Computer Department of Linguistics Intelligent Interfaces and System Science 1 Introduction We are designing a Conversational Agent that communicates at the same time by speech and expressive face. As we are engaged in face-to-face interaction or in any communicative acts where the visual modality is available along with the acoustic one, multimodal signals are at work. Our communicative acts are performed not only through words, but also through intonation, body posture, hand gestures, gaze patterns, facial expressions and so on. Thus, an important step is to define how the Agent s communicative acts are expressed into a coordinated, either sequential or simultaneous, verbal and nonverbal message. In making an Autonomous Agent capable of communicative and expressive behavior, then, a relevant problem to be taken into account is how the Agent plans not only what to communicate, but also by what (verbal or nonverbal) signals, in what combination and how synchronized. This depends on several factors : (i) consideration of the available modalities (e.g., face, gaze, voice), (ii) cognitive ease of production and processing of signals (for example; in describing an object, a gesture may be more expressive than a word); (iii) expressivity of each signal in communicating specific meanings (for example: emotions are better told by facial expression than by words); (iv) appropriateness of signals to social situations (for example: an insulting word may be less easily persecuted than a scornful gaze). Finally, metacommunicative constraints may occur that, say, lead to use redundancy when information to convey is particularly important or needs to be particularly clear: this brings to use verbal and nonverbal signals at the same time. Since few years, multimodal conversational systems [2, 3, 5, 18, 1] have been proposed. These systems integrate verbal and nonverbal signals such as deictic gestures, gaze behavior, communicative facial expressions. Cassell and Stone [4] have designed a multimodal manager whose role is to supervise the distribution of behaviors across the several channels (verbal, head, hand, face, body and gaze). Our system is close to this last one. But we are also considering the context in which the conversation takes place. In this paper we first describe our enriched discourse generator explaining the 2 sets of rules (trigger and regulation) we have added. We also review the different types of gaze communicative acts. Finally we present the variables defining the context and how they modify the computation of the display of the communicative acts. 2 Discourse Generator In order to achieve our aim, we developed a generator whose architecture is shown in Figure 1. This architecture is inspired to classical NLG systems [11, 13], with some differences that are due to the need to consider the two following factors: to keep the content level independent of the way in which it is out-putted (media independence) and resources are distributed; to include emotional and personality factors in the discourse plan. Starting from a given communicative goal, a hierarchical planner [7, 6] builds a discourse plan-tree, by using a pool of plan operators and according to constraints on the domain and on the mental states of the Sender and Addressee. The resulting plan is a hierarchy of goals and subgoals down to the leaves, that represents the primitive communicative acts (Inform, Request, etc.). Each node of this tree brings information about the communicative goal, the role the node plays in the Rhetorical Relation (RR) [13] attached to its fathernode, the RR that relates the two subtrees departing from it and the focus of the discourse. Being media independent, this plan is suitable to be translated into a written text or speech. However, at this level
2 Plan Operators Trigger rules Regulation rules PLANNER D-Plan Goal-Media Prioritizer Enriched Plan Surface realizator Communicative Goal Domain KB Context model Media-Instantiated Discourse Body Instantiator Face 2D character Written text... Figure 1: System architecture only the referential content of the presentation is represented: information on the emotional and cognitive state, that should be expressed in communicating with the User (the Addressee of the conversation), is missing. 2.1 Nonverbal communicative acts Emotional and cognitive information very often pass through nonverbal communication. In previous works [15, 12, 17], we have drawn a semantic typology of the types of information that we can in principle convey while communicating. If we focus only on gaze expressions (but of course, all of these types of information can be conveyed also through verbal behavior or, in many cases, by gestures or facial expressions), we have shown that gaze can make reference to concrete or abstract entities present in the physical context or mentioned in discourse (that is, it has a deictic function); it can mention some concrete or metaphorical properties (like huge, small or subtle ); it can express emotions (fear, anger, dismay...), performatives (it can implore, defy...), conversational information (sentence focus, turn-taking requests); and it can also express metacognitive information (I am thinking, I am trying to remember), and finally Rhetorical Relations within a discourse (contrast, elaboration...) [13]. What we want to focus on here is that RRs are only a (small) subset of the information we convey while talking. The generation of texts must then be enriched with all these other types of information. 2.2 Goal-media prioritizer To associate verbal information with a combination of non-verbal expressions (for instance a gaze, an eyebrow expression, a gesture etc), we need to select the expressions to be shown and to decide, based on their priority, if and when it should be displayed. This is the task of the goal-media prioritizer, a notion first introduced by [4]: this module revises the plan by enriching its nodes with information about the type of non-verbal signals to employ at each stage of the conversation, their combination and their synchronization with verbal communication. The goal-media prioritizer enriches the original plan-tree by applying two sets of rules: trigger and regulation rules. The first set is employed to fire a particular signal, based on information to display, on the domain and the context. The second one is employed to decide whether to display or not a signal
3 and with which intensity [8]. The left parts of trigger rules formalise domain and context dependent conditions; their right parts establish the emotional, meta-cognitive, or other kinds of signals to convey. The triggering mechanism has been built on the basis of the emotion category theory of Ortony, Clore and Collins [14], revised by Elliott [9, 10]. The general structure of this type of rules is the following: IF DC-Cond THEN (Signal Ag e), where DC-Cond is a condition on the context and/or on the domain, Signal represents the type of triggered signal (i.e. feeling of emotions, meta-cognitive, deictic reference and so on), Ag is the agent that is conveying the signal and e is the object of the Signal. For instance: Given a node in the discourse plan that corresponds to the communicative goal of describing an event (Describe(S, A, event)), whose focus is event, two different trigger rules may be applied to deal with pleasant or unpleasant events: IF (Focus(node) is unpleasant ) THEN (Feel S Sadness) IF (focus(node) is pleasant ) THEN (Feel S Joy) 2.3 Context Obviously, the expression of a particular emotional state may depend on other factors, that influence the way in which that emotion is signalled, its expression intensity (degree), and so on. As we mentioned before, this process is governed by the leakage rules, that take into account factors like the Sender s and the Addressee s personality traits, their social relationship and so on. Therefore contextual information relevant to this decision includes, in our view: 1. Sender s display goal - what S (Sender) wants A (Addressee) to do (to console, to help, to advice..) while expressing one s emotion. 2. the Social situation - either public or intimate; 3. the Addressee s model - what the Sender thinks of the Addressee, that includes in its turn: (a) A s cognitive capacity i. Understanding capacity (S will not share emotions that A cannot understand); ii. Problem solving capacity (S will not show sad and ask help if A cannot give good advice) iii. Experience (If A never felt similar emotions, he can t help S) (b) A s practical resources (if the reason I want to show I am in love is to ask my friend his garçonnière, I will not display it if he has no garçonnière) (c) A s personality, where we include [16]: i. A s typical goals (I will not show sad to a selfish person, who gives more importance to his own than to other people s goal) ii. A s typical emotions (I will not show happy to an envious friend; I will not show afraid to someone who is apprehensive). (d) the social relationship between S and A, namely i. role and power relationship (I will not show contempt to one who can retaliate; I won t show angry at my boss) ii. social attitude - whether helping or aggressive to each other (I ll not show angry at my child if she cut a precious suit to make me a present). An example of how context determine the display or not of the display of fear is the following: IF (Feel S Fear) and(bels (Apprehensive A)) THEN(GoalS( Display S Fear)) S will not show afraid if she does not want that an apprehensive person A gets worried. IF (Feel S Fear) and (Goal S (Help A S)) THEN (Goal S (Display S Fear)) S will display her fear if she wants to get help from A.
4 (Describe S A Stay(jail)) ElabObjAttr (Inform S A Stay(jail)) (Inform S A LengthofStay(jail)) D-Plan Portion (Display S A Distress) (Inform S A Stay(jail)) (Display S A "I m thinking") ElabObjAttr Enriched Plan (Display S A Adjectival) (Inform S A LengthofStay(jail)) Figure 2: Example of enriched plan 2.4 Enriched plan At the end of this process, a new enriched plan is generated: this is the input of the surface realizer which, according to the type of body that has been selected for the Animated Agent, defines a mediainstantiated presentation. Figure 2 shows an example of the generation process, by illustrating how the result of the planner is enriched and how this new plan is transformed into an annotated structure corresponding to the mediainstantiated presentation. In this example, the communicative goal of the Sender is to describe to A her stay in jail. Jail in the domain knowledge base is associated to distress. To describe her stay in jail the Sender has to inform that she stayed in jail and how long she stayed in jail. But at the same time she remembered how distressful it was to stay in jail and how long it was. In order to maintain the independence and the possible distribution of all these components, the result of enriched plan is annotated with an XML-based language. In particular, the media instantiated presentation, for the same example as above, will be represented as: <gaze type= ImThinking > I have been in <gaze type= Distress > jail </gaze> for a very <gaze type= LargeAdjectival > long </gaze> period </gaze> The gaze type refers to gaze semantic topology proposed in [17]. 3 Conclusion In this paper we have proposed a new approach to generate verbal and nonverbal behavior for an embodied agent. As we generate the discourse we consider the context. The context gathers information on the situation in which the conversation takes place, the Addressee s model and the social relationship between the Sender and the Addressee. We claim that the consideration of the context allows us to build a more personalized and individual agent with a less robotic and repetitive behavior. References [1] E. André, T. Rist, and J. Mueller. Integrating reactive and scripted behaviors in a life-like presentation agent. In Proceedings of the second International Conference on Autonomous Agents, pages , [2] J. Cassell, J. Bickmore, M. Billinghurst, L. Campbell, K. Chang, H. Vilhjálmsson, and H. Yan. Embodiment in conversational interfaces: Rea. In CHI 99, pages , Pittsburgh, PA, [3] J. Cassell, C. Pelachaud, N.I. Badler, M. Steedman, B. Achorn, T. Becket, B. Douville, S. Prevost, and M. Stone. Animated conversation: Rule-based generation of facial expression, gesture and spoken intonation for multiple conversational agents. In Computer Graphics Proceedings, Annual Conference Series, pages ACM SIGGRAPH, [4] J. Cassell and M. Stone. Living hand and mouth. Psychological theories about speech and gestures in interactive dialogue systems. In AAAI99 Fall Symposium on Psychological Models of Communication in Collaborative Systems, 1999.
5 [5] E. Churchill, S. Prevost, T. Bickmore, P. Hodgson, T. Sullivan, and L. Cook. Design issues for situated conversational characters. In WECC 98, The First Workshop on Embodied Conversational Characters, October [6] B. De Carolis, F. de Rosis, D.C. Berry, and I. Michas. Evaluating plan-based hypermedia generation. In Proceedings of the 7th European Workshop on Natural Language Generation, Toulouse, France, [7] B. De Carolis, F. de Rosis, F. Grasso, A. Rossiello, D.C. Berry, and T. Gillie. Generating recipientcentered explanations about drug prescription. Artificial Intelligence in Medicine, 8: , [8] P. Ekman. Emotion in the human face. Cambridge University Press, [9] C. Elliott. A affective reasoner: A process model of emotions in a multiagent system. PhD thesis, Northwestern University, The Institute for the Learning Sciences, Technical Report No. 32. [10] C. Elliott and G. Siegle. Variables influencing the intensity of simulated affective states. In AAAI technical report for the Spring Symposium on Reasoning about Mental States: Formal Theories and Applications, pages 58 67, Stanford University, March AAAI. [11] B.J. Grosz and C.L. Sidner. Attention, intentions, and the structure of discourse. Computational Linguistics, 12(3), [12] E. Magno-Caldognetto and I. Poggi. Micro- and macro-bimodality. In C. Benoit and R. Campbell, editors, Proceedings of ESCA, AVSP 97 workshop, Rhodes, Greece, September [13] W.C. Mann, C.M.I.M. Matthiessen, and S. Thompson. Rhetorical structure theory and text analysis. Technical Report , ISI Research, [14] A. Ortony, G. L. Clore, and A. Collins. The Cognitive Structure of Emotions. Cambridge University Press, [15] I. Poggi. Mind markers. In 5th International Pragmatics Conference, Mexico City, July [16] I. Poggi and C. Pelachaud. Facial performative in a conversational system. In S. Prevost J. Cassell, J. Sullivan and E. Churchill, editors, Embodied Conversational Characters. MITpress, Cambridge, MA, [17] I. Poggi, C. Pelachaud, and F. de Rosis. Eye communication in a conversational 3d synthetic agent. Special Issue on Behavior Planning for Life-Like Characters and Avatars of AI Communications, [18] J. Rickel and W.L. Johnson. Animated agents for procedural training in virtual reality: Perception, cognition, and motor control. Applied Artificial Intelligence, 13: , 1999.
Emotional Meaning and Expression in Animated Faces
Emotional Meaning and Expression in Animated Faces Isabella Poggi 1 and Catherine Pelachaud 2 1 University of Rome Three, Department of Linguistics Via del Castro Pretorio, 20, 00185 Rome Italy poggi@uniroma3.it
More informationModalities for Building Relationships with Handheld Computer Agents
Modalities for Building Relationships with Handheld Computer Agents Timothy Bickmore Assistant Professor College of Computer and Information Science Northeastern University 360 Huntington Ave, WVH 202
More informationAffect in Virtual Agents (and Robots) Professor Beste Filiz Yuksel University of San Francisco CS 686/486
Affect in Virtual Agents (and Robots) Professor Beste Filiz Yuksel University of San Francisco CS 686/486 Software / Virtual Agents and Robots Affective Agents Computer emotions are of primary interest
More informationUseful Roles of Emotions in Animated Pedagogical Agents. Ilusca L. L. Menezes IFT6261 :: Winter 2006
Useful Roles of Emotions in Animated Ilusca L. L. Menezes IFT6261 :: Winter 2006 Objectives To provide opportunities: To understand the importance of the emotions in learning To explore how to model emotions
More informationAffective Game Engines: Motivation & Requirements
Affective Game Engines: Motivation & Requirements Eva Hudlicka Psychometrix Associates Blacksburg, VA hudlicka@ieee.org psychometrixassociates.com DigiPen Institute of Technology February 20, 2009 1 Outline
More informationAffective Dialogue Communication System with Emotional Memories for Humanoid Robots
Affective Dialogue Communication System with Emotional Memories for Humanoid Robots M. S. Ryoo *, Yong-ho Seo, Hye-Won Jung, and H. S. Yang Artificial Intelligence and Media Laboratory Department of Electrical
More informationMODULE 41: THEORIES AND PHYSIOLOGY OF EMOTION
MODULE 41: THEORIES AND PHYSIOLOGY OF EMOTION EMOTION: a response of the whole organism, involving 1. physiological arousal 2. expressive behaviors, and 3. conscious experience A mix of bodily arousal
More informationFrom Greta s Mind to her Face:
From Greta s Mind to her Face: Modelling the Dynamics of Affective States in a Conversational Embodied Agent Fiorella de Rosis 1, Catherine Pelachaud 2, Isabella Poggi 3, Valeria Carofiglio 1 and Berardina
More informationEmotionally Responsive Virtual Counselor for Behavior-Change Health Interventions
Emotionally Responsive Virtual Counselor for Behavior-Change Health Interventions Reza Amini, Christine Lisetti, and Ugan Yasavur School of Computing and Information Sciences, Florida International University,
More informationPractical Approaches to Comforting Users with Relational Agents
Practical Approaches to Comforting Users with Relational Agents Timothy Bickmore, Daniel Schulman Northeastern University College of Computer and Information Science 360 Huntington Avenue, WVH 202, Boston,
More informationStrategies using Facial Expressions and Gaze Behaviors for Animated Agents
Strategies using Facial Expressions and Gaze Behaviors for Animated Agents Masahide Yuasa Tokyo Denki University 2-1200 Muzai Gakuendai, Inzai, Chiba, 270-1382, Japan yuasa@sie.dendai.ac.jp Abstract. This
More informationSimulating Affective Communication with Animated Agents
Simulating Affective Communication with Animated Agents Helmut Prendinger & Mitsuru Ishizuka Department of Information and Communication Engineering School of Engineering, University of Tokyo 7-3-1 Hongo,
More informationModelling character emotion in an interactive virtual environment
Modelling character emotion in an interactive virtual environment El Jed Mehdi, Pallamin Nico, Dugdale Julie and Pavard Bernard GRIC-IRIT Groupe de Recherche en Ingénierie Cognitive - Institut de Recherche
More informationPerceptual Enhancement of Emotional Mocap Head Motion: An Experimental Study
2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII) Perceptual Enhancement of Emotional Mocap Head Motion: An Experimental Study Yu Ding Univeristy of Houston
More informationEmpathy for Max. (Preliminary Project Report)
Empathy for Max (Preliminary Project Report) Christian Becker Faculty of Technology University of Bielefeld 33549 Bielefeld, Germany cbecker@techfak.uni-bielefeld.de Mitsuru Ishizuka Graduate School of
More informationRISK COMMUNICATION FLASH CARDS. Quiz your knowledge and learn the basics.
RISK COMMUNICATION FLASH CARDS Quiz your knowledge and learn the basics http://www.nmcphc.med.navy.mil/ TOPICS INCLUDE: Planning Strategically for Risk Communication Communicating with Verbal and Nonverbal
More informationEmotional intelligence in interactive systems
To appear in Design and Emotion, (Eds., D. McDonagh, P. Hekkert, J. van Erp and D. Gyi (pp.262-266) London: Taylor & Francis Emotional intelligence in interactive systems Antonella De Angeli and Graham
More informationFactors for Measuring Dramatic Believability. Brian Magerko, Ph.D. Games for Entertainment and Learning Lab Michigan State University
Factors for Measuring Dramatic Believability Brian Magerko, Ph.D. Games for Entertainment and Learning Lab Michigan State University Outline Introduction Deconstruction Evaluation from Player Perspective
More informationMaking It Personal: End-User Authoring of Health Narratives Delivered by Virtual Agents
Making It Personal: End-User Authoring of Health Narratives Delivered by Virtual Agents Timothy Bickmore, and Lazlo Ring College of Computer and Information Science, Northeastern University 360 Huntington
More informationLearn how to more effectively communicate with others. This will be a fun and informative workshop! Sponsored by
Assertiveness Training Learn how to more effectively communicate with others. This will be a fun and informative workshop! Sponsored by Lack of Assertiveness Examples Allowing others to coerce you into
More informationAffective Computing for Intelligent Agents. Introduction to Artificial Intelligence CIS 4930, Spring 2005 Guest Speaker: Cindy Bethel
Affective Computing for Intelligent Agents Introduction to Artificial Intelligence CIS 4930, Spring 2005 Guest Speaker: Cindy Bethel Affective Computing Affect: phenomena manifesting i itself under the
More informationEIQ16 questionnaire. Joe Smith. Emotional Intelligence Report. Report. myskillsprofile.com around the globe
Emotional Intelligence Report EIQ16 questionnaire Joe Smith myskillsprofile.com around the globe Report The EIQ16 questionnaire is copyright MySkillsProfile.com. myskillsprofile.com developed and publish
More informationThe Vine Assessment System by LifeCubby
The Vine Assessment System by LifeCubby A Fully Integrated Platform for Observation, Daily Reporting, Communications and Assessment For Early Childhood Professionals and the Families that they Serve Alignment
More informationSocial Context Based Emotion Expression
Social Context Based Emotion Expression Radosław Niewiadomski (1), Catherine Pelachaud (2) (1) University of Perugia, Italy (2) University Paris VIII, France radek@dipmat.unipg.it Social Context Based
More informationREASON FOR REFLECTING
Reflecting Skills Paraphrase and Reflection of Feeling REASON FOR REFLECTING Reflecting is a verbal way of communicating empathy A form of feedback that enables the client to confirm or correct the impression
More informationAffective Agent Architectures
Affective Agent Architectures Matthias Scheutz Artificial Intelligence and Robotics Laboratory Department of Computer Science and Engineering University of Notre Dame Notre Dame, IN 46556, USA mscheutz@cse.nd.edu
More informationMultimodal Interaction for Users with Autism in a 3D Educational Environment
Multimodal Interaction for Users with Autism in a 3D Educational Environment Ing. Alessandro Trivilini Prof. Licia Sbattella Ing. Roberto Tedesco 1 Screenshots 2 Screenshots 3 Introduction Existing Projects
More informationThe Comforting Presence of Relational Agents
The Comforting Presence of Relational Agents Timothy Bickmore Assistant Professor College of Computer and Information Science Northeastern University 360 Huntington Ave, WVH 202 Boston, MA 02115 USA bickmore@ccs.neu.edu
More informationThe Comforting Presence of Relational Agents
The Comforting Presence of Relational Agents Timothy Bickmore Assistant Professor College of Computer and Information Science Northeastern University 360 Huntington Ave, WVH 202 Boston, MA 02115 USA bickmore@ccs.neu.edu
More informationAssertive Communication/Conflict Resolution In Dealing With Different People. Stephanie Bellin Employer Services Trainer
Assertive Communication/Conflict Resolution In Dealing With Different People Stephanie Bellin Employer Services Trainer The Passive Communicator Often complain and feel they are being treated unfairly.
More informationColoring Multi-Character Conversations through the Expression of Emotions
Coloring Multi-Character Conversations through the Expression of Emotions Patrick Gebhard Martin Klesen Thomas Rist DFKI GmbH Stuhlsatzenhausweg 3 66123 Saarbrücken Germany {gebhard, klesen, rist}@dfki.de
More informationWP 7: Emotion in Cognition and Action
WP 7: Emotion in Cognition and Action Lola Cañamero, UH 2 nd Plenary, May 24-27 2005, Newcastle WP7: The context Emotion in cognition & action in multi-modal interfaces? Emotion-oriented systems adapted
More informationAnalysis of Emotion Recognition using Facial Expressions, Speech and Multimodal Information
Analysis of Emotion Recognition using Facial Expressions, Speech and Multimodal Information C. Busso, Z. Deng, S. Yildirim, M. Bulut, C. M. Lee, A. Kazemzadeh, S. Lee, U. Neumann, S. Narayanan Emotion
More informationD6c. Description of potential exemplars: Interaction. Catherine Pelachaud and WP6 members
Description of potential exemplars: Interaction Catherine Pelachaud and WP6 members Date: 30 th November 2004 IST project contract no. 507422 Project title Contractual date of delivery HUMAINE Human-Machine
More informationPSYC 222 Motivation and Emotions
PSYC 222 Motivation and Emotions Session 6 The Concept of Emotion Lecturer: Dr. Annabella Osei-Tutu, Psychology Department Contact Information: aopare-henaku@ug.edu.gh College of Education School of Continuing
More informationSARA: Social Affective Relational Agent: A Study on the Role of Empathy in Artificial Social Agents
SARA: Social Affective Relational Agent: A Study on the Role of Empathy in Artificial Social Agents Sandra Gama, Gabriel Barata, Daniel Gonçalves, Rui Prada, and Ana Paiva INESC-ID and Instituto Superior
More informationModel of Facial Expressions Management for an Embodied Conversational Agent
Model of Facial Expressions Management for an Embodied Conversational Agent Rados law Niewiadomski and Catherine Pelachaud IUT de Monreuil, Université Paris 8, France {niewiadomski,pelachaud}@iut.univ-paris8.fr
More informationIntelligent Expressions of Emotions
Intelligent Expressions of Emotions Magalie Ochs 1, Radosław Niewiadomski 2, Catherine Pelachaud 3 and David Sadek 1 1 France Telecom, R&D Division, Technology Center, France, {magalie.ochs, david.sadek}@francetelecom.com
More informationMastering Emotions. 1. Physiology
Mastering Emotions Emotional mastery is the key to living a life that you direct. The ability to have absolute direct power over what you feel in every single moment no matter what happens around you is
More informationCreating Adaptive and Individual Personalities in Many Characters Without Hand-Crafting Behaviors
Creating Adaptive and Individual Personalities in Many Characters Without Hand-Crafting Behaviors Jennifer Sandercock, Lin Padgham, and Fabio Zambetta School of Computer Science and Information Technology,
More informationPeer Support Meeting COMMUNICATION STRATEGIES
Peer Support Meeting COMMUNICATION STRATEGIES Communication Think of a situation where you missed out on an opportunity because of lack of communication. What communication skills in particular could have
More informationTalking Heads for the Web: what for? Koray Balci Fabio Pianesi Massimo Zancanaro
Talking Heads for the Web: what for? Koray Balci Fabio Pianesi Massimo Zancanaro Outline XFace an open source MPEG4-FAP based 3D Talking Head Standardization issues (beyond MPEG4) Synthetic Agents the
More informationEmotion-Aware Machines
Emotion-Aware Machines Saif Mohammad, Senior Research Officer National Research Council Canada 1 Emotion-Aware Machines Saif Mohammad National Research Council Canada 2 What does it mean for a machine
More informationChapter 3 Self-Esteem and Mental Health
Self-Esteem and Mental Health How frequently do you engage in the following behaviors? SCORING: 1 = never 2 = occasionally 3 = most of the time 4 = all of the time 1. I praise myself when I do a good job.
More informationCombining Logical with Emotional Reasoning in Natural Argumentation
Combining Logical with Emotional Reasoning in Natural Argumentation V. Carofiglio Intelligent Interfaces, Department of Informatics University of Bari, Italy carofiglio@di.uniba.it F. de Rosis Intelligent
More informationDescription and explanation of the major themes of The Curious Incident of the Dog in the other people, dealing with new environments, and making
How To Analyze People: Reading People, Body Language, Recognizing Emotions & Facial Expressions (Analyzing People, Body Language Books, How To Read Lies, Reading Facial Expressions) By Bradley Fairbanks
More informationTowards Behavioral Consistency in Animated Agents
University of Pennsylvania ScholarlyCommons Departmental Papers (CIS) Department of Computer & Information Science November 2000 Towards Behavioral Consistency in Animated Agents Norman I. Badler University
More informationElements of Communication
Communication Communication is the exchange of information, ideas, feelings, and thoughts Communication helps us know what the needs of others are and how to meet those needs Healthcare workers must be
More informationArtificial Emotions to Assist Social Coordination in HRI
Artificial Emotions to Assist Social Coordination in HRI Jekaterina Novikova, Leon Watts Department of Computer Science University of Bath Bath, BA2 7AY United Kingdom j.novikova@bath.ac.uk Abstract. Human-Robot
More informationEdge Level C Unit 4 Cluster 1 Face Facts: The Science of Facial Expressions
Edge Level C Unit 4 Cluster 1 Face Facts: The Science of Facial Expressions 1. Which group has been taught to read the clues in facial expressions? A. firefighters B. judges C. DEA agents D. border patrol
More informationLoving-Kindness Meditation
Loving-Kindness Meditation Compassion Meditation 10-15 min. Client Yes Loving-kindness means tender and benevolent affection. It is the wish that all beings (you and others) may be happy and that good
More informationEMOTIONAL INTELLIGENCE
EMOTIONAL INTELLIGENCE Ashley Gold, M.A. University of Missouri St. Louis Colarelli Meyer & Associates TOPICS Why does Emotional Intelligence (EI) matter? What is EI? Industrial-Organizational Perspective
More informationLECTURE 5: REACTIVE AND HYBRID ARCHITECTURES
Reactive Architectures LECTURE 5: REACTIVE AND HYBRID ARCHITECTURES An Introduction to MultiAgent Systems http://www.csc.liv.ac.uk/~mjw/pubs/imas There are many unsolved (some would say insoluble) problems
More informationAffective Computing: Emotions in human-computer. interaction. emotions.usc.edu
Affective Computing: Emotions in human-computer interaction gratch@ict.usc.edu; marsella@ict.usc.edu emotions.usc.edu Affective Computing The field of study concerned with understanding, recognizing and
More informationProposal for a Multiagent Architecture for Self-Organizing Systems (MA-SOS)
Proposal for a Multiagent Architecture for Self-Organizing Systems (MA-SOS) Niriaska Perozo 1, Jose Aguilar 2, and Oswaldo Terán 3 1 Unidad de Investigación en Inteligencia Artificial, UCLA, Barquisimeto
More informationAffect and Affordance: Architectures without Emotion
Affect and Affordance: Architectures without Emotion Darryl N. Davis, Suzanne C. Lewis and Gauvain Bourgne University of Hull, UK. Abstract General frameworks of mind map across tasks and domains. By what
More informationIs Asperger Syndrome The Same As Autism?
Asperger Syndrome BY: Rosalynd Lord Asperger Syndrome is a developmental disorder falling within the autistic spectrum affecting two- way social interaction, verbal and nonverbal communication and a reluctance
More informationK I N G. mentally ill E N. 38 myevt.com exceptional veterinary team March/April 2012
W OR K I N G W IT H mentally ill C LI E N TS 38 myevt.com exceptional veterinary team March/April 2012 Corissa C. Lotta, PhD, and Stacie L. Fishell, MA Peer Reviewed March/April 2012 exceptional veterinary
More informationHow is Believability of Virtual Agent Related to Warmth, Competence, Personification and. Embodiment? Virginie Demeure. Université de Toulouse
1 Running head: How is Believability of Virtual Agent Related to Warmth, Competence, Personification and Embodiment? Virginie Demeure Université de Toulouse CLLE-LTC, 5, allée Antonio Machado 31058 Toulouse
More informationEMOTION DETECTION FROM TEXT DOCUMENTS
EMOTION DETECTION FROM TEXT DOCUMENTS Shiv Naresh Shivhare and Sri Khetwat Saritha Department of CSE and IT, Maulana Azad National Institute of Technology, Bhopal, Madhya Pradesh, India ABSTRACT Emotion
More informationResearch Proposal on Emotion Recognition
Research Proposal on Emotion Recognition Colin Grubb June 3, 2012 Abstract In this paper I will introduce my thesis question: To what extent can emotion recognition be improved by combining audio and visual
More informationHow to Interact with Adults with Communication Difficulties
How to Interact with Adults with Communication Difficulties Monique Fourcaudot Professional Practice Leader Speech Language Pathologist p.1 Causes of Communication Difficulties Stroke Head Injury Degenerative
More informationEMOTIONAL LEARNING. Synonyms. Definition
EMOTIONAL LEARNING Claude Frasson and Alicia Heraz Department of Computer Science, University of Montreal Montreal (Québec) Canada {frasson,heraz}@umontreal.ca Synonyms Affective Learning, Emotional Intelligence,
More informationAn Empathic Virtual Dialog Agent to Improve Human-Machine Interaction
An Empathic Virtual Dialog Agent to Improve Human-Machine Interaction Magalie Ochs Université Paris 6, LIP6 Orange Labs France magalie.ochs@lip6.fr Catherine Pelachaud Université Paris 8, INRIA Rocquencourt
More informationModeling Emotion in Soar
Modeling Emotion in Soar Jonathan Gratch USC Institute for Creative Technologies Joint work with Stacy Marsella USC Information Sciences Institute Outline Human emotion can inform intelligent system design
More informationTowards building a Virtual Counselor: Modeling Nonverbal Behavior during Intimate Self-Disclosure
Towards building a Virtual Counselor: Modeling Nonverbal Behavior during Intimate Self-Disclosure Sin-Hwa Kang 1, Jonathan Gratch 1, Candy Sidner 2, Ron Artstein 1, Lixing Huang 1, and Louis-Philippe Morency
More informationI know you believe you understand what you think I said; but, I am not sure you realize what you heard is not what I meant.
I know you believe you understand what you think I said; but, I am not sure you realize what you heard is not what I meant. -Mother 1 Communication: Any connection between humans Both verbal & nonverbal.
More informationThe Regulation of Emotion
The Regulation of Emotion LP 8D Emotional Display 1 Emotions can be disruptive and troublesome. Negative feelings can prevent us from behaving as we would like to, but can so can positive feelings (page
More informationAbstract. Introduction. The Architectural Role of Emotion in Cognitive Systems. Jonathan Gratch and Stacy Marsella University of Southern California
Appears in Integrated Models of Cognitive Systems, Wayne Gray (ed.), Oxford University Press, 2006 1 The Architectural Role of Emotion in Cognitive Systems Jonathan Gratch and Stacy Marsella University
More informationINTERNATIONAL CERTIFICATE IN EMOTIONAL SKILLS AND COMPETENCIES A Paul Ekman Approved Course. A three day international certification program
A three day international certification program EMOTIONS - WHAT ARE THEY AND HOW DO WE DEAL WITH THEM? This course is about emotions - feeling, recognising and managing emotions in ourselves and others.
More informationEmotions and Motivation
Emotions and Motivation LP 8A emotions, theories of emotions 1 10.1 What Are Emotions? Emotions Vary in Valence and Arousal Emotions Have a Physiological Component What to Believe? Using Psychological
More informationemotions "affective computing" 30/3/
emotions "affective computing" 1 emotion and thought Globe & Mail, March 25, p. A15 "Emotions are an intrinsically human process..", [Dr. Mayberry] said. "One cannot separate emotions from thinking." Are
More informationBrain Mechanisms Explain Emotion and Consciousness. Paul Thagard University of Waterloo
Brain Mechanisms Explain Emotion and Consciousness Paul Thagard University of Waterloo 1 1. Why emotions matter 2. Theories 3. Semantic pointers 4. Emotions 5. Consciousness Outline 2 What is Emotion?
More informationAffective Advice Giving Dialogs
Affective Advice Giving Dialogs Addolorata Cavalluzzi, Valeria Carofiglio and Fiorella de Rosis Intelligent Interfaces, Department of Informatics, University of Bari {cavalluzzi,carofiglio,derosis}@di.uniba.it
More informationComputational Phronesis as a Possible Path toward Machine Emotional Integrity
Computational Phronesis as a Possible Path toward Machine Emotional Integrity Michal Ptaszynski Department of Computer Science, Kitami Institute of Technology!1 Computational Phronesis as a Possible Path
More informationWhat is Emotion? Emotion is a 4 part process consisting of: physiological arousal cognitive interpretation, subjective feelings behavioral expression.
What is Emotion? Emotion is a 4 part process consisting of: physiological arousal cognitive interpretation, subjective feelings behavioral expression. While our emotions are very different, they all involve
More informationEmotional Intelligence
Emotional Intelligence 1 Emotional Intelligence Emotional intelligence is your ability to recognize & understand emotions in yourself and others, and your ability to use this awareness to manage your behavior
More informationEmotions. These aspects are generally stronger in emotional responses than with moods. The duration of emotions tend to be shorter than moods.
LP 8D emotions & James/Lange 1 Emotions An emotion is a complex psychological state that involves subjective experience, physiological response, and behavioral or expressive responses. These aspects are
More informationMotion Control for Social Behaviours
Motion Control for Social Behaviours Aryel Beck a.beck@ntu.edu.sg Supervisor: Nadia Magnenat-Thalmann Collaborators: Zhang Zhijun, Rubha Shri Narayanan, Neetha Das 10-03-2015 INTRODUCTION In order for
More informationHow Is Believability of a Virtual Agent Related to Warmth, Competence, Personification, and Embodiment?
Virginie Demeure* Université de Toulouse 31058 Toulouse CEDEX 9, France Radosław Niewiadomski LTCI Telecom ParisTech How Is Believability of a Virtual Agent Related to Warmth, Competence, Personification,
More informationCommunications Sciences & Disorders Course Descriptions
Communications Sciences & Disorders Course Descriptions Undergraduate Level 3.2018 CSD 1126 Deaf Studies: 2 semester hours. Survey of the field of Deaf studies, emphasizing Deafhood, the role of allies;
More informationA Year of Tips for Communication Success
A Year of Tips for Communication Success 2143 Township Road 112 Millersburg, OH 44654 1-877-397-0178 info@saltillo.com www.saltillo.com Create Communication Success: Teach communication through modeling
More informationrelaxation and nervous system regulation exercises
relaxation and nervous system regulation exercises Objectives to provide a range of simple exercises that encourage the regular practice of relaxation and to help build resilience with increased awareness
More informationALMA A Layered Model of Affect
ALMA A Layered Model of Affect Patrick Gebhard German Research Center for Artificial Intelligence (DFKI) Stuhlsatzenhausweg 3 66123 Saarbrücken, Germany +49 681 3025258 patrick.gebhard@dfki.de ABSTRACT
More informationOn Alignment of Eye Behaviour in Human-Agent interaction
On Alignment of Eye Behaviour in Human-Agent interaction Huub Prüst Robbert-Jan Beun Rogier M. van Eijk Technical Report 2008-039 November 2008 Department of Information and Computing Sciences Utrecht
More informationGeneral Psych Thinking & Feeling
General Psych Thinking & Feeling Piaget s Theory Challenged Infants have more than reactive sensing Have some form of discrimination (reasoning) 1-month-old babies given a pacifier; never see it Babies
More informationNortheastern University Computer Science. Relational Agents in Nursing 5/25/2010. Relational Agents Group relationalagents.com
Relational Agents in Nursing Timothy Bickmore Northeastern University Boston, MA, USA Northeastern University Computer Science Founded 1982 26 FT faculty, 21 other staff 500 undergrads, 220 MS, 75 PhD
More informationThe Significance of Textures for Affective Interfaces
The Significance of Textures for Affective Interfaces Paula M. Ellis and Joanna J. Bryson Department of Computer Science, University of Bath, Bath BA2 7AY, United Kingdom paulini13@hotmail.com, J.J.Bryson@bath.ac.uk
More informationWhat is effective communication?
Communication What is effective communication? - Communication: Any connection between humans - Both verbal & non-verbal. - You cannot not communicate. * We are ALWAYS communicating. What are the five
More informationUnderstanding RUTH: Creating Believable Behaviors for a Virtual Human under Uncertainty
Understanding RUTH: Creating Believable Behaviors for a Virtual Human under Uncertainty Insuk Oh and Matthew Stone Department of Computer Science Rutgers, The State University of New Jersey 11 Frelinghuysen
More informationIncorporating Emotion Regulation into Virtual Stories
Incorporating Emotion Regulation into Virtual Stories Tibor Bosse, Matthijs Pontier, Ghazanfar F. Siddiqui, and Jan Treur Vrije Universiteit Amsterdam, Department of Artificial Intelligence, De Boelelaan
More informationInteractively Learning Nonverbal Behavior for Inference and Production: A Machine Learning Approach
Interactively Learning Nonverbal Behavior for Inference and Production: A Machine Learning Approach Jin Joo Lee MIT Media Lab Cambridge, MA 02142 USA jinjoo@media.mit.edu Cynthia Breazeal MIT Media Lab
More informationFrom Diagnostic and Statistical Manual of Mental Disorders: DSM IV
From Diagnostic and Statistical Manual of Mental Disorders: DSM IV (I) A total of six (or more) items from (A), (B), and (C), with at least two from (A), and one each from (B) and (C) (A) qualitative impairment
More informationA step toward irrationality: using emotion to change belief
Appears in the First International Joint Conference on Autonomous Agents and Multiagent Systems, Bologna, Italy 2002 A step toward irrationality: using emotion to change belief Stacy Marsella University
More informationAn assistive application identifying emotional state and executing a methodical healing process for depressive individuals.
An assistive application identifying emotional state and executing a methodical healing process for depressive individuals. Bandara G.M.M.B.O bhanukab@gmail.com Godawita B.M.D.T tharu9363@gmail.com Gunathilaka
More informationMPEG-4 Facial Expression Synthesis based on Appraisal Theory
MPEG-4 Facial Expression Synthesis based on Appraisal Theory L. Malatesta, A. Raouzaiou, K. Karpouzis and S. Kollias Image, Video and Multimedia Systems Laboratory, National Technical University of Athens,
More informationIntroduction to Cultivating Emotional Balance
Introduction to Cultivating Emotional Balance History of CEB Results of Research: CEB participants showed: Significant decrease in depression, anxiety and hostility over 5-week period Significant increase
More informationMulti-Space Behavioural Model for Face-based Affective Social Agents
Multi-Space Behavioural Model for Face-based Affective Social Agents Ali Arya 1 and Steve DiPaola 2 1 School of Information Technology, Carleton University, Ottawa, ON, Canada, arya@carleton.ca 2 School
More informationInteracting with people
Learning Guide Interacting with people 28518 Interact with people to provide support in a health or wellbeing setting Level 2 5 credits Name: Workplace: Issue 1.0 Copyright 2017 Careerforce All rights
More informationAMERICAN SIGN LANGUAGE (ASL) INTRODUCTORY 11
Area of Learning: SECOND LANGUAGES ASL Introductory Grade 11 Description AMERICAN SIGN LANGUAGE (ASL) INTRODUCTORY 11 American Sign Language (ASL) Introductory 11 has been developed to offer an opportunity
More information